00:00:00.001 Started by upstream project "autotest-nightly-lts" build number 2470 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3731 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.121 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.121 The recommended git tool is: git 00:00:00.122 using credential 00000000-0000-0000-0000-000000000002 00:00:00.123 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.163 Fetching changes from the remote Git repository 00:00:00.165 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.200 Using shallow fetch with depth 1 00:00:00.200 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.200 > git --version # timeout=10 00:00:00.232 > git --version # 'git version 2.39.2' 00:00:00.232 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.258 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.258 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.538 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.550 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.562 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:06.562 > git config core.sparsecheckout # timeout=10 00:00:06.574 > git read-tree -mu HEAD # timeout=10 00:00:06.588 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:06.610 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:06.610 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.698 [Pipeline] Start of Pipeline 00:00:06.709 [Pipeline] library 00:00:06.711 Loading library shm_lib@master 00:00:06.711 Library shm_lib@master is cached. Copying from home. 00:00:06.726 [Pipeline] node 00:00:06.748 Running on WFP4 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.750 [Pipeline] { 00:00:06.758 [Pipeline] catchError 00:00:06.759 [Pipeline] { 00:00:06.768 [Pipeline] wrap 00:00:06.775 [Pipeline] { 00:00:06.781 [Pipeline] stage 00:00:06.782 [Pipeline] { (Prologue) 00:00:07.018 [Pipeline] sh 00:00:07.299 + logger -p user.info -t JENKINS-CI 00:00:07.312 [Pipeline] echo 00:00:07.313 Node: WFP4 00:00:07.321 [Pipeline] sh 00:00:07.615 [Pipeline] setCustomBuildProperty 00:00:07.628 [Pipeline] echo 00:00:07.630 Cleanup processes 00:00:07.636 [Pipeline] sh 00:00:07.919 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.919 103464 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.933 [Pipeline] sh 00:00:08.217 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:08.217 ++ grep -v 'sudo pgrep' 00:00:08.217 ++ awk '{print $1}' 00:00:08.217 + sudo kill -9 00:00:08.217 + true 00:00:08.230 [Pipeline] cleanWs 00:00:08.239 [WS-CLEANUP] Deleting project workspace... 00:00:08.239 [WS-CLEANUP] Deferred wipeout is used... 00:00:08.244 [WS-CLEANUP] done 00:00:08.248 [Pipeline] setCustomBuildProperty 00:00:08.261 [Pipeline] sh 00:00:08.541 + sudo git config --global --replace-all safe.directory '*' 00:00:08.611 [Pipeline] httpRequest 00:00:09.414 [Pipeline] echo 00:00:09.416 Sorcerer 10.211.164.20 is alive 00:00:09.426 [Pipeline] retry 00:00:09.427 [Pipeline] { 00:00:09.442 [Pipeline] httpRequest 00:00:09.446 HttpMethod: GET 00:00:09.446 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.447 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.468 Response Code: HTTP/1.1 200 OK 00:00:09.468 Success: Status code 200 is in the accepted range: 200,404 00:00:09.469 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.033 [Pipeline] } 00:00:13.051 [Pipeline] // retry 00:00:13.059 [Pipeline] sh 00:00:13.344 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:13.359 [Pipeline] httpRequest 00:00:13.754 [Pipeline] echo 00:00:13.756 Sorcerer 10.211.164.20 is alive 00:00:13.766 [Pipeline] retry 00:00:13.768 [Pipeline] { 00:00:13.782 [Pipeline] httpRequest 00:00:13.787 HttpMethod: GET 00:00:13.787 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:13.787 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:13.801 Response Code: HTTP/1.1 200 OK 00:00:13.802 Success: Status code 200 is in the accepted range: 200,404 00:00:13.802 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:05.904 [Pipeline] } 00:01:05.922 [Pipeline] // retry 00:01:05.930 [Pipeline] sh 00:01:06.215 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:01:08.763 [Pipeline] sh 00:01:09.046 + git -C spdk log --oneline -n5 00:01:09.046 c13c99a5e test: Various fixes for Fedora40 00:01:09.046 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:01:09.046 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:01:09.046 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:01:09.046 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:01:09.056 [Pipeline] } 00:01:09.070 [Pipeline] // stage 00:01:09.078 [Pipeline] stage 00:01:09.080 [Pipeline] { (Prepare) 00:01:09.096 [Pipeline] writeFile 00:01:09.111 [Pipeline] sh 00:01:09.393 + logger -p user.info -t JENKINS-CI 00:01:09.405 [Pipeline] sh 00:01:09.689 + logger -p user.info -t JENKINS-CI 00:01:09.701 [Pipeline] sh 00:01:09.984 + cat autorun-spdk.conf 00:01:09.984 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:09.985 SPDK_TEST_NVMF=1 00:01:09.985 SPDK_TEST_NVME_CLI=1 00:01:09.985 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:09.985 SPDK_TEST_NVMF_NICS=e810 00:01:09.985 SPDK_RUN_UBSAN=1 00:01:09.985 NET_TYPE=phy 00:01:09.992 RUN_NIGHTLY=1 00:01:09.996 [Pipeline] readFile 00:01:10.023 [Pipeline] withEnv 00:01:10.025 [Pipeline] { 00:01:10.056 [Pipeline] sh 00:01:10.341 + set -ex 00:01:10.341 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:10.341 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:10.341 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:10.341 ++ SPDK_TEST_NVMF=1 00:01:10.341 ++ SPDK_TEST_NVME_CLI=1 00:01:10.341 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:10.341 ++ SPDK_TEST_NVMF_NICS=e810 00:01:10.341 ++ SPDK_RUN_UBSAN=1 00:01:10.341 ++ NET_TYPE=phy 00:01:10.341 ++ RUN_NIGHTLY=1 00:01:10.341 + case $SPDK_TEST_NVMF_NICS in 00:01:10.341 + DRIVERS=ice 00:01:10.341 + [[ tcp == \r\d\m\a ]] 00:01:10.341 + [[ -n ice ]] 00:01:10.341 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:10.341 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:10.341 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:10.341 rmmod: ERROR: Module i40iw is not currently loaded 00:01:10.341 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:10.341 + true 00:01:10.341 + for D in $DRIVERS 00:01:10.341 + sudo modprobe ice 00:01:10.341 + exit 0 00:01:10.351 [Pipeline] } 00:01:10.365 [Pipeline] // withEnv 00:01:10.370 [Pipeline] } 00:01:10.384 [Pipeline] // stage 00:01:10.394 [Pipeline] catchError 00:01:10.395 [Pipeline] { 00:01:10.409 [Pipeline] timeout 00:01:10.409 Timeout set to expire in 1 hr 0 min 00:01:10.410 [Pipeline] { 00:01:10.423 [Pipeline] stage 00:01:10.425 [Pipeline] { (Tests) 00:01:10.439 [Pipeline] sh 00:01:10.723 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:10.723 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:10.723 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:10.723 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:10.723 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:10.723 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:10.723 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:10.723 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:10.723 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:10.723 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:10.723 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:10.723 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:10.723 + source /etc/os-release 00:01:10.723 ++ NAME='Fedora Linux' 00:01:10.723 ++ VERSION='39 (Cloud Edition)' 00:01:10.723 ++ ID=fedora 00:01:10.723 ++ VERSION_ID=39 00:01:10.723 ++ VERSION_CODENAME= 00:01:10.723 ++ PLATFORM_ID=platform:f39 00:01:10.723 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:10.723 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:10.723 ++ LOGO=fedora-logo-icon 00:01:10.723 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:10.723 ++ HOME_URL=https://fedoraproject.org/ 00:01:10.723 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:10.723 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:10.723 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:10.723 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:10.723 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:10.723 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:10.723 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:10.723 ++ SUPPORT_END=2024-11-12 00:01:10.723 ++ VARIANT='Cloud Edition' 00:01:10.723 ++ VARIANT_ID=cloud 00:01:10.723 + uname -a 00:01:10.723 Linux spdk-wfp-04 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 05:41:37 UTC 2024 x86_64 GNU/Linux 00:01:10.723 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:12.629 Hugepages 00:01:12.629 node hugesize free / total 00:01:12.629 node0 1048576kB 0 / 0 00:01:12.629 node0 2048kB 0 / 0 00:01:12.629 node1 1048576kB 0 / 0 00:01:12.629 node1 2048kB 0 / 0 00:01:12.629 00:01:12.629 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:12.629 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:01:12.630 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:01:12.630 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:01:12.630 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:01:12.630 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:01:12.630 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:01:12.630 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:01:12.630 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:01:12.630 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:01:12.630 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:01:12.630 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:01:12.630 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:01:12.630 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:01:12.630 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:01:12.630 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:01:12.630 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:01:12.630 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:01:12.889 + rm -f /tmp/spdk-ld-path 00:01:12.889 + source autorun-spdk.conf 00:01:12.889 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:12.889 ++ SPDK_TEST_NVMF=1 00:01:12.889 ++ SPDK_TEST_NVME_CLI=1 00:01:12.889 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:12.889 ++ SPDK_TEST_NVMF_NICS=e810 00:01:12.889 ++ SPDK_RUN_UBSAN=1 00:01:12.889 ++ NET_TYPE=phy 00:01:12.889 ++ RUN_NIGHTLY=1 00:01:12.889 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:12.889 + [[ -n '' ]] 00:01:12.889 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:12.889 + for M in /var/spdk/build-*-manifest.txt 00:01:12.889 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:12.889 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:12.889 + for M in /var/spdk/build-*-manifest.txt 00:01:12.889 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:12.889 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:12.889 + for M in /var/spdk/build-*-manifest.txt 00:01:12.889 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:12.889 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:12.889 ++ uname 00:01:12.889 + [[ Linux == \L\i\n\u\x ]] 00:01:12.889 + sudo dmesg -T 00:01:12.890 + sudo dmesg --clear 00:01:12.890 + dmesg_pid=104375 00:01:12.890 + [[ Fedora Linux == FreeBSD ]] 00:01:12.890 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:12.890 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:12.890 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:12.890 + [[ -x /usr/src/fio-static/fio ]] 00:01:12.890 + export FIO_BIN=/usr/src/fio-static/fio 00:01:12.890 + FIO_BIN=/usr/src/fio-static/fio 00:01:12.890 + sudo dmesg -Tw 00:01:12.890 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:12.890 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:12.890 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:12.890 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:12.890 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:12.890 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:12.890 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:12.890 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:12.890 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:12.890 Test configuration: 00:01:12.890 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:12.890 SPDK_TEST_NVMF=1 00:01:12.890 SPDK_TEST_NVME_CLI=1 00:01:12.890 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:12.890 SPDK_TEST_NVMF_NICS=e810 00:01:12.890 SPDK_RUN_UBSAN=1 00:01:12.890 NET_TYPE=phy 00:01:12.890 RUN_NIGHTLY=1 14:05:27 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:12.890 14:05:27 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:12.890 14:05:27 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:12.890 14:05:27 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:12.890 14:05:27 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:12.890 14:05:27 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:12.890 14:05:27 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:12.890 14:05:27 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:12.890 14:05:27 -- paths/export.sh@5 -- $ export PATH 00:01:12.890 14:05:27 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:12.890 14:05:27 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:12.890 14:05:27 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:12.890 14:05:27 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1734354327.XXXXXX 00:01:12.890 14:05:27 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1734354327.6crrBP 00:01:12.890 14:05:27 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:12.890 14:05:27 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:01:12.890 14:05:27 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:01:12.890 14:05:27 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:12.890 14:05:27 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:12.890 14:05:27 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:12.890 14:05:27 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:12.890 14:05:27 -- common/autotest_common.sh@10 -- $ set +x 00:01:12.890 14:05:27 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:01:12.890 14:05:27 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:12.890 14:05:27 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:12.890 14:05:27 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:12.890 14:05:27 -- spdk/autobuild.sh@16 -- $ date -u 00:01:12.890 Mon Dec 16 01:05:27 PM UTC 2024 00:01:12.890 14:05:27 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:12.890 LTS-67-gc13c99a5e 00:01:12.890 14:05:27 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:12.890 14:05:27 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:12.890 14:05:27 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:12.890 14:05:27 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:12.890 14:05:27 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:12.890 14:05:27 -- common/autotest_common.sh@10 -- $ set +x 00:01:12.890 ************************************ 00:01:12.890 START TEST ubsan 00:01:12.890 ************************************ 00:01:12.890 14:05:27 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:12.890 using ubsan 00:01:12.890 00:01:12.890 real 0m0.000s 00:01:12.890 user 0m0.000s 00:01:12.890 sys 0m0.000s 00:01:12.890 14:05:27 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:12.890 14:05:27 -- common/autotest_common.sh@10 -- $ set +x 00:01:12.890 ************************************ 00:01:12.890 END TEST ubsan 00:01:12.890 ************************************ 00:01:12.890 14:05:27 -- spdk/autobuild.sh@27 -- $ '[' -n '' ']' 00:01:12.890 14:05:27 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:01:12.890 14:05:27 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:01:12.890 14:05:27 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:01:12.890 14:05:27 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:01:12.890 14:05:27 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:01:12.890 14:05:27 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:01:12.890 14:05:27 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:01:12.890 14:05:27 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-shared 00:01:13.150 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:01:13.150 Using default DPDK in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:13.409 Using 'verbs' RDMA provider 00:01:26.195 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:01:36.183 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:01:36.183 Creating mk/config.mk...done. 00:01:36.183 Creating mk/cc.flags.mk...done. 00:01:36.183 Type 'make' to build. 00:01:36.183 14:05:50 -- spdk/autobuild.sh@69 -- $ run_test make make -j96 00:01:36.183 14:05:50 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:36.183 14:05:50 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:36.183 14:05:50 -- common/autotest_common.sh@10 -- $ set +x 00:01:36.183 ************************************ 00:01:36.183 START TEST make 00:01:36.183 ************************************ 00:01:36.183 14:05:50 -- common/autotest_common.sh@1114 -- $ make -j96 00:01:36.183 make[1]: Nothing to be done for 'all'. 00:01:44.401 The Meson build system 00:01:44.401 Version: 1.5.0 00:01:44.401 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk 00:01:44.401 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp 00:01:44.401 Build type: native build 00:01:44.401 Program cat found: YES (/usr/bin/cat) 00:01:44.401 Project name: DPDK 00:01:44.401 Project version: 23.11.0 00:01:44.401 C compiler for the host machine: cc (gcc 13.3.1 "cc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:44.401 C linker for the host machine: cc ld.bfd 2.40-14 00:01:44.401 Host machine cpu family: x86_64 00:01:44.401 Host machine cpu: x86_64 00:01:44.401 Message: ## Building in Developer Mode ## 00:01:44.401 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:44.401 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/check-symbols.sh) 00:01:44.401 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/buildtools/options-ibverbs-static.sh) 00:01:44.401 Program python3 found: YES (/usr/bin/python3) 00:01:44.401 Program cat found: YES (/usr/bin/cat) 00:01:44.401 Compiler for C supports arguments -march=native: YES 00:01:44.401 Checking for size of "void *" : 8 00:01:44.401 Checking for size of "void *" : 8 (cached) 00:01:44.401 Library m found: YES 00:01:44.401 Library numa found: YES 00:01:44.401 Has header "numaif.h" : YES 00:01:44.401 Library fdt found: NO 00:01:44.401 Library execinfo found: NO 00:01:44.401 Has header "execinfo.h" : YES 00:01:44.401 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:44.401 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:44.401 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:44.401 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:44.401 Run-time dependency openssl found: YES 3.1.1 00:01:44.401 Run-time dependency libpcap found: YES 1.10.4 00:01:44.401 Has header "pcap.h" with dependency libpcap: YES 00:01:44.401 Compiler for C supports arguments -Wcast-qual: YES 00:01:44.401 Compiler for C supports arguments -Wdeprecated: YES 00:01:44.401 Compiler for C supports arguments -Wformat: YES 00:01:44.401 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:44.401 Compiler for C supports arguments -Wformat-security: NO 00:01:44.401 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:44.401 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:44.401 Compiler for C supports arguments -Wnested-externs: YES 00:01:44.401 Compiler for C supports arguments -Wold-style-definition: YES 00:01:44.401 Compiler for C supports arguments -Wpointer-arith: YES 00:01:44.401 Compiler for C supports arguments -Wsign-compare: YES 00:01:44.401 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:44.401 Compiler for C supports arguments -Wundef: YES 00:01:44.401 Compiler for C supports arguments -Wwrite-strings: YES 00:01:44.401 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:44.401 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:44.401 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:44.401 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:44.401 Program objdump found: YES (/usr/bin/objdump) 00:01:44.401 Compiler for C supports arguments -mavx512f: YES 00:01:44.401 Checking if "AVX512 checking" compiles: YES 00:01:44.402 Fetching value of define "__SSE4_2__" : 1 00:01:44.402 Fetching value of define "__AES__" : 1 00:01:44.402 Fetching value of define "__AVX__" : 1 00:01:44.402 Fetching value of define "__AVX2__" : 1 00:01:44.402 Fetching value of define "__AVX512BW__" : 1 00:01:44.402 Fetching value of define "__AVX512CD__" : 1 00:01:44.402 Fetching value of define "__AVX512DQ__" : 1 00:01:44.402 Fetching value of define "__AVX512F__" : 1 00:01:44.402 Fetching value of define "__AVX512VL__" : 1 00:01:44.402 Fetching value of define "__PCLMUL__" : 1 00:01:44.402 Fetching value of define "__RDRND__" : 1 00:01:44.402 Fetching value of define "__RDSEED__" : 1 00:01:44.402 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:44.402 Fetching value of define "__znver1__" : (undefined) 00:01:44.402 Fetching value of define "__znver2__" : (undefined) 00:01:44.402 Fetching value of define "__znver3__" : (undefined) 00:01:44.402 Fetching value of define "__znver4__" : (undefined) 00:01:44.402 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:44.402 Message: lib/log: Defining dependency "log" 00:01:44.402 Message: lib/kvargs: Defining dependency "kvargs" 00:01:44.402 Message: lib/telemetry: Defining dependency "telemetry" 00:01:44.402 Checking for function "getentropy" : NO 00:01:44.402 Message: lib/eal: Defining dependency "eal" 00:01:44.402 Message: lib/ring: Defining dependency "ring" 00:01:44.402 Message: lib/rcu: Defining dependency "rcu" 00:01:44.402 Message: lib/mempool: Defining dependency "mempool" 00:01:44.402 Message: lib/mbuf: Defining dependency "mbuf" 00:01:44.402 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:44.402 Fetching value of define "__AVX512F__" : 1 (cached) 00:01:44.402 Fetching value of define "__AVX512BW__" : 1 (cached) 00:01:44.402 Fetching value of define "__AVX512DQ__" : 1 (cached) 00:01:44.402 Fetching value of define "__AVX512VL__" : 1 (cached) 00:01:44.402 Fetching value of define "__VPCLMULQDQ__" : (undefined) (cached) 00:01:44.402 Compiler for C supports arguments -mpclmul: YES 00:01:44.402 Compiler for C supports arguments -maes: YES 00:01:44.402 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:44.402 Compiler for C supports arguments -mavx512bw: YES 00:01:44.402 Compiler for C supports arguments -mavx512dq: YES 00:01:44.402 Compiler for C supports arguments -mavx512vl: YES 00:01:44.402 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:44.402 Compiler for C supports arguments -mavx2: YES 00:01:44.402 Compiler for C supports arguments -mavx: YES 00:01:44.402 Message: lib/net: Defining dependency "net" 00:01:44.402 Message: lib/meter: Defining dependency "meter" 00:01:44.402 Message: lib/ethdev: Defining dependency "ethdev" 00:01:44.402 Message: lib/pci: Defining dependency "pci" 00:01:44.402 Message: lib/cmdline: Defining dependency "cmdline" 00:01:44.402 Message: lib/hash: Defining dependency "hash" 00:01:44.402 Message: lib/timer: Defining dependency "timer" 00:01:44.402 Message: lib/compressdev: Defining dependency "compressdev" 00:01:44.402 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:44.402 Message: lib/dmadev: Defining dependency "dmadev" 00:01:44.402 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:44.402 Message: lib/power: Defining dependency "power" 00:01:44.402 Message: lib/reorder: Defining dependency "reorder" 00:01:44.402 Message: lib/security: Defining dependency "security" 00:01:44.402 Has header "linux/userfaultfd.h" : YES 00:01:44.402 Has header "linux/vduse.h" : YES 00:01:44.402 Message: lib/vhost: Defining dependency "vhost" 00:01:44.402 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:44.402 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:44.402 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:44.402 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:44.402 Message: Disabling raw/* drivers: missing internal dependency "rawdev" 00:01:44.402 Message: Disabling regex/* drivers: missing internal dependency "regexdev" 00:01:44.402 Message: Disabling ml/* drivers: missing internal dependency "mldev" 00:01:44.402 Message: Disabling event/* drivers: missing internal dependency "eventdev" 00:01:44.402 Message: Disabling baseband/* drivers: missing internal dependency "bbdev" 00:01:44.402 Message: Disabling gpu/* drivers: missing internal dependency "gpudev" 00:01:44.402 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:44.402 Configuring doxy-api-html.conf using configuration 00:01:44.402 Configuring doxy-api-man.conf using configuration 00:01:44.402 Program mandb found: YES (/usr/bin/mandb) 00:01:44.402 Program sphinx-build found: NO 00:01:44.402 Configuring rte_build_config.h using configuration 00:01:44.402 Message: 00:01:44.402 ================= 00:01:44.402 Applications Enabled 00:01:44.402 ================= 00:01:44.402 00:01:44.402 apps: 00:01:44.402 00:01:44.402 00:01:44.402 Message: 00:01:44.402 ================= 00:01:44.402 Libraries Enabled 00:01:44.402 ================= 00:01:44.402 00:01:44.402 libs: 00:01:44.402 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:44.402 net, meter, ethdev, pci, cmdline, hash, timer, compressdev, 00:01:44.402 cryptodev, dmadev, power, reorder, security, vhost, 00:01:44.402 00:01:44.402 Message: 00:01:44.402 =============== 00:01:44.402 Drivers Enabled 00:01:44.402 =============== 00:01:44.402 00:01:44.402 common: 00:01:44.402 00:01:44.402 bus: 00:01:44.402 pci, vdev, 00:01:44.402 mempool: 00:01:44.402 ring, 00:01:44.402 dma: 00:01:44.402 00:01:44.402 net: 00:01:44.402 00:01:44.403 crypto: 00:01:44.403 00:01:44.403 compress: 00:01:44.403 00:01:44.403 vdpa: 00:01:44.403 00:01:44.403 00:01:44.403 Message: 00:01:44.403 ================= 00:01:44.403 Content Skipped 00:01:44.403 ================= 00:01:44.403 00:01:44.403 apps: 00:01:44.403 dumpcap: explicitly disabled via build config 00:01:44.403 graph: explicitly disabled via build config 00:01:44.403 pdump: explicitly disabled via build config 00:01:44.403 proc-info: explicitly disabled via build config 00:01:44.403 test-acl: explicitly disabled via build config 00:01:44.403 test-bbdev: explicitly disabled via build config 00:01:44.403 test-cmdline: explicitly disabled via build config 00:01:44.403 test-compress-perf: explicitly disabled via build config 00:01:44.403 test-crypto-perf: explicitly disabled via build config 00:01:44.403 test-dma-perf: explicitly disabled via build config 00:01:44.403 test-eventdev: explicitly disabled via build config 00:01:44.403 test-fib: explicitly disabled via build config 00:01:44.403 test-flow-perf: explicitly disabled via build config 00:01:44.403 test-gpudev: explicitly disabled via build config 00:01:44.403 test-mldev: explicitly disabled via build config 00:01:44.403 test-pipeline: explicitly disabled via build config 00:01:44.403 test-pmd: explicitly disabled via build config 00:01:44.403 test-regex: explicitly disabled via build config 00:01:44.403 test-sad: explicitly disabled via build config 00:01:44.403 test-security-perf: explicitly disabled via build config 00:01:44.403 00:01:44.403 libs: 00:01:44.403 metrics: explicitly disabled via build config 00:01:44.403 acl: explicitly disabled via build config 00:01:44.403 bbdev: explicitly disabled via build config 00:01:44.403 bitratestats: explicitly disabled via build config 00:01:44.403 bpf: explicitly disabled via build config 00:01:44.403 cfgfile: explicitly disabled via build config 00:01:44.403 distributor: explicitly disabled via build config 00:01:44.403 efd: explicitly disabled via build config 00:01:44.403 eventdev: explicitly disabled via build config 00:01:44.403 dispatcher: explicitly disabled via build config 00:01:44.403 gpudev: explicitly disabled via build config 00:01:44.403 gro: explicitly disabled via build config 00:01:44.403 gso: explicitly disabled via build config 00:01:44.403 ip_frag: explicitly disabled via build config 00:01:44.403 jobstats: explicitly disabled via build config 00:01:44.403 latencystats: explicitly disabled via build config 00:01:44.403 lpm: explicitly disabled via build config 00:01:44.403 member: explicitly disabled via build config 00:01:44.403 pcapng: explicitly disabled via build config 00:01:44.403 rawdev: explicitly disabled via build config 00:01:44.403 regexdev: explicitly disabled via build config 00:01:44.403 mldev: explicitly disabled via build config 00:01:44.403 rib: explicitly disabled via build config 00:01:44.403 sched: explicitly disabled via build config 00:01:44.403 stack: explicitly disabled via build config 00:01:44.403 ipsec: explicitly disabled via build config 00:01:44.403 pdcp: explicitly disabled via build config 00:01:44.403 fib: explicitly disabled via build config 00:01:44.403 port: explicitly disabled via build config 00:01:44.403 pdump: explicitly disabled via build config 00:01:44.403 table: explicitly disabled via build config 00:01:44.403 pipeline: explicitly disabled via build config 00:01:44.403 graph: explicitly disabled via build config 00:01:44.403 node: explicitly disabled via build config 00:01:44.403 00:01:44.403 drivers: 00:01:44.403 common/cpt: not in enabled drivers build config 00:01:44.403 common/dpaax: not in enabled drivers build config 00:01:44.403 common/iavf: not in enabled drivers build config 00:01:44.403 common/idpf: not in enabled drivers build config 00:01:44.403 common/mvep: not in enabled drivers build config 00:01:44.403 common/octeontx: not in enabled drivers build config 00:01:44.403 bus/auxiliary: not in enabled drivers build config 00:01:44.403 bus/cdx: not in enabled drivers build config 00:01:44.403 bus/dpaa: not in enabled drivers build config 00:01:44.403 bus/fslmc: not in enabled drivers build config 00:01:44.403 bus/ifpga: not in enabled drivers build config 00:01:44.403 bus/platform: not in enabled drivers build config 00:01:44.403 bus/vmbus: not in enabled drivers build config 00:01:44.403 common/cnxk: not in enabled drivers build config 00:01:44.403 common/mlx5: not in enabled drivers build config 00:01:44.403 common/nfp: not in enabled drivers build config 00:01:44.403 common/qat: not in enabled drivers build config 00:01:44.403 common/sfc_efx: not in enabled drivers build config 00:01:44.403 mempool/bucket: not in enabled drivers build config 00:01:44.403 mempool/cnxk: not in enabled drivers build config 00:01:44.403 mempool/dpaa: not in enabled drivers build config 00:01:44.403 mempool/dpaa2: not in enabled drivers build config 00:01:44.403 mempool/octeontx: not in enabled drivers build config 00:01:44.403 mempool/stack: not in enabled drivers build config 00:01:44.403 dma/cnxk: not in enabled drivers build config 00:01:44.403 dma/dpaa: not in enabled drivers build config 00:01:44.403 dma/dpaa2: not in enabled drivers build config 00:01:44.403 dma/hisilicon: not in enabled drivers build config 00:01:44.403 dma/idxd: not in enabled drivers build config 00:01:44.403 dma/ioat: not in enabled drivers build config 00:01:44.403 dma/skeleton: not in enabled drivers build config 00:01:44.403 net/af_packet: not in enabled drivers build config 00:01:44.403 net/af_xdp: not in enabled drivers build config 00:01:44.403 net/ark: not in enabled drivers build config 00:01:44.403 net/atlantic: not in enabled drivers build config 00:01:44.403 net/avp: not in enabled drivers build config 00:01:44.403 net/axgbe: not in enabled drivers build config 00:01:44.403 net/bnx2x: not in enabled drivers build config 00:01:44.403 net/bnxt: not in enabled drivers build config 00:01:44.403 net/bonding: not in enabled drivers build config 00:01:44.403 net/cnxk: not in enabled drivers build config 00:01:44.404 net/cpfl: not in enabled drivers build config 00:01:44.404 net/cxgbe: not in enabled drivers build config 00:01:44.404 net/dpaa: not in enabled drivers build config 00:01:44.404 net/dpaa2: not in enabled drivers build config 00:01:44.404 net/e1000: not in enabled drivers build config 00:01:44.404 net/ena: not in enabled drivers build config 00:01:44.404 net/enetc: not in enabled drivers build config 00:01:44.404 net/enetfec: not in enabled drivers build config 00:01:44.404 net/enic: not in enabled drivers build config 00:01:44.404 net/failsafe: not in enabled drivers build config 00:01:44.404 net/fm10k: not in enabled drivers build config 00:01:44.404 net/gve: not in enabled drivers build config 00:01:44.404 net/hinic: not in enabled drivers build config 00:01:44.404 net/hns3: not in enabled drivers build config 00:01:44.404 net/i40e: not in enabled drivers build config 00:01:44.404 net/iavf: not in enabled drivers build config 00:01:44.404 net/ice: not in enabled drivers build config 00:01:44.404 net/idpf: not in enabled drivers build config 00:01:44.404 net/igc: not in enabled drivers build config 00:01:44.404 net/ionic: not in enabled drivers build config 00:01:44.404 net/ipn3ke: not in enabled drivers build config 00:01:44.404 net/ixgbe: not in enabled drivers build config 00:01:44.404 net/mana: not in enabled drivers build config 00:01:44.404 net/memif: not in enabled drivers build config 00:01:44.404 net/mlx4: not in enabled drivers build config 00:01:44.404 net/mlx5: not in enabled drivers build config 00:01:44.404 net/mvneta: not in enabled drivers build config 00:01:44.404 net/mvpp2: not in enabled drivers build config 00:01:44.404 net/netvsc: not in enabled drivers build config 00:01:44.404 net/nfb: not in enabled drivers build config 00:01:44.404 net/nfp: not in enabled drivers build config 00:01:44.404 net/ngbe: not in enabled drivers build config 00:01:44.404 net/null: not in enabled drivers build config 00:01:44.404 net/octeontx: not in enabled drivers build config 00:01:44.404 net/octeon_ep: not in enabled drivers build config 00:01:44.404 net/pcap: not in enabled drivers build config 00:01:44.404 net/pfe: not in enabled drivers build config 00:01:44.404 net/qede: not in enabled drivers build config 00:01:44.404 net/ring: not in enabled drivers build config 00:01:44.404 net/sfc: not in enabled drivers build config 00:01:44.404 net/softnic: not in enabled drivers build config 00:01:44.404 net/tap: not in enabled drivers build config 00:01:44.404 net/thunderx: not in enabled drivers build config 00:01:44.404 net/txgbe: not in enabled drivers build config 00:01:44.404 net/vdev_netvsc: not in enabled drivers build config 00:01:44.404 net/vhost: not in enabled drivers build config 00:01:44.404 net/virtio: not in enabled drivers build config 00:01:44.404 net/vmxnet3: not in enabled drivers build config 00:01:44.404 raw/*: missing internal dependency, "rawdev" 00:01:44.404 crypto/armv8: not in enabled drivers build config 00:01:44.404 crypto/bcmfs: not in enabled drivers build config 00:01:44.404 crypto/caam_jr: not in enabled drivers build config 00:01:44.404 crypto/ccp: not in enabled drivers build config 00:01:44.404 crypto/cnxk: not in enabled drivers build config 00:01:44.404 crypto/dpaa_sec: not in enabled drivers build config 00:01:44.404 crypto/dpaa2_sec: not in enabled drivers build config 00:01:44.404 crypto/ipsec_mb: not in enabled drivers build config 00:01:44.404 crypto/mlx5: not in enabled drivers build config 00:01:44.404 crypto/mvsam: not in enabled drivers build config 00:01:44.404 crypto/nitrox: not in enabled drivers build config 00:01:44.404 crypto/null: not in enabled drivers build config 00:01:44.404 crypto/octeontx: not in enabled drivers build config 00:01:44.404 crypto/openssl: not in enabled drivers build config 00:01:44.404 crypto/scheduler: not in enabled drivers build config 00:01:44.404 crypto/uadk: not in enabled drivers build config 00:01:44.404 crypto/virtio: not in enabled drivers build config 00:01:44.404 compress/isal: not in enabled drivers build config 00:01:44.404 compress/mlx5: not in enabled drivers build config 00:01:44.404 compress/octeontx: not in enabled drivers build config 00:01:44.404 compress/zlib: not in enabled drivers build config 00:01:44.404 regex/*: missing internal dependency, "regexdev" 00:01:44.404 ml/*: missing internal dependency, "mldev" 00:01:44.404 vdpa/ifc: not in enabled drivers build config 00:01:44.404 vdpa/mlx5: not in enabled drivers build config 00:01:44.404 vdpa/nfp: not in enabled drivers build config 00:01:44.404 vdpa/sfc: not in enabled drivers build config 00:01:44.404 event/*: missing internal dependency, "eventdev" 00:01:44.404 baseband/*: missing internal dependency, "bbdev" 00:01:44.404 gpu/*: missing internal dependency, "gpudev" 00:01:44.404 00:01:44.404 00:01:44.404 Build targets in project: 85 00:01:44.404 00:01:44.404 DPDK 23.11.0 00:01:44.404 00:01:44.404 User defined options 00:01:44.404 buildtype : debug 00:01:44.404 default_library : shared 00:01:44.404 libdir : lib 00:01:44.404 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:01:44.404 c_args : -fPIC -Werror -Wno-stringop-overflow -fcommon -Wno-stringop-overread -Wno-array-bounds 00:01:44.404 c_link_args : 00:01:44.404 cpu_instruction_set: native 00:01:44.404 disable_apps : test-sad,test-acl,test-dma-perf,test-pipeline,test-compress-perf,test-fib,test-flow-perf,test-crypto-perf,test-bbdev,test-eventdev,pdump,test-mldev,test-cmdline,graph,test-security-perf,test-pmd,test,proc-info,test-regex,dumpcap,test-gpudev 00:01:44.404 disable_libs : port,sched,rib,node,ipsec,distributor,gro,eventdev,pdcp,acl,member,latencystats,efd,stack,regexdev,rawdev,bpf,metrics,gpudev,pipeline,pdump,table,fib,dispatcher,mldev,gso,cfgfile,bitratestats,ip_frag,graph,lpm,jobstats,pcapng,bbdev 00:01:44.404 enable_docs : false 00:01:44.405 enable_drivers : bus,bus/pci,bus/vdev,mempool/ring 00:01:44.405 enable_kmods : false 00:01:44.405 tests : false 00:01:44.405 00:01:44.405 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:44.405 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp' 00:01:44.671 [1/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:44.671 [2/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:44.671 [3/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:44.671 [4/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:44.671 [5/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:44.671 [6/265] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:44.671 [7/265] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:44.671 [8/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:44.671 [9/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:44.671 [10/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:44.671 [11/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:44.671 [12/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:44.671 [13/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:44.671 [14/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:44.671 [15/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:44.671 [16/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:44.671 [17/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:44.671 [18/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:44.671 [19/265] Linking static target lib/librte_kvargs.a 00:01:44.671 [20/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:44.671 [21/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:44.671 [22/265] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:44.671 [23/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:44.933 [24/265] Linking static target lib/librte_log.a 00:01:44.933 [25/265] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:44.933 [26/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:44.933 [27/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:44.933 [28/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:44.933 [29/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:44.933 [30/265] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:44.933 [31/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:44.933 [32/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:44.933 [33/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:44.933 [34/265] Linking static target lib/librte_pci.a 00:01:44.933 [35/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:44.933 [36/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:44.933 [37/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:45.195 [38/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:45.195 [39/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:45.195 [40/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:45.195 [41/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:45.195 [42/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:45.195 [43/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:45.195 [44/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:45.195 [45/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:45.195 [46/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:45.195 [47/265] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:45.195 [48/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:45.195 [49/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:45.195 [50/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:45.195 [51/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:45.195 [52/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:45.195 [53/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:45.195 [54/265] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:45.195 [55/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:45.195 [56/265] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:45.195 [57/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:45.195 [58/265] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:45.196 [59/265] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:45.196 [60/265] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:45.196 [61/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:45.196 [62/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:45.196 [63/265] Linking static target lib/librte_ring.a 00:01:45.196 [64/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:45.196 [65/265] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:45.196 [66/265] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:45.196 [67/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:45.196 [68/265] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:45.196 [69/265] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:45.196 [70/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:45.196 [71/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:45.196 [72/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:45.196 [73/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:45.196 [74/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:45.455 [75/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:45.455 [76/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:45.455 [77/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:45.455 [78/265] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:45.455 [79/265] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:45.455 [80/265] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:45.455 [81/265] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.455 [82/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:45.455 [83/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:45.455 [84/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:45.456 [85/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:45.456 [86/265] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.456 [87/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:45.456 [88/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:45.456 [89/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:45.456 [90/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:45.456 [91/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:45.456 [92/265] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:45.456 [93/265] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:45.456 [94/265] Linking static target lib/librte_meter.a 00:01:45.456 [95/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:45.456 [96/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:45.456 [97/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:45.456 [98/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:45.456 [99/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:45.456 [100/265] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:45.456 [101/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:45.456 [102/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:45.456 [103/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:45.456 [104/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:45.456 [105/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:45.456 [106/265] Linking static target lib/librte_telemetry.a 00:01:45.456 [107/265] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:45.456 [108/265] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:45.456 [109/265] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:45.456 [110/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:45.456 [111/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:45.456 [112/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:45.456 [113/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:45.456 [114/265] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:45.456 [115/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:45.456 [116/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:45.456 [117/265] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:45.456 [118/265] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:45.456 [119/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:45.456 [120/265] Linking static target lib/librte_cmdline.a 00:01:45.456 [121/265] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:45.456 [122/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:45.456 [123/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:45.456 [124/265] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:45.456 [125/265] Linking static target lib/librte_net.a 00:01:45.456 [126/265] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:45.456 [127/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:45.456 [128/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:45.456 [129/265] Linking static target lib/librte_rcu.a 00:01:45.456 [130/265] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:45.456 [131/265] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:45.456 [132/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:45.456 [133/265] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:45.456 [134/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:45.456 [135/265] Linking static target lib/librte_mempool.a 00:01:45.456 [136/265] Linking static target lib/librte_eal.a 00:01:45.456 [137/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:45.456 [138/265] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:45.456 [139/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:45.456 [140/265] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.456 [141/265] Linking static target lib/librte_timer.a 00:01:45.456 [142/265] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.456 [143/265] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:45.456 [144/265] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:45.716 [145/265] Linking target lib/librte_log.so.24.0 00:01:45.716 [146/265] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:45.716 [147/265] Linking static target lib/librte_mbuf.a 00:01:45.716 [148/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:45.716 [149/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:45.716 [150/265] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:45.716 [151/265] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.716 [152/265] Linking static target lib/librte_compressdev.a 00:01:45.716 [153/265] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:45.716 [154/265] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:45.716 [155/265] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:45.716 [156/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:45.716 [157/265] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:45.716 [158/265] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:45.716 [159/265] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:45.716 [160/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:45.716 [161/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:45.716 [162/265] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:45.716 [163/265] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:45.716 [164/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:45.716 [165/265] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:45.716 [166/265] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:45.716 [167/265] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:45.716 [168/265] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:45.716 [169/265] Linking static target lib/librte_dmadev.a 00:01:45.716 [170/265] Linking static target lib/librte_power.a 00:01:45.716 [171/265] Linking static target lib/librte_security.a 00:01:45.716 [172/265] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:45.716 [173/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:45.716 [174/265] Linking target lib/librte_kvargs.so.24.0 00:01:45.716 [175/265] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:45.716 [176/265] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.716 [177/265] Linking static target lib/librte_reorder.a 00:01:45.716 [178/265] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:45.716 [179/265] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.716 [180/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:45.716 [181/265] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.716 [182/265] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:45.716 [183/265] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:45.976 [184/265] Linking static target lib/librte_hash.a 00:01:45.976 [185/265] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:45.976 [186/265] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:45.976 [187/265] Linking target lib/librte_telemetry.so.24.0 00:01:45.976 [188/265] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:45.976 [189/265] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:45.976 [190/265] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:45.976 [191/265] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:45.976 [192/265] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:45.976 [193/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:45.976 [194/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:45.976 [195/265] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:45.976 [196/265] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:45.976 [197/265] Linking static target drivers/librte_bus_vdev.a 00:01:45.976 [198/265] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:45.976 [199/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:45.976 [200/265] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:45.976 [201/265] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:45.976 [202/265] Linking static target lib/librte_cryptodev.a 00:01:45.976 [203/265] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:46.236 [204/265] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:46.236 [205/265] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:46.236 [206/265] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:46.236 [207/265] Linking static target drivers/librte_bus_pci.a 00:01:46.236 [208/265] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:46.236 [209/265] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:46.236 [210/265] Linking static target drivers/librte_mempool_ring.a 00:01:46.236 [211/265] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.236 [212/265] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.236 [213/265] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.236 [214/265] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.236 [215/265] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.236 [216/265] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.236 [217/265] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.495 [218/265] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:46.495 [219/265] Linking static target lib/librte_ethdev.a 00:01:46.495 [220/265] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.495 [221/265] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:01:46.495 [222/265] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.753 [223/265] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:46.753 [224/265] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.689 [225/265] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:01:47.689 [226/265] Linking static target lib/librte_vhost.a 00:01:47.689 [227/265] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.594 [228/265] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.787 [229/265] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.695 [230/265] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:55.695 [231/265] Linking target lib/librte_eal.so.24.0 00:01:55.695 [232/265] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:55.695 [233/265] Linking target lib/librte_timer.so.24.0 00:01:55.695 [234/265] Linking target lib/librte_meter.so.24.0 00:01:55.695 [235/265] Linking target lib/librte_pci.so.24.0 00:01:55.695 [236/265] Linking target lib/librte_dmadev.so.24.0 00:01:55.695 [237/265] Linking target drivers/librte_bus_vdev.so.24.0 00:01:55.695 [238/265] Linking target lib/librte_ring.so.24.0 00:01:55.695 [239/265] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:55.695 [240/265] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:55.695 [241/265] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:55.695 [242/265] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:55.695 [243/265] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:55.695 [244/265] Linking target lib/librte_mempool.so.24.0 00:01:55.695 [245/265] Linking target lib/librte_rcu.so.24.0 00:01:55.695 [246/265] Linking target drivers/librte_bus_pci.so.24.0 00:01:55.955 [247/265] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:55.955 [248/265] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:55.955 [249/265] Linking target lib/librte_mbuf.so.24.0 00:01:55.955 [250/265] Linking target drivers/librte_mempool_ring.so.24.0 00:01:56.214 [251/265] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:56.214 [252/265] Linking target lib/librte_net.so.24.0 00:01:56.214 [253/265] Linking target lib/librte_cryptodev.so.24.0 00:01:56.214 [254/265] Linking target lib/librte_reorder.so.24.0 00:01:56.214 [255/265] Linking target lib/librte_compressdev.so.24.0 00:01:56.214 [256/265] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:56.214 [257/265] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:56.214 [258/265] Linking target lib/librte_cmdline.so.24.0 00:01:56.214 [259/265] Linking target lib/librte_hash.so.24.0 00:01:56.214 [260/265] Linking target lib/librte_ethdev.so.24.0 00:01:56.214 [261/265] Linking target lib/librte_security.so.24.0 00:01:56.473 [262/265] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:56.473 [263/265] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:56.473 [264/265] Linking target lib/librte_power.so.24.0 00:01:56.473 [265/265] Linking target lib/librte_vhost.so.24.0 00:01:56.473 INFO: autodetecting backend as ninja 00:01:56.473 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build-tmp -j 96 00:01:57.412 CC lib/ut/ut.o 00:01:57.412 CC lib/ut_mock/mock.o 00:01:57.412 CC lib/log/log.o 00:01:57.412 CC lib/log/log_deprecated.o 00:01:57.412 CC lib/log/log_flags.o 00:01:57.412 LIB libspdk_ut_mock.a 00:01:57.412 LIB libspdk_ut.a 00:01:57.412 SO libspdk_ut.so.1.0 00:01:57.412 LIB libspdk_log.a 00:01:57.412 SO libspdk_ut_mock.so.5.0 00:01:57.671 SO libspdk_log.so.6.1 00:01:57.671 SYMLINK libspdk_ut.so 00:01:57.671 SYMLINK libspdk_ut_mock.so 00:01:57.671 SYMLINK libspdk_log.so 00:01:57.671 CXX lib/trace_parser/trace.o 00:01:57.931 CC lib/ioat/ioat.o 00:01:57.931 CC lib/dma/dma.o 00:01:57.931 CC lib/util/base64.o 00:01:57.931 CC lib/util/bit_array.o 00:01:57.931 CC lib/util/cpuset.o 00:01:57.931 CC lib/util/crc32.o 00:01:57.931 CC lib/util/crc16.o 00:01:57.931 CC lib/util/crc32c.o 00:01:57.931 CC lib/util/crc32_ieee.o 00:01:57.931 CC lib/util/crc64.o 00:01:57.931 CC lib/util/dif.o 00:01:57.931 CC lib/util/fd.o 00:01:57.931 CC lib/util/file.o 00:01:57.931 CC lib/util/hexlify.o 00:01:57.931 CC lib/util/iov.o 00:01:57.931 CC lib/util/math.o 00:01:57.931 CC lib/util/pipe.o 00:01:57.931 CC lib/util/uuid.o 00:01:57.931 CC lib/util/strerror_tls.o 00:01:57.931 CC lib/util/string.o 00:01:57.931 CC lib/util/fd_group.o 00:01:57.931 CC lib/util/xor.o 00:01:57.931 CC lib/util/zipf.o 00:01:57.931 CC lib/vfio_user/host/vfio_user.o 00:01:57.931 CC lib/vfio_user/host/vfio_user_pci.o 00:01:57.931 LIB libspdk_dma.a 00:01:57.931 SO libspdk_dma.so.3.0 00:01:57.931 LIB libspdk_ioat.a 00:01:58.190 SYMLINK libspdk_dma.so 00:01:58.190 SO libspdk_ioat.so.6.0 00:01:58.190 LIB libspdk_vfio_user.a 00:01:58.190 SYMLINK libspdk_ioat.so 00:01:58.190 SO libspdk_vfio_user.so.4.0 00:01:58.190 SYMLINK libspdk_vfio_user.so 00:01:58.190 LIB libspdk_util.a 00:01:58.190 SO libspdk_util.so.8.0 00:01:58.448 SYMLINK libspdk_util.so 00:01:58.448 LIB libspdk_trace_parser.a 00:01:58.448 SO libspdk_trace_parser.so.4.0 00:01:58.448 CC lib/vmd/vmd.o 00:01:58.448 CC lib/vmd/led.o 00:01:58.448 SYMLINK libspdk_trace_parser.so 00:01:58.448 CC lib/env_dpdk/memory.o 00:01:58.448 CC lib/rdma/common.o 00:01:58.448 CC lib/env_dpdk/env.o 00:01:58.707 CC lib/rdma/rdma_verbs.o 00:01:58.708 CC lib/env_dpdk/pci.o 00:01:58.708 CC lib/env_dpdk/init.o 00:01:58.708 CC lib/env_dpdk/threads.o 00:01:58.708 CC lib/conf/conf.o 00:01:58.708 CC lib/env_dpdk/pci_ioat.o 00:01:58.708 CC lib/env_dpdk/pci_virtio.o 00:01:58.708 CC lib/json/json_parse.o 00:01:58.708 CC lib/env_dpdk/pci_vmd.o 00:01:58.708 CC lib/json/json_util.o 00:01:58.708 CC lib/env_dpdk/pci_idxd.o 00:01:58.708 CC lib/json/json_write.o 00:01:58.708 CC lib/env_dpdk/pci_event.o 00:01:58.708 CC lib/env_dpdk/sigbus_handler.o 00:01:58.708 CC lib/env_dpdk/pci_dpdk.o 00:01:58.708 CC lib/idxd/idxd_user.o 00:01:58.708 CC lib/idxd/idxd.o 00:01:58.708 CC lib/env_dpdk/pci_dpdk_2207.o 00:01:58.708 CC lib/env_dpdk/pci_dpdk_2211.o 00:01:58.708 CC lib/idxd/idxd_kernel.o 00:01:58.708 LIB libspdk_conf.a 00:01:58.708 LIB libspdk_json.a 00:01:58.708 SO libspdk_conf.so.5.0 00:01:58.967 LIB libspdk_rdma.a 00:01:58.967 SO libspdk_json.so.5.1 00:01:58.967 SO libspdk_rdma.so.5.0 00:01:58.967 SYMLINK libspdk_conf.so 00:01:58.967 SYMLINK libspdk_json.so 00:01:58.967 SYMLINK libspdk_rdma.so 00:01:58.967 LIB libspdk_idxd.a 00:01:58.967 LIB libspdk_vmd.a 00:01:58.967 SO libspdk_idxd.so.11.0 00:01:58.967 SO libspdk_vmd.so.5.0 00:01:59.227 SYMLINK libspdk_idxd.so 00:01:59.227 CC lib/jsonrpc/jsonrpc_server.o 00:01:59.227 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:01:59.227 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:01:59.227 CC lib/jsonrpc/jsonrpc_client.o 00:01:59.227 SYMLINK libspdk_vmd.so 00:01:59.227 LIB libspdk_jsonrpc.a 00:01:59.486 SO libspdk_jsonrpc.so.5.1 00:01:59.486 SYMLINK libspdk_jsonrpc.so 00:01:59.486 LIB libspdk_env_dpdk.a 00:01:59.745 CC lib/rpc/rpc.o 00:01:59.745 SO libspdk_env_dpdk.so.13.0 00:01:59.745 SYMLINK libspdk_env_dpdk.so 00:01:59.745 LIB libspdk_rpc.a 00:01:59.745 SO libspdk_rpc.so.5.0 00:01:59.745 SYMLINK libspdk_rpc.so 00:02:00.004 CC lib/notify/notify.o 00:02:00.004 CC lib/notify/notify_rpc.o 00:02:00.004 CC lib/trace/trace.o 00:02:00.004 CC lib/trace/trace_flags.o 00:02:00.004 CC lib/trace/trace_rpc.o 00:02:00.004 CC lib/sock/sock.o 00:02:00.004 CC lib/sock/sock_rpc.o 00:02:00.263 LIB libspdk_notify.a 00:02:00.263 SO libspdk_notify.so.5.0 00:02:00.263 LIB libspdk_trace.a 00:02:00.263 SYMLINK libspdk_notify.so 00:02:00.263 SO libspdk_trace.so.9.0 00:02:00.263 SYMLINK libspdk_trace.so 00:02:00.263 LIB libspdk_sock.a 00:02:00.523 SO libspdk_sock.so.8.0 00:02:00.523 SYMLINK libspdk_sock.so 00:02:00.523 CC lib/thread/iobuf.o 00:02:00.523 CC lib/thread/thread.o 00:02:00.781 CC lib/nvme/nvme_ctrlr_cmd.o 00:02:00.781 CC lib/nvme/nvme_ctrlr.o 00:02:00.781 CC lib/nvme/nvme_fabric.o 00:02:00.781 CC lib/nvme/nvme_ns_cmd.o 00:02:00.781 CC lib/nvme/nvme_ns.o 00:02:00.781 CC lib/nvme/nvme_pcie_common.o 00:02:00.781 CC lib/nvme/nvme_pcie.o 00:02:00.781 CC lib/nvme/nvme_qpair.o 00:02:00.781 CC lib/nvme/nvme_transport.o 00:02:00.781 CC lib/nvme/nvme.o 00:02:00.781 CC lib/nvme/nvme_quirks.o 00:02:00.781 CC lib/nvme/nvme_discovery.o 00:02:00.781 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:02:00.781 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:02:00.781 CC lib/nvme/nvme_tcp.o 00:02:00.781 CC lib/nvme/nvme_opal.o 00:02:00.781 CC lib/nvme/nvme_io_msg.o 00:02:00.781 CC lib/nvme/nvme_poll_group.o 00:02:00.781 CC lib/nvme/nvme_zns.o 00:02:00.781 CC lib/nvme/nvme_cuse.o 00:02:00.781 CC lib/nvme/nvme_vfio_user.o 00:02:00.781 CC lib/nvme/nvme_rdma.o 00:02:01.716 LIB libspdk_thread.a 00:02:01.716 SO libspdk_thread.so.9.0 00:02:01.716 SYMLINK libspdk_thread.so 00:02:01.974 CC lib/blob/blobstore.o 00:02:01.974 CC lib/blob/request.o 00:02:01.974 CC lib/virtio/virtio_vhost_user.o 00:02:01.974 CC lib/accel/accel.o 00:02:01.974 CC lib/virtio/virtio.o 00:02:01.974 CC lib/accel/accel_rpc.o 00:02:01.974 CC lib/accel/accel_sw.o 00:02:01.974 CC lib/virtio/virtio_vfio_user.o 00:02:01.974 CC lib/blob/zeroes.o 00:02:01.974 CC lib/virtio/virtio_pci.o 00:02:01.974 CC lib/blob/blob_bs_dev.o 00:02:01.974 CC lib/init/json_config.o 00:02:01.974 CC lib/init/subsystem.o 00:02:01.974 CC lib/init/subsystem_rpc.o 00:02:01.974 CC lib/init/rpc.o 00:02:02.232 LIB libspdk_init.a 00:02:02.232 SO libspdk_init.so.4.0 00:02:02.232 LIB libspdk_virtio.a 00:02:02.232 LIB libspdk_nvme.a 00:02:02.232 SO libspdk_virtio.so.6.0 00:02:02.232 SYMLINK libspdk_init.so 00:02:02.232 SYMLINK libspdk_virtio.so 00:02:02.232 SO libspdk_nvme.so.12.0 00:02:02.491 CC lib/event/app.o 00:02:02.491 CC lib/event/reactor.o 00:02:02.491 CC lib/event/log_rpc.o 00:02:02.491 CC lib/event/scheduler_static.o 00:02:02.491 CC lib/event/app_rpc.o 00:02:02.491 SYMLINK libspdk_nvme.so 00:02:02.753 LIB libspdk_accel.a 00:02:02.753 SO libspdk_accel.so.14.0 00:02:02.753 LIB libspdk_event.a 00:02:02.753 SYMLINK libspdk_accel.so 00:02:02.753 SO libspdk_event.so.12.0 00:02:02.753 SYMLINK libspdk_event.so 00:02:03.014 CC lib/bdev/bdev.o 00:02:03.014 CC lib/bdev/bdev_rpc.o 00:02:03.014 CC lib/bdev/bdev_zone.o 00:02:03.014 CC lib/bdev/scsi_nvme.o 00:02:03.014 CC lib/bdev/part.o 00:02:03.951 LIB libspdk_blob.a 00:02:03.951 SO libspdk_blob.so.10.1 00:02:03.951 SYMLINK libspdk_blob.so 00:02:04.210 CC lib/blobfs/blobfs.o 00:02:04.210 CC lib/blobfs/tree.o 00:02:04.210 CC lib/lvol/lvol.o 00:02:04.778 LIB libspdk_bdev.a 00:02:04.778 LIB libspdk_blobfs.a 00:02:04.778 SO libspdk_bdev.so.14.0 00:02:04.778 SO libspdk_blobfs.so.9.0 00:02:04.778 LIB libspdk_lvol.a 00:02:04.778 SO libspdk_lvol.so.9.1 00:02:04.778 SYMLINK libspdk_blobfs.so 00:02:04.778 SYMLINK libspdk_bdev.so 00:02:04.778 SYMLINK libspdk_lvol.so 00:02:05.036 CC lib/scsi/dev.o 00:02:05.036 CC lib/scsi/port.o 00:02:05.036 CC lib/scsi/lun.o 00:02:05.036 CC lib/scsi/scsi_bdev.o 00:02:05.036 CC lib/scsi/scsi.o 00:02:05.036 CC lib/nbd/nbd.o 00:02:05.036 CC lib/scsi/scsi_pr.o 00:02:05.036 CC lib/nbd/nbd_rpc.o 00:02:05.036 CC lib/scsi/scsi_rpc.o 00:02:05.036 CC lib/scsi/task.o 00:02:05.036 CC lib/nvmf/ctrlr.o 00:02:05.036 CC lib/nvmf/ctrlr_discovery.o 00:02:05.036 CC lib/ublk/ublk.o 00:02:05.036 CC lib/nvmf/subsystem.o 00:02:05.036 CC lib/nvmf/ctrlr_bdev.o 00:02:05.036 CC lib/ublk/ublk_rpc.o 00:02:05.036 CC lib/nvmf/nvmf.o 00:02:05.036 CC lib/nvmf/nvmf_rpc.o 00:02:05.036 CC lib/nvmf/transport.o 00:02:05.037 CC lib/nvmf/tcp.o 00:02:05.037 CC lib/nvmf/rdma.o 00:02:05.037 CC lib/ftl/ftl_core.o 00:02:05.037 CC lib/ftl/ftl_init.o 00:02:05.037 CC lib/ftl/ftl_layout.o 00:02:05.037 CC lib/ftl/ftl_debug.o 00:02:05.037 CC lib/ftl/ftl_io.o 00:02:05.037 CC lib/ftl/ftl_sb.o 00:02:05.037 CC lib/ftl/ftl_l2p.o 00:02:05.037 CC lib/ftl/ftl_nv_cache.o 00:02:05.037 CC lib/ftl/ftl_l2p_flat.o 00:02:05.037 CC lib/ftl/ftl_band.o 00:02:05.037 CC lib/ftl/ftl_band_ops.o 00:02:05.037 CC lib/ftl/ftl_writer.o 00:02:05.037 CC lib/ftl/ftl_rq.o 00:02:05.037 CC lib/ftl/ftl_reloc.o 00:02:05.037 CC lib/ftl/ftl_l2p_cache.o 00:02:05.037 CC lib/ftl/ftl_p2l.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_startup.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_misc.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_md.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_band.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:02:05.037 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:02:05.037 CC lib/ftl/utils/ftl_conf.o 00:02:05.037 CC lib/ftl/utils/ftl_md.o 00:02:05.037 CC lib/ftl/utils/ftl_mempool.o 00:02:05.037 CC lib/ftl/utils/ftl_bitmap.o 00:02:05.037 CC lib/ftl/utils/ftl_property.o 00:02:05.037 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:02:05.037 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:02:05.037 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:02:05.037 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:02:05.037 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:02:05.037 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:02:05.037 CC lib/ftl/upgrade/ftl_sb_v3.o 00:02:05.037 CC lib/ftl/nvc/ftl_nvc_dev.o 00:02:05.037 CC lib/ftl/upgrade/ftl_sb_v5.o 00:02:05.037 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:02:05.037 CC lib/ftl/base/ftl_base_dev.o 00:02:05.037 CC lib/ftl/base/ftl_base_bdev.o 00:02:05.037 CC lib/ftl/ftl_trace.o 00:02:05.603 LIB libspdk_scsi.a 00:02:05.603 SO libspdk_scsi.so.8.0 00:02:05.603 LIB libspdk_nbd.a 00:02:05.603 SYMLINK libspdk_scsi.so 00:02:05.603 SO libspdk_nbd.so.6.0 00:02:05.603 SYMLINK libspdk_nbd.so 00:02:05.603 LIB libspdk_ublk.a 00:02:05.603 SO libspdk_ublk.so.2.0 00:02:05.862 CC lib/iscsi/conn.o 00:02:05.862 CC lib/iscsi/init_grp.o 00:02:05.862 CC lib/iscsi/iscsi.o 00:02:05.862 CC lib/iscsi/portal_grp.o 00:02:05.862 CC lib/iscsi/md5.o 00:02:05.862 CC lib/iscsi/param.o 00:02:05.862 CC lib/vhost/vhost.o 00:02:05.862 CC lib/vhost/vhost_rpc.o 00:02:05.862 CC lib/iscsi/tgt_node.o 00:02:05.862 CC lib/iscsi/iscsi_subsystem.o 00:02:05.862 CC lib/vhost/vhost_scsi.o 00:02:05.862 CC lib/vhost/rte_vhost_user.o 00:02:05.862 CC lib/iscsi/iscsi_rpc.o 00:02:05.862 CC lib/vhost/vhost_blk.o 00:02:05.862 CC lib/iscsi/task.o 00:02:05.862 SYMLINK libspdk_ublk.so 00:02:05.862 LIB libspdk_ftl.a 00:02:05.862 SO libspdk_ftl.so.8.0 00:02:06.120 SYMLINK libspdk_ftl.so 00:02:06.379 LIB libspdk_vhost.a 00:02:06.639 SO libspdk_vhost.so.7.1 00:02:06.639 LIB libspdk_nvmf.a 00:02:06.639 SYMLINK libspdk_vhost.so 00:02:06.639 SO libspdk_nvmf.so.17.0 00:02:06.639 LIB libspdk_iscsi.a 00:02:06.898 SO libspdk_iscsi.so.7.0 00:02:06.898 SYMLINK libspdk_nvmf.so 00:02:06.898 SYMLINK libspdk_iscsi.so 00:02:07.157 CC module/env_dpdk/env_dpdk_rpc.o 00:02:07.157 CC module/accel/error/accel_error.o 00:02:07.157 CC module/accel/error/accel_error_rpc.o 00:02:07.415 CC module/accel/dsa/accel_dsa.o 00:02:07.415 CC module/accel/dsa/accel_dsa_rpc.o 00:02:07.415 CC module/accel/iaa/accel_iaa.o 00:02:07.415 CC module/accel/ioat/accel_ioat.o 00:02:07.415 CC module/accel/iaa/accel_iaa_rpc.o 00:02:07.415 CC module/accel/ioat/accel_ioat_rpc.o 00:02:07.415 CC module/scheduler/dynamic/scheduler_dynamic.o 00:02:07.415 CC module/sock/posix/posix.o 00:02:07.415 CC module/scheduler/gscheduler/gscheduler.o 00:02:07.415 CC module/blob/bdev/blob_bdev.o 00:02:07.415 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:02:07.415 LIB libspdk_env_dpdk_rpc.a 00:02:07.415 SO libspdk_env_dpdk_rpc.so.5.0 00:02:07.415 SYMLINK libspdk_env_dpdk_rpc.so 00:02:07.415 LIB libspdk_accel_error.a 00:02:07.415 LIB libspdk_scheduler_gscheduler.a 00:02:07.415 LIB libspdk_scheduler_dpdk_governor.a 00:02:07.415 LIB libspdk_scheduler_dynamic.a 00:02:07.415 LIB libspdk_accel_ioat.a 00:02:07.415 LIB libspdk_accel_dsa.a 00:02:07.415 SO libspdk_accel_error.so.1.0 00:02:07.415 SO libspdk_scheduler_gscheduler.so.3.0 00:02:07.415 SO libspdk_scheduler_dpdk_governor.so.3.0 00:02:07.415 LIB libspdk_accel_iaa.a 00:02:07.415 SO libspdk_scheduler_dynamic.so.3.0 00:02:07.415 SO libspdk_accel_ioat.so.5.0 00:02:07.416 SO libspdk_accel_dsa.so.4.0 00:02:07.416 SO libspdk_accel_iaa.so.2.0 00:02:07.416 LIB libspdk_blob_bdev.a 00:02:07.416 SYMLINK libspdk_accel_error.so 00:02:07.416 SYMLINK libspdk_scheduler_gscheduler.so 00:02:07.416 SYMLINK libspdk_scheduler_dpdk_governor.so 00:02:07.674 SYMLINK libspdk_accel_ioat.so 00:02:07.674 SYMLINK libspdk_scheduler_dynamic.so 00:02:07.674 SYMLINK libspdk_accel_dsa.so 00:02:07.674 SO libspdk_blob_bdev.so.10.1 00:02:07.674 SYMLINK libspdk_accel_iaa.so 00:02:07.674 SYMLINK libspdk_blob_bdev.so 00:02:07.932 LIB libspdk_sock_posix.a 00:02:07.932 SO libspdk_sock_posix.so.5.0 00:02:07.932 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:02:07.932 CC module/blobfs/bdev/blobfs_bdev.o 00:02:07.932 CC module/bdev/malloc/bdev_malloc_rpc.o 00:02:07.932 CC module/bdev/malloc/bdev_malloc.o 00:02:07.932 CC module/bdev/gpt/vbdev_gpt.o 00:02:07.932 CC module/bdev/gpt/gpt.o 00:02:07.933 CC module/bdev/zone_block/vbdev_zone_block.o 00:02:07.933 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:02:07.933 CC module/bdev/lvol/vbdev_lvol.o 00:02:07.933 CC module/bdev/passthru/vbdev_passthru.o 00:02:07.933 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:02:07.933 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:02:07.933 CC module/bdev/null/bdev_null.o 00:02:07.933 CC module/bdev/null/bdev_null_rpc.o 00:02:07.933 CC module/bdev/error/vbdev_error.o 00:02:07.933 CC module/bdev/error/vbdev_error_rpc.o 00:02:07.933 CC module/bdev/iscsi/bdev_iscsi.o 00:02:07.933 CC module/bdev/raid/bdev_raid.o 00:02:07.933 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:02:07.933 CC module/bdev/delay/vbdev_delay.o 00:02:07.933 CC module/bdev/ftl/bdev_ftl.o 00:02:07.933 CC module/bdev/raid/bdev_raid_rpc.o 00:02:07.933 CC module/bdev/aio/bdev_aio.o 00:02:07.933 CC module/bdev/raid/bdev_raid_sb.o 00:02:07.933 CC module/bdev/raid/raid0.o 00:02:07.933 CC module/bdev/aio/bdev_aio_rpc.o 00:02:07.933 CC module/bdev/split/vbdev_split.o 00:02:07.933 CC module/bdev/split/vbdev_split_rpc.o 00:02:07.933 CC module/bdev/virtio/bdev_virtio_blk.o 00:02:07.933 CC module/bdev/virtio/bdev_virtio_scsi.o 00:02:07.933 CC module/bdev/ftl/bdev_ftl_rpc.o 00:02:07.933 CC module/bdev/delay/vbdev_delay_rpc.o 00:02:07.933 CC module/bdev/raid/concat.o 00:02:07.933 CC module/bdev/raid/raid1.o 00:02:07.933 CC module/bdev/virtio/bdev_virtio_rpc.o 00:02:07.933 CC module/bdev/nvme/bdev_nvme.o 00:02:07.933 CC module/bdev/nvme/bdev_nvme_rpc.o 00:02:07.933 CC module/bdev/nvme/nvme_rpc.o 00:02:07.933 CC module/bdev/nvme/bdev_mdns_client.o 00:02:07.933 CC module/bdev/nvme/vbdev_opal.o 00:02:07.933 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:02:07.933 CC module/bdev/nvme/vbdev_opal_rpc.o 00:02:07.933 SYMLINK libspdk_sock_posix.so 00:02:08.191 LIB libspdk_blobfs_bdev.a 00:02:08.191 SO libspdk_blobfs_bdev.so.5.0 00:02:08.191 LIB libspdk_bdev_null.a 00:02:08.191 LIB libspdk_bdev_error.a 00:02:08.191 LIB libspdk_bdev_split.a 00:02:08.191 SYMLINK libspdk_blobfs_bdev.so 00:02:08.191 SO libspdk_bdev_null.so.5.0 00:02:08.191 LIB libspdk_bdev_gpt.a 00:02:08.191 SO libspdk_bdev_error.so.5.0 00:02:08.191 LIB libspdk_bdev_passthru.a 00:02:08.191 SO libspdk_bdev_split.so.5.0 00:02:08.191 LIB libspdk_bdev_ftl.a 00:02:08.191 SO libspdk_bdev_gpt.so.5.0 00:02:08.191 SO libspdk_bdev_passthru.so.5.0 00:02:08.191 SYMLINK libspdk_bdev_null.so 00:02:08.191 LIB libspdk_bdev_malloc.a 00:02:08.191 SO libspdk_bdev_ftl.so.5.0 00:02:08.191 SYMLINK libspdk_bdev_error.so 00:02:08.191 LIB libspdk_bdev_zone_block.a 00:02:08.191 SYMLINK libspdk_bdev_split.so 00:02:08.191 LIB libspdk_bdev_aio.a 00:02:08.191 LIB libspdk_bdev_delay.a 00:02:08.191 SYMLINK libspdk_bdev_passthru.so 00:02:08.191 SO libspdk_bdev_malloc.so.5.0 00:02:08.191 SO libspdk_bdev_aio.so.5.0 00:02:08.191 SYMLINK libspdk_bdev_gpt.so 00:02:08.191 SO libspdk_bdev_zone_block.so.5.0 00:02:08.191 LIB libspdk_bdev_iscsi.a 00:02:08.449 SO libspdk_bdev_delay.so.5.0 00:02:08.449 SYMLINK libspdk_bdev_ftl.so 00:02:08.449 SO libspdk_bdev_iscsi.so.5.0 00:02:08.449 SYMLINK libspdk_bdev_aio.so 00:02:08.449 SYMLINK libspdk_bdev_malloc.so 00:02:08.449 LIB libspdk_bdev_lvol.a 00:02:08.449 SYMLINK libspdk_bdev_zone_block.so 00:02:08.449 SYMLINK libspdk_bdev_delay.so 00:02:08.449 SO libspdk_bdev_lvol.so.5.0 00:02:08.449 SYMLINK libspdk_bdev_iscsi.so 00:02:08.449 LIB libspdk_bdev_virtio.a 00:02:08.449 SO libspdk_bdev_virtio.so.5.0 00:02:08.449 SYMLINK libspdk_bdev_lvol.so 00:02:08.450 SYMLINK libspdk_bdev_virtio.so 00:02:08.708 LIB libspdk_bdev_raid.a 00:02:08.708 SO libspdk_bdev_raid.so.5.0 00:02:08.708 SYMLINK libspdk_bdev_raid.so 00:02:09.644 LIB libspdk_bdev_nvme.a 00:02:09.644 SO libspdk_bdev_nvme.so.6.0 00:02:09.644 SYMLINK libspdk_bdev_nvme.so 00:02:09.903 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:02:09.903 CC module/event/subsystems/sock/sock.o 00:02:09.903 CC module/event/subsystems/iobuf/iobuf.o 00:02:09.903 CC module/event/subsystems/vmd/vmd.o 00:02:09.903 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:02:09.903 CC module/event/subsystems/vmd/vmd_rpc.o 00:02:09.903 CC module/event/subsystems/scheduler/scheduler.o 00:02:10.163 LIB libspdk_event_sock.a 00:02:10.163 LIB libspdk_event_vhost_blk.a 00:02:10.163 LIB libspdk_event_scheduler.a 00:02:10.163 LIB libspdk_event_vmd.a 00:02:10.163 LIB libspdk_event_iobuf.a 00:02:10.163 SO libspdk_event_sock.so.4.0 00:02:10.163 SO libspdk_event_vhost_blk.so.2.0 00:02:10.163 SO libspdk_event_scheduler.so.3.0 00:02:10.163 SO libspdk_event_vmd.so.5.0 00:02:10.163 SO libspdk_event_iobuf.so.2.0 00:02:10.163 SYMLINK libspdk_event_sock.so 00:02:10.163 SYMLINK libspdk_event_vhost_blk.so 00:02:10.163 SYMLINK libspdk_event_scheduler.so 00:02:10.163 SYMLINK libspdk_event_vmd.so 00:02:10.163 SYMLINK libspdk_event_iobuf.so 00:02:10.422 CC module/event/subsystems/accel/accel.o 00:02:10.684 LIB libspdk_event_accel.a 00:02:10.684 SO libspdk_event_accel.so.5.0 00:02:10.684 SYMLINK libspdk_event_accel.so 00:02:10.944 CC module/event/subsystems/bdev/bdev.o 00:02:10.944 LIB libspdk_event_bdev.a 00:02:11.203 SO libspdk_event_bdev.so.5.0 00:02:11.203 SYMLINK libspdk_event_bdev.so 00:02:11.203 CC module/event/subsystems/nbd/nbd.o 00:02:11.203 CC module/event/subsystems/scsi/scsi.o 00:02:11.462 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:02:11.462 CC module/event/subsystems/ublk/ublk.o 00:02:11.462 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:02:11.462 LIB libspdk_event_nbd.a 00:02:11.462 SO libspdk_event_nbd.so.5.0 00:02:11.462 LIB libspdk_event_scsi.a 00:02:11.462 LIB libspdk_event_ublk.a 00:02:11.462 SO libspdk_event_scsi.so.5.0 00:02:11.462 SYMLINK libspdk_event_nbd.so 00:02:11.462 SO libspdk_event_ublk.so.2.0 00:02:11.462 LIB libspdk_event_nvmf.a 00:02:11.462 SYMLINK libspdk_event_scsi.so 00:02:11.462 SYMLINK libspdk_event_ublk.so 00:02:11.462 SO libspdk_event_nvmf.so.5.0 00:02:11.721 SYMLINK libspdk_event_nvmf.so 00:02:11.721 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:02:11.721 CC module/event/subsystems/iscsi/iscsi.o 00:02:11.981 LIB libspdk_event_vhost_scsi.a 00:02:11.981 SO libspdk_event_vhost_scsi.so.2.0 00:02:11.981 LIB libspdk_event_iscsi.a 00:02:11.981 SO libspdk_event_iscsi.so.5.0 00:02:11.981 SYMLINK libspdk_event_vhost_scsi.so 00:02:11.981 SYMLINK libspdk_event_iscsi.so 00:02:11.981 SO libspdk.so.5.0 00:02:11.981 SYMLINK libspdk.so 00:02:12.241 TEST_HEADER include/spdk/assert.h 00:02:12.242 TEST_HEADER include/spdk/accel.h 00:02:12.242 TEST_HEADER include/spdk/accel_module.h 00:02:12.242 TEST_HEADER include/spdk/base64.h 00:02:12.242 TEST_HEADER include/spdk/barrier.h 00:02:12.242 CC app/trace_record/trace_record.o 00:02:12.242 TEST_HEADER include/spdk/bdev_module.h 00:02:12.242 TEST_HEADER include/spdk/bdev_zone.h 00:02:12.242 CC app/spdk_lspci/spdk_lspci.o 00:02:12.242 TEST_HEADER include/spdk/bdev.h 00:02:12.242 CC test/rpc_client/rpc_client_test.o 00:02:12.242 TEST_HEADER include/spdk/bit_pool.h 00:02:12.242 TEST_HEADER include/spdk/bit_array.h 00:02:12.242 TEST_HEADER include/spdk/blob_bdev.h 00:02:12.242 CC app/spdk_nvme_identify/identify.o 00:02:12.242 TEST_HEADER include/spdk/blobfs_bdev.h 00:02:12.242 CXX app/trace/trace.o 00:02:12.242 TEST_HEADER include/spdk/blobfs.h 00:02:12.242 CC app/spdk_nvme_discover/discovery_aer.o 00:02:12.242 TEST_HEADER include/spdk/conf.h 00:02:12.242 TEST_HEADER include/spdk/blob.h 00:02:12.242 TEST_HEADER include/spdk/config.h 00:02:12.242 TEST_HEADER include/spdk/cpuset.h 00:02:12.242 TEST_HEADER include/spdk/crc16.h 00:02:12.242 CC app/spdk_top/spdk_top.o 00:02:12.242 CC app/spdk_nvme_perf/perf.o 00:02:12.242 TEST_HEADER include/spdk/crc32.h 00:02:12.242 TEST_HEADER include/spdk/crc64.h 00:02:12.242 TEST_HEADER include/spdk/dma.h 00:02:12.242 TEST_HEADER include/spdk/dif.h 00:02:12.242 TEST_HEADER include/spdk/endian.h 00:02:12.242 TEST_HEADER include/spdk/env_dpdk.h 00:02:12.242 TEST_HEADER include/spdk/env.h 00:02:12.242 TEST_HEADER include/spdk/event.h 00:02:12.242 TEST_HEADER include/spdk/fd_group.h 00:02:12.242 TEST_HEADER include/spdk/file.h 00:02:12.242 TEST_HEADER include/spdk/ftl.h 00:02:12.242 TEST_HEADER include/spdk/fd.h 00:02:12.242 TEST_HEADER include/spdk/gpt_spec.h 00:02:12.242 TEST_HEADER include/spdk/hexlify.h 00:02:12.242 TEST_HEADER include/spdk/idxd.h 00:02:12.242 TEST_HEADER include/spdk/histogram_data.h 00:02:12.242 TEST_HEADER include/spdk/idxd_spec.h 00:02:12.242 TEST_HEADER include/spdk/init.h 00:02:12.242 CC examples/interrupt_tgt/interrupt_tgt.o 00:02:12.242 TEST_HEADER include/spdk/ioat.h 00:02:12.242 TEST_HEADER include/spdk/ioat_spec.h 00:02:12.242 TEST_HEADER include/spdk/jsonrpc.h 00:02:12.506 TEST_HEADER include/spdk/json.h 00:02:12.506 TEST_HEADER include/spdk/iscsi_spec.h 00:02:12.506 TEST_HEADER include/spdk/log.h 00:02:12.506 TEST_HEADER include/spdk/likely.h 00:02:12.506 TEST_HEADER include/spdk/memory.h 00:02:12.506 TEST_HEADER include/spdk/lvol.h 00:02:12.506 TEST_HEADER include/spdk/mmio.h 00:02:12.506 TEST_HEADER include/spdk/nbd.h 00:02:12.506 CC app/spdk_dd/spdk_dd.o 00:02:12.506 CC app/iscsi_tgt/iscsi_tgt.o 00:02:12.506 TEST_HEADER include/spdk/notify.h 00:02:12.506 CC app/nvmf_tgt/nvmf_main.o 00:02:12.506 TEST_HEADER include/spdk/nvme.h 00:02:12.506 TEST_HEADER include/spdk/nvme_intel.h 00:02:12.506 TEST_HEADER include/spdk/nvme_ocssd.h 00:02:12.506 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:02:12.506 TEST_HEADER include/spdk/nvme_spec.h 00:02:12.506 TEST_HEADER include/spdk/nvme_zns.h 00:02:12.506 TEST_HEADER include/spdk/nvmf_cmd.h 00:02:12.506 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:02:12.506 TEST_HEADER include/spdk/nvmf.h 00:02:12.506 TEST_HEADER include/spdk/nvmf_spec.h 00:02:12.506 TEST_HEADER include/spdk/nvmf_transport.h 00:02:12.506 TEST_HEADER include/spdk/opal_spec.h 00:02:12.506 TEST_HEADER include/spdk/pci_ids.h 00:02:12.506 TEST_HEADER include/spdk/opal.h 00:02:12.506 TEST_HEADER include/spdk/pipe.h 00:02:12.506 CC app/vhost/vhost.o 00:02:12.506 TEST_HEADER include/spdk/reduce.h 00:02:12.506 TEST_HEADER include/spdk/queue.h 00:02:12.506 TEST_HEADER include/spdk/rpc.h 00:02:12.506 TEST_HEADER include/spdk/scsi_spec.h 00:02:12.506 TEST_HEADER include/spdk/scheduler.h 00:02:12.506 TEST_HEADER include/spdk/scsi.h 00:02:12.506 TEST_HEADER include/spdk/sock.h 00:02:12.506 TEST_HEADER include/spdk/stdinc.h 00:02:12.506 TEST_HEADER include/spdk/thread.h 00:02:12.506 TEST_HEADER include/spdk/string.h 00:02:12.506 TEST_HEADER include/spdk/trace.h 00:02:12.506 TEST_HEADER include/spdk/trace_parser.h 00:02:12.506 TEST_HEADER include/spdk/tree.h 00:02:12.506 TEST_HEADER include/spdk/ublk.h 00:02:12.506 TEST_HEADER include/spdk/util.h 00:02:12.506 CC app/spdk_tgt/spdk_tgt.o 00:02:12.506 TEST_HEADER include/spdk/vfio_user_pci.h 00:02:12.506 TEST_HEADER include/spdk/uuid.h 00:02:12.506 TEST_HEADER include/spdk/version.h 00:02:12.506 TEST_HEADER include/spdk/vfio_user_spec.h 00:02:12.506 TEST_HEADER include/spdk/vhost.h 00:02:12.506 TEST_HEADER include/spdk/vmd.h 00:02:12.506 TEST_HEADER include/spdk/xor.h 00:02:12.506 TEST_HEADER include/spdk/zipf.h 00:02:12.506 CXX test/cpp_headers/accel.o 00:02:12.506 CXX test/cpp_headers/assert.o 00:02:12.506 CXX test/cpp_headers/accel_module.o 00:02:12.507 CXX test/cpp_headers/base64.o 00:02:12.507 CXX test/cpp_headers/barrier.o 00:02:12.507 CXX test/cpp_headers/bdev.o 00:02:12.507 CXX test/cpp_headers/bdev_zone.o 00:02:12.507 CXX test/cpp_headers/bit_array.o 00:02:12.507 CXX test/cpp_headers/bdev_module.o 00:02:12.507 CXX test/cpp_headers/bit_pool.o 00:02:12.507 CXX test/cpp_headers/blob_bdev.o 00:02:12.507 CXX test/cpp_headers/blobfs_bdev.o 00:02:12.507 CXX test/cpp_headers/blobfs.o 00:02:12.507 CC examples/idxd/perf/perf.o 00:02:12.507 CXX test/cpp_headers/blob.o 00:02:12.507 CXX test/cpp_headers/conf.o 00:02:12.507 CXX test/cpp_headers/config.o 00:02:12.507 CC examples/nvme/hello_world/hello_world.o 00:02:12.507 CXX test/cpp_headers/cpuset.o 00:02:12.507 CXX test/cpp_headers/crc16.o 00:02:12.507 CC examples/accel/perf/accel_perf.o 00:02:12.507 CXX test/cpp_headers/crc32.o 00:02:12.507 CXX test/cpp_headers/crc64.o 00:02:12.507 CXX test/cpp_headers/dif.o 00:02:12.507 CC examples/ioat/perf/perf.o 00:02:12.507 CC examples/sock/hello_world/hello_sock.o 00:02:12.507 CC examples/ioat/verify/verify.o 00:02:12.507 CC examples/nvme/nvme_manage/nvme_manage.o 00:02:12.507 CC examples/nvme/reconnect/reconnect.o 00:02:12.507 CC examples/nvme/hotplug/hotplug.o 00:02:12.507 CC examples/util/zipf/zipf.o 00:02:12.507 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:02:12.507 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:02:12.507 CC examples/vmd/lsvmd/lsvmd.o 00:02:12.507 CC examples/nvme/abort/abort.o 00:02:12.507 CC test/app/histogram_perf/histogram_perf.o 00:02:12.507 CC examples/vmd/led/led.o 00:02:12.507 CC test/event/event_perf/event_perf.o 00:02:12.507 CC test/thread/poller_perf/poller_perf.o 00:02:12.507 CC test/nvme/doorbell_aers/doorbell_aers.o 00:02:12.507 CC test/nvme/e2edp/nvme_dp.o 00:02:12.507 CC test/nvme/startup/startup.o 00:02:12.507 CC examples/nvme/cmb_copy/cmb_copy.o 00:02:12.507 CC test/env/vtophys/vtophys.o 00:02:12.507 CC test/nvme/overhead/overhead.o 00:02:12.507 CC test/nvme/cuse/cuse.o 00:02:12.507 CC test/app/stub/stub.o 00:02:12.507 CC examples/nvme/arbitration/arbitration.o 00:02:12.507 CC test/nvme/connect_stress/connect_stress.o 00:02:12.507 CC examples/blob/cli/blobcli.o 00:02:12.507 CC test/event/app_repeat/app_repeat.o 00:02:12.507 CC app/fio/nvme/fio_plugin.o 00:02:12.507 CC test/nvme/reset/reset.o 00:02:12.507 CXX test/cpp_headers/dma.o 00:02:12.507 CC test/env/pci/pci_ut.o 00:02:12.507 CC test/nvme/fused_ordering/fused_ordering.o 00:02:12.507 CC examples/thread/thread/thread_ex.o 00:02:12.507 CC test/nvme/boot_partition/boot_partition.o 00:02:12.507 CC test/nvme/aer/aer.o 00:02:12.507 CC examples/nvmf/nvmf/nvmf.o 00:02:12.507 CC test/nvme/sgl/sgl.o 00:02:12.507 CC test/event/reactor/reactor.o 00:02:12.507 CC test/env/memory/memory_ut.o 00:02:12.507 CC test/nvme/simple_copy/simple_copy.o 00:02:12.507 CC test/app/jsoncat/jsoncat.o 00:02:12.507 CC test/nvme/compliance/nvme_compliance.o 00:02:12.507 CC test/event/reactor_perf/reactor_perf.o 00:02:12.507 CC examples/blob/hello_world/hello_blob.o 00:02:12.507 CC test/accel/dif/dif.o 00:02:12.507 CC test/nvme/fdp/fdp.o 00:02:12.507 CC examples/bdev/hello_world/hello_bdev.o 00:02:12.507 CC test/nvme/reserve/reserve.o 00:02:12.507 CC examples/bdev/bdevperf/bdevperf.o 00:02:12.507 CC test/app/bdev_svc/bdev_svc.o 00:02:12.507 CC test/nvme/err_injection/err_injection.o 00:02:12.507 CC test/bdev/bdevio/bdevio.o 00:02:12.507 CC test/blobfs/mkfs/mkfs.o 00:02:12.507 CC test/dma/test_dma/test_dma.o 00:02:12.507 CC app/fio/bdev/fio_plugin.o 00:02:12.507 CC test/event/scheduler/scheduler.o 00:02:12.770 LINK spdk_lspci 00:02:12.770 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:02:12.770 CC test/env/mem_callbacks/mem_callbacks.o 00:02:12.770 CC test/lvol/esnap/esnap.o 00:02:12.770 LINK rpc_client_test 00:02:12.770 LINK spdk_nvme_discover 00:02:12.770 LINK lsvmd 00:02:12.770 LINK spdk_trace_record 00:02:12.770 LINK iscsi_tgt 00:02:12.770 LINK histogram_perf 00:02:12.770 LINK interrupt_tgt 00:02:12.770 LINK zipf 00:02:12.770 LINK poller_perf 00:02:12.770 LINK led 00:02:12.770 LINK vhost 00:02:12.770 LINK jsoncat 00:02:12.770 LINK reactor 00:02:12.770 LINK stub 00:02:12.770 LINK nvmf_tgt 00:02:13.037 LINK startup 00:02:13.037 LINK hello_world 00:02:13.037 LINK fused_ordering 00:02:13.037 LINK spdk_tgt 00:02:13.037 LINK event_perf 00:02:13.037 LINK ioat_perf 00:02:13.037 LINK app_repeat 00:02:13.037 CXX test/cpp_headers/endian.o 00:02:13.037 LINK vtophys 00:02:13.037 CXX test/cpp_headers/env_dpdk.o 00:02:13.037 CXX test/cpp_headers/env.o 00:02:13.037 LINK reactor_perf 00:02:13.037 LINK pmr_persistence 00:02:13.037 LINK hello_sock 00:02:13.037 LINK env_dpdk_post_init 00:02:13.037 CXX test/cpp_headers/event.o 00:02:13.037 CXX test/cpp_headers/fd_group.o 00:02:13.037 CXX test/cpp_headers/fd.o 00:02:13.037 CXX test/cpp_headers/file.o 00:02:13.037 LINK boot_partition 00:02:13.037 LINK hotplug 00:02:13.037 LINK reserve 00:02:13.037 LINK hello_blob 00:02:13.037 CXX test/cpp_headers/ftl.o 00:02:13.037 CXX test/cpp_headers/gpt_spec.o 00:02:13.037 LINK doorbell_aers 00:02:13.037 LINK connect_stress 00:02:13.037 LINK thread 00:02:13.037 LINK cmb_copy 00:02:13.037 LINK bdev_svc 00:02:13.037 LINK hello_bdev 00:02:13.037 LINK verify 00:02:13.037 LINK err_injection 00:02:13.037 LINK nvme_dp 00:02:13.037 LINK spdk_dd 00:02:13.037 CXX test/cpp_headers/hexlify.o 00:02:13.037 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:02:13.037 LINK mkfs 00:02:13.037 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:02:13.037 LINK idxd_perf 00:02:13.037 LINK fdp 00:02:13.037 CXX test/cpp_headers/histogram_data.o 00:02:13.037 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:02:13.037 CXX test/cpp_headers/idxd.o 00:02:13.037 LINK scheduler 00:02:13.037 CXX test/cpp_headers/idxd_spec.o 00:02:13.037 CXX test/cpp_headers/init.o 00:02:13.297 CXX test/cpp_headers/ioat.o 00:02:13.297 CXX test/cpp_headers/ioat_spec.o 00:02:13.297 LINK reconnect 00:02:13.297 LINK simple_copy 00:02:13.297 CXX test/cpp_headers/iscsi_spec.o 00:02:13.297 CXX test/cpp_headers/json.o 00:02:13.297 LINK sgl 00:02:13.297 CXX test/cpp_headers/jsonrpc.o 00:02:13.297 CXX test/cpp_headers/likely.o 00:02:13.297 CXX test/cpp_headers/log.o 00:02:13.297 LINK reset 00:02:13.297 CXX test/cpp_headers/lvol.o 00:02:13.297 LINK spdk_trace 00:02:13.297 CXX test/cpp_headers/memory.o 00:02:13.297 CXX test/cpp_headers/mmio.o 00:02:13.297 LINK bdevio 00:02:13.297 LINK aer 00:02:13.297 CXX test/cpp_headers/nbd.o 00:02:13.297 LINK overhead 00:02:13.297 CXX test/cpp_headers/notify.o 00:02:13.297 CXX test/cpp_headers/nvme.o 00:02:13.297 CXX test/cpp_headers/nvme_intel.o 00:02:13.297 LINK test_dma 00:02:13.297 LINK nvmf 00:02:13.297 CXX test/cpp_headers/nvme_ocssd.o 00:02:13.297 CXX test/cpp_headers/nvme_spec.o 00:02:13.297 CXX test/cpp_headers/nvme_ocssd_spec.o 00:02:13.297 LINK accel_perf 00:02:13.297 CXX test/cpp_headers/nvmf_cmd.o 00:02:13.297 CXX test/cpp_headers/nvme_zns.o 00:02:13.297 CXX test/cpp_headers/nvmf_fc_spec.o 00:02:13.297 CXX test/cpp_headers/nvmf.o 00:02:13.297 CXX test/cpp_headers/nvmf_spec.o 00:02:13.297 CXX test/cpp_headers/opal.o 00:02:13.297 CXX test/cpp_headers/nvmf_transport.o 00:02:13.297 CXX test/cpp_headers/opal_spec.o 00:02:13.297 CXX test/cpp_headers/pipe.o 00:02:13.297 CXX test/cpp_headers/pci_ids.o 00:02:13.297 CXX test/cpp_headers/queue.o 00:02:13.297 CXX test/cpp_headers/reduce.o 00:02:13.297 CXX test/cpp_headers/rpc.o 00:02:13.297 CXX test/cpp_headers/scheduler.o 00:02:13.297 LINK arbitration 00:02:13.297 CXX test/cpp_headers/scsi.o 00:02:13.297 CXX test/cpp_headers/sock.o 00:02:13.297 CXX test/cpp_headers/scsi_spec.o 00:02:13.297 CXX test/cpp_headers/stdinc.o 00:02:13.297 CXX test/cpp_headers/string.o 00:02:13.297 CXX test/cpp_headers/thread.o 00:02:13.297 CXX test/cpp_headers/trace.o 00:02:13.297 LINK blobcli 00:02:13.297 LINK nvme_compliance 00:02:13.297 LINK abort 00:02:13.297 CXX test/cpp_headers/trace_parser.o 00:02:13.297 CXX test/cpp_headers/tree.o 00:02:13.297 CXX test/cpp_headers/ublk.o 00:02:13.297 CXX test/cpp_headers/util.o 00:02:13.559 LINK spdk_nvme 00:02:13.559 CXX test/cpp_headers/version.o 00:02:13.559 CXX test/cpp_headers/uuid.o 00:02:13.559 CXX test/cpp_headers/vfio_user_pci.o 00:02:13.559 CXX test/cpp_headers/vfio_user_spec.o 00:02:13.559 LINK dif 00:02:13.559 CXX test/cpp_headers/vhost.o 00:02:13.559 CXX test/cpp_headers/vmd.o 00:02:13.559 CXX test/cpp_headers/xor.o 00:02:13.559 CXX test/cpp_headers/zipf.o 00:02:13.559 LINK pci_ut 00:02:13.559 LINK nvme_manage 00:02:13.559 LINK nvme_fuzz 00:02:13.818 LINK spdk_bdev 00:02:13.818 LINK spdk_nvme_identify 00:02:13.818 LINK bdevperf 00:02:13.818 LINK mem_callbacks 00:02:13.818 LINK spdk_nvme_perf 00:02:13.818 LINK vhost_fuzz 00:02:14.077 LINK spdk_top 00:02:14.077 LINK cuse 00:02:14.077 LINK memory_ut 00:02:14.645 LINK iscsi_fuzz 00:02:16.549 LINK esnap 00:02:16.549 00:02:16.549 real 0m40.619s 00:02:16.549 user 6m41.194s 00:02:16.549 sys 3m12.767s 00:02:16.549 14:06:31 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:16.549 14:06:31 -- common/autotest_common.sh@10 -- $ set +x 00:02:16.549 ************************************ 00:02:16.549 END TEST make 00:02:16.549 ************************************ 00:02:16.549 14:06:31 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:16.809 14:06:31 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:16.809 14:06:31 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:16.809 14:06:31 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:16.809 14:06:31 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:16.809 14:06:31 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:16.809 14:06:31 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:16.809 14:06:31 -- scripts/common.sh@335 -- # IFS=.-: 00:02:16.809 14:06:31 -- scripts/common.sh@335 -- # read -ra ver1 00:02:16.809 14:06:31 -- scripts/common.sh@336 -- # IFS=.-: 00:02:16.809 14:06:31 -- scripts/common.sh@336 -- # read -ra ver2 00:02:16.809 14:06:31 -- scripts/common.sh@337 -- # local 'op=<' 00:02:16.809 14:06:31 -- scripts/common.sh@339 -- # ver1_l=2 00:02:16.809 14:06:31 -- scripts/common.sh@340 -- # ver2_l=1 00:02:16.809 14:06:31 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:16.809 14:06:31 -- scripts/common.sh@343 -- # case "$op" in 00:02:16.809 14:06:31 -- scripts/common.sh@344 -- # : 1 00:02:16.809 14:06:31 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:16.809 14:06:31 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:16.809 14:06:31 -- scripts/common.sh@364 -- # decimal 1 00:02:16.809 14:06:31 -- scripts/common.sh@352 -- # local d=1 00:02:16.809 14:06:31 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:16.809 14:06:31 -- scripts/common.sh@354 -- # echo 1 00:02:16.809 14:06:31 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:16.809 14:06:31 -- scripts/common.sh@365 -- # decimal 2 00:02:16.809 14:06:31 -- scripts/common.sh@352 -- # local d=2 00:02:16.809 14:06:31 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:16.809 14:06:31 -- scripts/common.sh@354 -- # echo 2 00:02:16.809 14:06:31 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:16.809 14:06:31 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:16.809 14:06:31 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:16.809 14:06:31 -- scripts/common.sh@367 -- # return 0 00:02:16.809 14:06:31 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:16.809 14:06:31 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:16.809 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:16.809 --rc genhtml_branch_coverage=1 00:02:16.809 --rc genhtml_function_coverage=1 00:02:16.809 --rc genhtml_legend=1 00:02:16.809 --rc geninfo_all_blocks=1 00:02:16.809 --rc geninfo_unexecuted_blocks=1 00:02:16.809 00:02:16.809 ' 00:02:16.809 14:06:31 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:16.809 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:16.809 --rc genhtml_branch_coverage=1 00:02:16.809 --rc genhtml_function_coverage=1 00:02:16.809 --rc genhtml_legend=1 00:02:16.809 --rc geninfo_all_blocks=1 00:02:16.809 --rc geninfo_unexecuted_blocks=1 00:02:16.809 00:02:16.809 ' 00:02:16.809 14:06:31 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:16.809 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:16.809 --rc genhtml_branch_coverage=1 00:02:16.809 --rc genhtml_function_coverage=1 00:02:16.809 --rc genhtml_legend=1 00:02:16.809 --rc geninfo_all_blocks=1 00:02:16.809 --rc geninfo_unexecuted_blocks=1 00:02:16.809 00:02:16.809 ' 00:02:16.809 14:06:31 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:16.809 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:16.809 --rc genhtml_branch_coverage=1 00:02:16.809 --rc genhtml_function_coverage=1 00:02:16.809 --rc genhtml_legend=1 00:02:16.809 --rc geninfo_all_blocks=1 00:02:16.809 --rc geninfo_unexecuted_blocks=1 00:02:16.809 00:02:16.809 ' 00:02:16.809 14:06:31 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:02:16.809 14:06:31 -- nvmf/common.sh@7 -- # uname -s 00:02:16.809 14:06:31 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:02:16.809 14:06:31 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:02:16.809 14:06:31 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:02:16.809 14:06:31 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:02:16.809 14:06:31 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:02:16.809 14:06:31 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:02:16.809 14:06:31 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:02:16.809 14:06:31 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:02:16.809 14:06:31 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:02:16.809 14:06:31 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:02:16.809 14:06:31 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:02:16.809 14:06:31 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:02:16.809 14:06:31 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:02:16.809 14:06:31 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:02:16.809 14:06:31 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:02:16.809 14:06:31 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:02:16.809 14:06:31 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:02:16.809 14:06:31 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:02:16.809 14:06:31 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:02:16.809 14:06:31 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:16.809 14:06:31 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:16.810 14:06:31 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:16.810 14:06:31 -- paths/export.sh@5 -- # export PATH 00:02:16.810 14:06:31 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:02:16.810 14:06:31 -- nvmf/common.sh@46 -- # : 0 00:02:16.810 14:06:31 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:02:16.810 14:06:31 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:02:16.810 14:06:31 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:02:16.810 14:06:31 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:02:16.810 14:06:31 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:02:16.810 14:06:31 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:02:16.810 14:06:31 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:02:16.810 14:06:31 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:02:16.810 14:06:31 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:02:16.810 14:06:31 -- spdk/autotest.sh@32 -- # uname -s 00:02:16.810 14:06:31 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:02:16.810 14:06:31 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:02:16.810 14:06:31 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:16.810 14:06:31 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:02:16.810 14:06:31 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:02:16.810 14:06:31 -- spdk/autotest.sh@44 -- # modprobe nbd 00:02:16.810 14:06:31 -- spdk/autotest.sh@46 -- # type -P udevadm 00:02:16.810 14:06:31 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:02:16.810 14:06:31 -- spdk/autotest.sh@48 -- # udevadm_pid=147222 00:02:16.810 14:06:31 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:16.810 14:06:31 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:02:16.810 14:06:31 -- spdk/autotest.sh@54 -- # echo 147224 00:02:16.810 14:06:31 -- spdk/autotest.sh@56 -- # echo 147225 00:02:16.810 14:06:31 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:16.810 14:06:31 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:02:16.810 14:06:31 -- spdk/autotest.sh@60 -- # echo 147226 00:02:16.810 14:06:31 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:02:16.810 14:06:31 -- spdk/autotest.sh@62 -- # echo 147227 00:02:16.810 14:06:31 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:16.810 14:06:31 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:02:16.810 14:06:31 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:02:16.810 14:06:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:16.810 14:06:31 -- common/autotest_common.sh@10 -- # set +x 00:02:16.810 14:06:31 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:02:16.810 14:06:31 -- spdk/autotest.sh@70 -- # create_test_list 00:02:16.810 14:06:31 -- common/autotest_common.sh@746 -- # xtrace_disable 00:02:16.810 14:06:31 -- common/autotest_common.sh@10 -- # set +x 00:02:16.810 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:02:16.810 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:02:16.810 14:06:31 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:02:16.810 14:06:31 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:16.810 14:06:31 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:16.810 14:06:31 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:02:16.810 14:06:31 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:16.810 14:06:31 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:02:16.810 14:06:31 -- common/autotest_common.sh@1450 -- # uname 00:02:16.810 14:06:31 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:02:16.810 14:06:31 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:02:16.810 14:06:31 -- common/autotest_common.sh@1470 -- # uname 00:02:16.810 14:06:31 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:02:16.810 14:06:31 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:02:16.810 14:06:31 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:02:16.810 lcov: LCOV version 1.15 00:02:16.810 14:06:31 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:02:19.344 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:02:19.344 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:02:19.344 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:02:19.344 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:02:19.344 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:02:19.344 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:02:41.279 14:06:52 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:02:41.279 14:06:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:02:41.279 14:06:52 -- common/autotest_common.sh@10 -- # set +x 00:02:41.279 14:06:52 -- spdk/autotest.sh@89 -- # rm -f 00:02:41.279 14:06:52 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:41.279 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:02:41.279 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:02:41.279 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:02:41.279 14:06:55 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:02:41.279 14:06:55 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:41.279 14:06:55 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:41.279 14:06:55 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:41.279 14:06:55 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:41.279 14:06:55 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:41.279 14:06:55 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:41.279 14:06:55 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:41.279 14:06:55 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:41.279 14:06:55 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:02:41.279 14:06:55 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:02:41.279 14:06:55 -- spdk/autotest.sh@108 -- # grep -v p 00:02:41.279 14:06:55 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:02:41.279 14:06:55 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:02:41.279 14:06:55 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:02:41.279 14:06:55 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:02:41.279 14:06:55 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:02:41.279 No valid GPT data, bailing 00:02:41.279 14:06:55 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:02:41.279 14:06:55 -- scripts/common.sh@393 -- # pt= 00:02:41.279 14:06:55 -- scripts/common.sh@394 -- # return 1 00:02:41.279 14:06:55 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:02:41.279 1+0 records in 00:02:41.279 1+0 records out 00:02:41.279 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00558296 s, 188 MB/s 00:02:41.279 14:06:55 -- spdk/autotest.sh@116 -- # sync 00:02:41.279 14:06:55 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:02:41.279 14:06:55 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:02:41.279 14:06:55 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:02:46.551 14:07:00 -- spdk/autotest.sh@122 -- # uname -s 00:02:46.551 14:07:00 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:02:46.551 14:07:00 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:46.551 14:07:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:46.551 14:07:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:46.551 14:07:00 -- common/autotest_common.sh@10 -- # set +x 00:02:46.551 ************************************ 00:02:46.551 START TEST setup.sh 00:02:46.551 ************************************ 00:02:46.551 14:07:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:02:46.551 * Looking for test storage... 00:02:46.551 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:46.551 14:07:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:46.551 14:07:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:46.551 14:07:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:46.551 14:07:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:46.551 14:07:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:46.551 14:07:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:46.551 14:07:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:46.551 14:07:00 -- scripts/common.sh@335 -- # IFS=.-: 00:02:46.551 14:07:00 -- scripts/common.sh@335 -- # read -ra ver1 00:02:46.551 14:07:00 -- scripts/common.sh@336 -- # IFS=.-: 00:02:46.551 14:07:00 -- scripts/common.sh@336 -- # read -ra ver2 00:02:46.551 14:07:00 -- scripts/common.sh@337 -- # local 'op=<' 00:02:46.551 14:07:00 -- scripts/common.sh@339 -- # ver1_l=2 00:02:46.552 14:07:00 -- scripts/common.sh@340 -- # ver2_l=1 00:02:46.552 14:07:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:46.552 14:07:00 -- scripts/common.sh@343 -- # case "$op" in 00:02:46.552 14:07:00 -- scripts/common.sh@344 -- # : 1 00:02:46.552 14:07:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:46.552 14:07:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:46.552 14:07:00 -- scripts/common.sh@364 -- # decimal 1 00:02:46.552 14:07:00 -- scripts/common.sh@352 -- # local d=1 00:02:46.552 14:07:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:46.552 14:07:00 -- scripts/common.sh@354 -- # echo 1 00:02:46.552 14:07:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:46.552 14:07:00 -- scripts/common.sh@365 -- # decimal 2 00:02:46.552 14:07:00 -- scripts/common.sh@352 -- # local d=2 00:02:46.552 14:07:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:46.552 14:07:00 -- scripts/common.sh@354 -- # echo 2 00:02:46.552 14:07:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:46.552 14:07:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:46.552 14:07:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:46.552 14:07:00 -- scripts/common.sh@367 -- # return 0 00:02:46.552 14:07:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:46.552 14:07:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:46.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:46.552 --rc genhtml_branch_coverage=1 00:02:46.552 --rc genhtml_function_coverage=1 00:02:46.552 --rc genhtml_legend=1 00:02:46.552 --rc geninfo_all_blocks=1 00:02:46.552 --rc geninfo_unexecuted_blocks=1 00:02:46.552 00:02:46.552 ' 00:02:46.552 14:07:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:46.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:46.552 --rc genhtml_branch_coverage=1 00:02:46.552 --rc genhtml_function_coverage=1 00:02:46.552 --rc genhtml_legend=1 00:02:46.552 --rc geninfo_all_blocks=1 00:02:46.552 --rc geninfo_unexecuted_blocks=1 00:02:46.552 00:02:46.552 ' 00:02:46.552 14:07:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:46.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:46.552 --rc genhtml_branch_coverage=1 00:02:46.552 --rc genhtml_function_coverage=1 00:02:46.552 --rc genhtml_legend=1 00:02:46.552 --rc geninfo_all_blocks=1 00:02:46.552 --rc geninfo_unexecuted_blocks=1 00:02:46.552 00:02:46.552 ' 00:02:46.552 14:07:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:46.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:46.552 --rc genhtml_branch_coverage=1 00:02:46.552 --rc genhtml_function_coverage=1 00:02:46.552 --rc genhtml_legend=1 00:02:46.552 --rc geninfo_all_blocks=1 00:02:46.552 --rc geninfo_unexecuted_blocks=1 00:02:46.552 00:02:46.552 ' 00:02:46.552 14:07:00 -- setup/test-setup.sh@10 -- # uname -s 00:02:46.552 14:07:00 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:02:46.552 14:07:00 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:46.552 14:07:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:46.552 14:07:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:46.552 14:07:00 -- common/autotest_common.sh@10 -- # set +x 00:02:46.552 ************************************ 00:02:46.552 START TEST acl 00:02:46.552 ************************************ 00:02:46.552 14:07:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:02:46.552 * Looking for test storage... 00:02:46.552 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:02:46.552 14:07:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:02:46.552 14:07:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:02:46.552 14:07:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:02:46.552 14:07:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:02:46.552 14:07:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:02:46.552 14:07:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:02:46.552 14:07:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:02:46.552 14:07:01 -- scripts/common.sh@335 -- # IFS=.-: 00:02:46.552 14:07:01 -- scripts/common.sh@335 -- # read -ra ver1 00:02:46.552 14:07:01 -- scripts/common.sh@336 -- # IFS=.-: 00:02:46.552 14:07:01 -- scripts/common.sh@336 -- # read -ra ver2 00:02:46.552 14:07:01 -- scripts/common.sh@337 -- # local 'op=<' 00:02:46.552 14:07:01 -- scripts/common.sh@339 -- # ver1_l=2 00:02:46.552 14:07:01 -- scripts/common.sh@340 -- # ver2_l=1 00:02:46.552 14:07:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:02:46.552 14:07:01 -- scripts/common.sh@343 -- # case "$op" in 00:02:46.552 14:07:01 -- scripts/common.sh@344 -- # : 1 00:02:46.552 14:07:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:02:46.552 14:07:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:02:46.552 14:07:01 -- scripts/common.sh@364 -- # decimal 1 00:02:46.552 14:07:01 -- scripts/common.sh@352 -- # local d=1 00:02:46.552 14:07:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:02:46.552 14:07:01 -- scripts/common.sh@354 -- # echo 1 00:02:46.552 14:07:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:02:46.552 14:07:01 -- scripts/common.sh@365 -- # decimal 2 00:02:46.552 14:07:01 -- scripts/common.sh@352 -- # local d=2 00:02:46.552 14:07:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:02:46.552 14:07:01 -- scripts/common.sh@354 -- # echo 2 00:02:46.552 14:07:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:02:46.552 14:07:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:02:46.552 14:07:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:02:46.552 14:07:01 -- scripts/common.sh@367 -- # return 0 00:02:46.552 14:07:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:02:46.552 14:07:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:02:46.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:46.552 --rc genhtml_branch_coverage=1 00:02:46.552 --rc genhtml_function_coverage=1 00:02:46.552 --rc genhtml_legend=1 00:02:46.552 --rc geninfo_all_blocks=1 00:02:46.552 --rc geninfo_unexecuted_blocks=1 00:02:46.552 00:02:46.552 ' 00:02:46.552 14:07:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:02:46.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:46.552 --rc genhtml_branch_coverage=1 00:02:46.552 --rc genhtml_function_coverage=1 00:02:46.552 --rc genhtml_legend=1 00:02:46.552 --rc geninfo_all_blocks=1 00:02:46.552 --rc geninfo_unexecuted_blocks=1 00:02:46.552 00:02:46.552 ' 00:02:46.552 14:07:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:02:46.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:46.552 --rc genhtml_branch_coverage=1 00:02:46.552 --rc genhtml_function_coverage=1 00:02:46.552 --rc genhtml_legend=1 00:02:46.552 --rc geninfo_all_blocks=1 00:02:46.552 --rc geninfo_unexecuted_blocks=1 00:02:46.552 00:02:46.552 ' 00:02:46.552 14:07:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:02:46.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:02:46.552 --rc genhtml_branch_coverage=1 00:02:46.552 --rc genhtml_function_coverage=1 00:02:46.552 --rc genhtml_legend=1 00:02:46.552 --rc geninfo_all_blocks=1 00:02:46.552 --rc geninfo_unexecuted_blocks=1 00:02:46.552 00:02:46.552 ' 00:02:46.552 14:07:01 -- setup/acl.sh@10 -- # get_zoned_devs 00:02:46.552 14:07:01 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:02:46.552 14:07:01 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:02:46.552 14:07:01 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:02:46.552 14:07:01 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:02:46.552 14:07:01 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:02:46.552 14:07:01 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:02:46.552 14:07:01 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:02:46.552 14:07:01 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:02:46.552 14:07:01 -- setup/acl.sh@12 -- # devs=() 00:02:46.552 14:07:01 -- setup/acl.sh@12 -- # declare -a devs 00:02:46.552 14:07:01 -- setup/acl.sh@13 -- # drivers=() 00:02:46.552 14:07:01 -- setup/acl.sh@13 -- # declare -A drivers 00:02:46.552 14:07:01 -- setup/acl.sh@51 -- # setup reset 00:02:46.552 14:07:01 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:46.812 14:07:01 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:50.097 14:07:04 -- setup/acl.sh@52 -- # collect_setup_devs 00:02:50.097 14:07:04 -- setup/acl.sh@16 -- # local dev driver 00:02:50.097 14:07:04 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:50.097 14:07:04 -- setup/acl.sh@15 -- # setup output status 00:02:50.097 14:07:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:50.097 14:07:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:02:52.002 Hugepages 00:02:52.002 node hugesize free / total 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # continue 00:02:52.002 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # continue 00:02:52.002 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # continue 00:02:52.002 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.002 00:02:52.002 Type BDF Vendor Device NUMA Driver Device Block devices 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # continue 00:02:52.002 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:02:52.002 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.002 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.002 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:02:52.002 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.002 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.002 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.002 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:02:52.002 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.002 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.002 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.003 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.003 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.003 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.003 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.003 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.003 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.003 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.003 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.003 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.003 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.003 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:5e:00.0 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@22 -- # devs+=("$dev") 00:02:52.262 14:07:06 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:02:52.262 14:07:06 -- setup/acl.sh@20 -- # continue 00:02:52.262 14:07:06 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:02:52.262 14:07:06 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:02:52.262 14:07:06 -- setup/acl.sh@54 -- # run_test denied denied 00:02:52.262 14:07:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:52.262 14:07:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:52.262 14:07:06 -- common/autotest_common.sh@10 -- # set +x 00:02:52.262 ************************************ 00:02:52.262 START TEST denied 00:02:52.262 ************************************ 00:02:52.262 14:07:06 -- common/autotest_common.sh@1114 -- # denied 00:02:52.262 14:07:06 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:5e:00.0' 00:02:52.262 14:07:06 -- setup/acl.sh@38 -- # setup output config 00:02:52.262 14:07:06 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:5e:00.0' 00:02:52.262 14:07:06 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:52.262 14:07:06 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:02:55.633 0000:5e:00.0 (8086 0a54): Skipping denied controller at 0000:5e:00.0 00:02:55.633 14:07:09 -- setup/acl.sh@40 -- # verify 0000:5e:00.0 00:02:55.633 14:07:09 -- setup/acl.sh@28 -- # local dev driver 00:02:55.633 14:07:09 -- setup/acl.sh@30 -- # for dev in "$@" 00:02:55.633 14:07:09 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:5e:00.0 ]] 00:02:55.633 14:07:09 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:5e:00.0/driver 00:02:55.633 14:07:09 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:02:55.633 14:07:09 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:02:55.633 14:07:09 -- setup/acl.sh@41 -- # setup reset 00:02:55.633 14:07:09 -- setup/common.sh@9 -- # [[ reset == output ]] 00:02:55.633 14:07:09 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:02:58.975 00:02:58.975 real 0m6.742s 00:02:58.975 user 0m2.079s 00:02:58.975 sys 0m3.928s 00:02:58.975 14:07:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:02:58.975 14:07:13 -- common/autotest_common.sh@10 -- # set +x 00:02:58.975 ************************************ 00:02:58.975 END TEST denied 00:02:58.975 ************************************ 00:02:58.975 14:07:13 -- setup/acl.sh@55 -- # run_test allowed allowed 00:02:58.975 14:07:13 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:02:58.975 14:07:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:02:58.975 14:07:13 -- common/autotest_common.sh@10 -- # set +x 00:02:58.975 ************************************ 00:02:58.975 START TEST allowed 00:02:58.975 ************************************ 00:02:58.975 14:07:13 -- common/autotest_common.sh@1114 -- # allowed 00:02:58.975 14:07:13 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:5e:00.0 00:02:58.975 14:07:13 -- setup/acl.sh@45 -- # setup output config 00:02:58.975 14:07:13 -- setup/acl.sh@46 -- # grep -E '0000:5e:00.0 .*: nvme -> .*' 00:02:58.975 14:07:13 -- setup/common.sh@9 -- # [[ output == output ]] 00:02:58.975 14:07:13 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:03.167 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:03:03.168 14:07:16 -- setup/acl.sh@47 -- # verify 00:03:03.168 14:07:16 -- setup/acl.sh@28 -- # local dev driver 00:03:03.168 14:07:16 -- setup/acl.sh@48 -- # setup reset 00:03:03.168 14:07:16 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:03.168 14:07:16 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:05.704 00:03:05.704 real 0m6.408s 00:03:05.704 user 0m1.846s 00:03:05.704 sys 0m3.602s 00:03:05.704 14:07:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:05.704 14:07:19 -- common/autotest_common.sh@10 -- # set +x 00:03:05.704 ************************************ 00:03:05.704 END TEST allowed 00:03:05.704 ************************************ 00:03:05.704 00:03:05.704 real 0m18.981s 00:03:05.704 user 0m6.116s 00:03:05.704 sys 0m11.362s 00:03:05.704 14:07:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:05.704 14:07:19 -- common/autotest_common.sh@10 -- # set +x 00:03:05.704 ************************************ 00:03:05.704 END TEST acl 00:03:05.704 ************************************ 00:03:05.704 14:07:19 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:05.704 14:07:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:05.704 14:07:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:05.704 14:07:19 -- common/autotest_common.sh@10 -- # set +x 00:03:05.704 ************************************ 00:03:05.704 START TEST hugepages 00:03:05.704 ************************************ 00:03:05.704 14:07:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:03:05.704 * Looking for test storage... 00:03:05.704 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:05.704 14:07:20 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:05.704 14:07:20 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:05.704 14:07:20 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:05.704 14:07:20 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:05.704 14:07:20 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:05.704 14:07:20 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:05.704 14:07:20 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:05.704 14:07:20 -- scripts/common.sh@335 -- # IFS=.-: 00:03:05.704 14:07:20 -- scripts/common.sh@335 -- # read -ra ver1 00:03:05.704 14:07:20 -- scripts/common.sh@336 -- # IFS=.-: 00:03:05.704 14:07:20 -- scripts/common.sh@336 -- # read -ra ver2 00:03:05.704 14:07:20 -- scripts/common.sh@337 -- # local 'op=<' 00:03:05.704 14:07:20 -- scripts/common.sh@339 -- # ver1_l=2 00:03:05.704 14:07:20 -- scripts/common.sh@340 -- # ver2_l=1 00:03:05.704 14:07:20 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:05.704 14:07:20 -- scripts/common.sh@343 -- # case "$op" in 00:03:05.704 14:07:20 -- scripts/common.sh@344 -- # : 1 00:03:05.704 14:07:20 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:05.704 14:07:20 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:05.704 14:07:20 -- scripts/common.sh@364 -- # decimal 1 00:03:05.704 14:07:20 -- scripts/common.sh@352 -- # local d=1 00:03:05.704 14:07:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:05.704 14:07:20 -- scripts/common.sh@354 -- # echo 1 00:03:05.704 14:07:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:05.704 14:07:20 -- scripts/common.sh@365 -- # decimal 2 00:03:05.704 14:07:20 -- scripts/common.sh@352 -- # local d=2 00:03:05.704 14:07:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:05.704 14:07:20 -- scripts/common.sh@354 -- # echo 2 00:03:05.704 14:07:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:05.704 14:07:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:05.704 14:07:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:05.704 14:07:20 -- scripts/common.sh@367 -- # return 0 00:03:05.704 14:07:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:05.704 14:07:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:05.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.704 --rc genhtml_branch_coverage=1 00:03:05.704 --rc genhtml_function_coverage=1 00:03:05.704 --rc genhtml_legend=1 00:03:05.704 --rc geninfo_all_blocks=1 00:03:05.704 --rc geninfo_unexecuted_blocks=1 00:03:05.704 00:03:05.704 ' 00:03:05.704 14:07:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:05.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.704 --rc genhtml_branch_coverage=1 00:03:05.704 --rc genhtml_function_coverage=1 00:03:05.704 --rc genhtml_legend=1 00:03:05.704 --rc geninfo_all_blocks=1 00:03:05.704 --rc geninfo_unexecuted_blocks=1 00:03:05.704 00:03:05.704 ' 00:03:05.704 14:07:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:05.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.704 --rc genhtml_branch_coverage=1 00:03:05.704 --rc genhtml_function_coverage=1 00:03:05.704 --rc genhtml_legend=1 00:03:05.704 --rc geninfo_all_blocks=1 00:03:05.704 --rc geninfo_unexecuted_blocks=1 00:03:05.704 00:03:05.704 ' 00:03:05.704 14:07:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:05.704 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:05.704 --rc genhtml_branch_coverage=1 00:03:05.704 --rc genhtml_function_coverage=1 00:03:05.704 --rc genhtml_legend=1 00:03:05.704 --rc geninfo_all_blocks=1 00:03:05.704 --rc geninfo_unexecuted_blocks=1 00:03:05.704 00:03:05.704 ' 00:03:05.704 14:07:20 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:03:05.704 14:07:20 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:03:05.704 14:07:20 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:03:05.704 14:07:20 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:03:05.704 14:07:20 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:03:05.704 14:07:20 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:03:05.704 14:07:20 -- setup/common.sh@17 -- # local get=Hugepagesize 00:03:05.704 14:07:20 -- setup/common.sh@18 -- # local node= 00:03:05.704 14:07:20 -- setup/common.sh@19 -- # local var val 00:03:05.704 14:07:20 -- setup/common.sh@20 -- # local mem_f mem 00:03:05.704 14:07:20 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:05.704 14:07:20 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:05.704 14:07:20 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:05.704 14:07:20 -- setup/common.sh@28 -- # mapfile -t mem 00:03:05.704 14:07:20 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 75178668 kB' 'MemAvailable: 78921168 kB' 'Buffers: 4136 kB' 'Cached: 10608028 kB' 'SwapCached: 0 kB' 'Active: 7262516 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865108 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 485340 kB' 'Mapped: 186940 kB' 'Shmem: 6383640 kB' 'KReclaimable: 220308 kB' 'Slab: 972544 kB' 'SReclaimable: 220308 kB' 'SUnreclaim: 752236 kB' 'KernelStack: 19648 kB' 'PageTables: 8424 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 52947900 kB' 'Committed_AS: 8104936 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215004 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.704 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.704 14:07:20 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # continue 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # IFS=': ' 00:03:05.705 14:07:20 -- setup/common.sh@31 -- # read -r var val _ 00:03:05.705 14:07:20 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:03:05.705 14:07:20 -- setup/common.sh@33 -- # echo 2048 00:03:05.705 14:07:20 -- setup/common.sh@33 -- # return 0 00:03:05.705 14:07:20 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:03:05.705 14:07:20 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:03:05.705 14:07:20 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:03:05.705 14:07:20 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:03:05.705 14:07:20 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:03:05.705 14:07:20 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:03:05.705 14:07:20 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:03:05.705 14:07:20 -- setup/hugepages.sh@207 -- # get_nodes 00:03:05.705 14:07:20 -- setup/hugepages.sh@27 -- # local node 00:03:05.705 14:07:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:05.705 14:07:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:03:05.705 14:07:20 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:05.705 14:07:20 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:05.705 14:07:20 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:05.705 14:07:20 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:05.705 14:07:20 -- setup/hugepages.sh@208 -- # clear_hp 00:03:05.705 14:07:20 -- setup/hugepages.sh@37 -- # local node hp 00:03:05.705 14:07:20 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:05.705 14:07:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:05.705 14:07:20 -- setup/hugepages.sh@41 -- # echo 0 00:03:05.705 14:07:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:05.705 14:07:20 -- setup/hugepages.sh@41 -- # echo 0 00:03:05.705 14:07:20 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:05.705 14:07:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:05.705 14:07:20 -- setup/hugepages.sh@41 -- # echo 0 00:03:05.705 14:07:20 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:05.705 14:07:20 -- setup/hugepages.sh@41 -- # echo 0 00:03:05.705 14:07:20 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:05.705 14:07:20 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:05.705 14:07:20 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:03:05.705 14:07:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:05.705 14:07:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:05.705 14:07:20 -- common/autotest_common.sh@10 -- # set +x 00:03:05.705 ************************************ 00:03:05.705 START TEST default_setup 00:03:05.705 ************************************ 00:03:05.706 14:07:20 -- common/autotest_common.sh@1114 -- # default_setup 00:03:05.706 14:07:20 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:03:05.706 14:07:20 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:05.706 14:07:20 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:05.706 14:07:20 -- setup/hugepages.sh@51 -- # shift 00:03:05.706 14:07:20 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:05.706 14:07:20 -- setup/hugepages.sh@52 -- # local node_ids 00:03:05.706 14:07:20 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:05.706 14:07:20 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:05.706 14:07:20 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:05.706 14:07:20 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:05.706 14:07:20 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:05.706 14:07:20 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:05.706 14:07:20 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:05.706 14:07:20 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:05.706 14:07:20 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:05.706 14:07:20 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:05.706 14:07:20 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:05.706 14:07:20 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:05.706 14:07:20 -- setup/hugepages.sh@73 -- # return 0 00:03:05.706 14:07:20 -- setup/hugepages.sh@137 -- # setup output 00:03:05.706 14:07:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:05.706 14:07:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:08.996 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:03:08.996 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:03:09.567 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:03:09.567 14:07:24 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:03:09.567 14:07:24 -- setup/hugepages.sh@89 -- # local node 00:03:09.567 14:07:24 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:09.567 14:07:24 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:09.567 14:07:24 -- setup/hugepages.sh@92 -- # local surp 00:03:09.567 14:07:24 -- setup/hugepages.sh@93 -- # local resv 00:03:09.567 14:07:24 -- setup/hugepages.sh@94 -- # local anon 00:03:09.567 14:07:24 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:09.567 14:07:24 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:09.567 14:07:24 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:09.567 14:07:24 -- setup/common.sh@18 -- # local node= 00:03:09.567 14:07:24 -- setup/common.sh@19 -- # local var val 00:03:09.567 14:07:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:09.567 14:07:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:09.567 14:07:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:09.567 14:07:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:09.567 14:07:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:09.567 14:07:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77341176 kB' 'MemAvailable: 81083660 kB' 'Buffers: 4136 kB' 'Cached: 10608136 kB' 'SwapCached: 0 kB' 'Active: 7261476 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864068 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483704 kB' 'Mapped: 186328 kB' 'Shmem: 6383748 kB' 'KReclaimable: 220276 kB' 'Slab: 972332 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 752056 kB' 'KernelStack: 19664 kB' 'PageTables: 8180 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8108720 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215244 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.567 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.567 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:09.568 14:07:24 -- setup/common.sh@33 -- # echo 0 00:03:09.568 14:07:24 -- setup/common.sh@33 -- # return 0 00:03:09.568 14:07:24 -- setup/hugepages.sh@97 -- # anon=0 00:03:09.568 14:07:24 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:09.568 14:07:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:09.568 14:07:24 -- setup/common.sh@18 -- # local node= 00:03:09.568 14:07:24 -- setup/common.sh@19 -- # local var val 00:03:09.568 14:07:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:09.568 14:07:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:09.568 14:07:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:09.568 14:07:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:09.568 14:07:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:09.568 14:07:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77343072 kB' 'MemAvailable: 81085556 kB' 'Buffers: 4136 kB' 'Cached: 10608144 kB' 'SwapCached: 0 kB' 'Active: 7260920 kB' 'Inactive: 3831116 kB' 'Active(anon): 6863512 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482940 kB' 'Mapped: 186256 kB' 'Shmem: 6383756 kB' 'KReclaimable: 220276 kB' 'Slab: 972332 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 752056 kB' 'KernelStack: 19760 kB' 'PageTables: 8460 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8108736 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215276 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.568 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.568 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.569 14:07:24 -- setup/common.sh@33 -- # echo 0 00:03:09.569 14:07:24 -- setup/common.sh@33 -- # return 0 00:03:09.569 14:07:24 -- setup/hugepages.sh@99 -- # surp=0 00:03:09.569 14:07:24 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:09.569 14:07:24 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:09.569 14:07:24 -- setup/common.sh@18 -- # local node= 00:03:09.569 14:07:24 -- setup/common.sh@19 -- # local var val 00:03:09.569 14:07:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:09.569 14:07:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:09.569 14:07:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:09.569 14:07:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:09.569 14:07:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:09.569 14:07:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77343172 kB' 'MemAvailable: 81085656 kB' 'Buffers: 4136 kB' 'Cached: 10608144 kB' 'SwapCached: 0 kB' 'Active: 7260984 kB' 'Inactive: 3831116 kB' 'Active(anon): 6863576 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483028 kB' 'Mapped: 186260 kB' 'Shmem: 6383756 kB' 'KReclaimable: 220276 kB' 'Slab: 972388 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 752112 kB' 'KernelStack: 19824 kB' 'PageTables: 8496 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8108752 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215324 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.569 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.569 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.570 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.570 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:09.571 14:07:24 -- setup/common.sh@33 -- # echo 0 00:03:09.571 14:07:24 -- setup/common.sh@33 -- # return 0 00:03:09.571 14:07:24 -- setup/hugepages.sh@100 -- # resv=0 00:03:09.571 14:07:24 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:09.571 nr_hugepages=1024 00:03:09.571 14:07:24 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:09.571 resv_hugepages=0 00:03:09.571 14:07:24 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:09.571 surplus_hugepages=0 00:03:09.571 14:07:24 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:09.571 anon_hugepages=0 00:03:09.571 14:07:24 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:09.571 14:07:24 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:09.571 14:07:24 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:09.571 14:07:24 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:09.571 14:07:24 -- setup/common.sh@18 -- # local node= 00:03:09.571 14:07:24 -- setup/common.sh@19 -- # local var val 00:03:09.571 14:07:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:09.571 14:07:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:09.571 14:07:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:09.571 14:07:24 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:09.571 14:07:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:09.571 14:07:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77339984 kB' 'MemAvailable: 81082468 kB' 'Buffers: 4136 kB' 'Cached: 10608168 kB' 'SwapCached: 0 kB' 'Active: 7261648 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864240 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483748 kB' 'Mapped: 186256 kB' 'Shmem: 6383780 kB' 'KReclaimable: 220276 kB' 'Slab: 972388 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 752112 kB' 'KernelStack: 19792 kB' 'PageTables: 8316 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8108400 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215340 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.571 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.571 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.572 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.572 14:07:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.832 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.832 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:09.832 14:07:24 -- setup/common.sh@33 -- # echo 1024 00:03:09.832 14:07:24 -- setup/common.sh@33 -- # return 0 00:03:09.832 14:07:24 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:09.832 14:07:24 -- setup/hugepages.sh@112 -- # get_nodes 00:03:09.833 14:07:24 -- setup/hugepages.sh@27 -- # local node 00:03:09.833 14:07:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:09.833 14:07:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:09.833 14:07:24 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:09.833 14:07:24 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:09.833 14:07:24 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:09.833 14:07:24 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:09.833 14:07:24 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:09.833 14:07:24 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:09.833 14:07:24 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:09.833 14:07:24 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:09.833 14:07:24 -- setup/common.sh@18 -- # local node=0 00:03:09.833 14:07:24 -- setup/common.sh@19 -- # local var val 00:03:09.833 14:07:24 -- setup/common.sh@20 -- # local mem_f mem 00:03:09.833 14:07:24 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:09.833 14:07:24 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:09.833 14:07:24 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:09.833 14:07:24 -- setup/common.sh@28 -- # mapfile -t mem 00:03:09.833 14:07:24 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32630596 kB' 'MemFree: 19496488 kB' 'MemUsed: 13134108 kB' 'SwapCached: 0 kB' 'Active: 5842960 kB' 'Inactive: 3740160 kB' 'Active(anon): 5604652 kB' 'Inactive(anon): 0 kB' 'Active(file): 238308 kB' 'Inactive(file): 3740160 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9482092 kB' 'Mapped: 135304 kB' 'AnonPages: 104132 kB' 'Shmem: 5503624 kB' 'KernelStack: 10824 kB' 'PageTables: 4420 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115924 kB' 'Slab: 516728 kB' 'SReclaimable: 115924 kB' 'SUnreclaim: 400804 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.833 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.833 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.834 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.834 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.834 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.834 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.834 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.834 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.834 14:07:24 -- setup/common.sh@32 -- # continue 00:03:09.834 14:07:24 -- setup/common.sh@31 -- # IFS=': ' 00:03:09.834 14:07:24 -- setup/common.sh@31 -- # read -r var val _ 00:03:09.834 14:07:24 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:09.834 14:07:24 -- setup/common.sh@33 -- # echo 0 00:03:09.834 14:07:24 -- setup/common.sh@33 -- # return 0 00:03:09.834 14:07:24 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:09.834 14:07:24 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:09.834 14:07:24 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:09.834 14:07:24 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:09.834 14:07:24 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:09.834 node0=1024 expecting 1024 00:03:09.834 14:07:24 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:09.834 00:03:09.834 real 0m3.998s 00:03:09.834 user 0m1.297s 00:03:09.834 sys 0m1.990s 00:03:09.834 14:07:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:09.834 14:07:24 -- common/autotest_common.sh@10 -- # set +x 00:03:09.834 ************************************ 00:03:09.834 END TEST default_setup 00:03:09.834 ************************************ 00:03:09.834 14:07:24 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:03:09.834 14:07:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:09.834 14:07:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:09.834 14:07:24 -- common/autotest_common.sh@10 -- # set +x 00:03:09.834 ************************************ 00:03:09.834 START TEST per_node_1G_alloc 00:03:09.834 ************************************ 00:03:09.834 14:07:24 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:03:09.834 14:07:24 -- setup/hugepages.sh@143 -- # local IFS=, 00:03:09.834 14:07:24 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:03:09.834 14:07:24 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:09.834 14:07:24 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:03:09.834 14:07:24 -- setup/hugepages.sh@51 -- # shift 00:03:09.834 14:07:24 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:03:09.834 14:07:24 -- setup/hugepages.sh@52 -- # local node_ids 00:03:09.834 14:07:24 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:09.834 14:07:24 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:09.834 14:07:24 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:03:09.834 14:07:24 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:03:09.834 14:07:24 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:09.834 14:07:24 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:09.834 14:07:24 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:09.834 14:07:24 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:09.834 14:07:24 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:09.834 14:07:24 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:03:09.834 14:07:24 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:09.834 14:07:24 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:09.834 14:07:24 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:09.834 14:07:24 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:03:09.834 14:07:24 -- setup/hugepages.sh@73 -- # return 0 00:03:09.834 14:07:24 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:03:09.834 14:07:24 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:03:09.834 14:07:24 -- setup/hugepages.sh@146 -- # setup output 00:03:09.834 14:07:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:09.834 14:07:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:12.373 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:12.373 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:12.373 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:12.373 14:07:26 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:03:12.373 14:07:26 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:03:12.373 14:07:26 -- setup/hugepages.sh@89 -- # local node 00:03:12.373 14:07:26 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:12.373 14:07:26 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:12.373 14:07:26 -- setup/hugepages.sh@92 -- # local surp 00:03:12.373 14:07:26 -- setup/hugepages.sh@93 -- # local resv 00:03:12.374 14:07:26 -- setup/hugepages.sh@94 -- # local anon 00:03:12.374 14:07:26 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:12.374 14:07:26 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:12.374 14:07:26 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:12.374 14:07:26 -- setup/common.sh@18 -- # local node= 00:03:12.374 14:07:26 -- setup/common.sh@19 -- # local var val 00:03:12.374 14:07:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.374 14:07:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.374 14:07:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.374 14:07:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.374 14:07:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.374 14:07:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77331164 kB' 'MemAvailable: 81073648 kB' 'Buffers: 4136 kB' 'Cached: 10608248 kB' 'SwapCached: 0 kB' 'Active: 7261412 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864004 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483440 kB' 'Mapped: 186224 kB' 'Shmem: 6383860 kB' 'KReclaimable: 220276 kB' 'Slab: 972556 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 752280 kB' 'KernelStack: 19664 kB' 'PageTables: 8032 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8105040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215324 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.374 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.374 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:12.375 14:07:26 -- setup/common.sh@33 -- # echo 0 00:03:12.375 14:07:26 -- setup/common.sh@33 -- # return 0 00:03:12.375 14:07:26 -- setup/hugepages.sh@97 -- # anon=0 00:03:12.375 14:07:26 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:12.375 14:07:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:12.375 14:07:26 -- setup/common.sh@18 -- # local node= 00:03:12.375 14:07:26 -- setup/common.sh@19 -- # local var val 00:03:12.375 14:07:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.375 14:07:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.375 14:07:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.375 14:07:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.375 14:07:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.375 14:07:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77335560 kB' 'MemAvailable: 81078044 kB' 'Buffers: 4136 kB' 'Cached: 10608252 kB' 'SwapCached: 0 kB' 'Active: 7260820 kB' 'Inactive: 3831116 kB' 'Active(anon): 6863412 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482972 kB' 'Mapped: 186260 kB' 'Shmem: 6383864 kB' 'KReclaimable: 220276 kB' 'Slab: 972720 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 752444 kB' 'KernelStack: 19632 kB' 'PageTables: 8236 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8107844 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215196 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.375 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.375 14:07:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.376 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.376 14:07:26 -- setup/common.sh@33 -- # echo 0 00:03:12.376 14:07:26 -- setup/common.sh@33 -- # return 0 00:03:12.376 14:07:26 -- setup/hugepages.sh@99 -- # surp=0 00:03:12.376 14:07:26 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:12.376 14:07:26 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:12.376 14:07:26 -- setup/common.sh@18 -- # local node= 00:03:12.376 14:07:26 -- setup/common.sh@19 -- # local var val 00:03:12.376 14:07:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.376 14:07:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.376 14:07:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.376 14:07:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.376 14:07:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.376 14:07:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.376 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77338236 kB' 'MemAvailable: 81080720 kB' 'Buffers: 4136 kB' 'Cached: 10608264 kB' 'SwapCached: 0 kB' 'Active: 7262228 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864820 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484348 kB' 'Mapped: 186764 kB' 'Shmem: 6383876 kB' 'KReclaimable: 220276 kB' 'Slab: 972720 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 752444 kB' 'KernelStack: 19776 kB' 'PageTables: 8304 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8111268 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215324 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.377 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.377 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:12.378 14:07:26 -- setup/common.sh@33 -- # echo 0 00:03:12.378 14:07:26 -- setup/common.sh@33 -- # return 0 00:03:12.378 14:07:26 -- setup/hugepages.sh@100 -- # resv=0 00:03:12.378 14:07:26 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:12.378 nr_hugepages=1024 00:03:12.378 14:07:26 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:12.378 resv_hugepages=0 00:03:12.378 14:07:26 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:12.378 surplus_hugepages=0 00:03:12.378 14:07:26 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:12.378 anon_hugepages=0 00:03:12.378 14:07:26 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:12.378 14:07:26 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:12.378 14:07:26 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:12.378 14:07:26 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:12.378 14:07:26 -- setup/common.sh@18 -- # local node= 00:03:12.378 14:07:26 -- setup/common.sh@19 -- # local var val 00:03:12.378 14:07:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.378 14:07:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.378 14:07:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:12.378 14:07:26 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:12.378 14:07:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.378 14:07:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77333704 kB' 'MemAvailable: 81076188 kB' 'Buffers: 4136 kB' 'Cached: 10608276 kB' 'SwapCached: 0 kB' 'Active: 7267048 kB' 'Inactive: 3831116 kB' 'Active(anon): 6869640 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 489112 kB' 'Mapped: 186764 kB' 'Shmem: 6383888 kB' 'KReclaimable: 220276 kB' 'Slab: 972720 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 752444 kB' 'KernelStack: 19904 kB' 'PageTables: 8932 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8115228 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215376 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.378 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.378 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.379 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.379 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:12.380 14:07:26 -- setup/common.sh@33 -- # echo 1024 00:03:12.380 14:07:26 -- setup/common.sh@33 -- # return 0 00:03:12.380 14:07:26 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:12.380 14:07:26 -- setup/hugepages.sh@112 -- # get_nodes 00:03:12.380 14:07:26 -- setup/hugepages.sh@27 -- # local node 00:03:12.380 14:07:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.380 14:07:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:12.380 14:07:26 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:12.380 14:07:26 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:12.380 14:07:26 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:12.380 14:07:26 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:12.380 14:07:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:12.380 14:07:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:12.380 14:07:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:12.380 14:07:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:12.380 14:07:26 -- setup/common.sh@18 -- # local node=0 00:03:12.380 14:07:26 -- setup/common.sh@19 -- # local var val 00:03:12.380 14:07:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.380 14:07:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.380 14:07:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:12.380 14:07:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:12.380 14:07:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.380 14:07:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32630596 kB' 'MemFree: 20556644 kB' 'MemUsed: 12073952 kB' 'SwapCached: 0 kB' 'Active: 5843024 kB' 'Inactive: 3740160 kB' 'Active(anon): 5604716 kB' 'Inactive(anon): 0 kB' 'Active(file): 238308 kB' 'Inactive(file): 3740160 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9482132 kB' 'Mapped: 136052 kB' 'AnonPages: 104216 kB' 'Shmem: 5503664 kB' 'KernelStack: 10712 kB' 'PageTables: 4268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115924 kB' 'Slab: 516896 kB' 'SReclaimable: 115924 kB' 'SUnreclaim: 400972 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.380 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.380 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@33 -- # echo 0 00:03:12.381 14:07:26 -- setup/common.sh@33 -- # return 0 00:03:12.381 14:07:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:12.381 14:07:26 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:12.381 14:07:26 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:12.381 14:07:26 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:12.381 14:07:26 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:12.381 14:07:26 -- setup/common.sh@18 -- # local node=1 00:03:12.381 14:07:26 -- setup/common.sh@19 -- # local var val 00:03:12.381 14:07:26 -- setup/common.sh@20 -- # local mem_f mem 00:03:12.381 14:07:26 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:12.381 14:07:26 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:12.381 14:07:26 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:12.381 14:07:26 -- setup/common.sh@28 -- # mapfile -t mem 00:03:12.381 14:07:26 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60682300 kB' 'MemFree: 56796348 kB' 'MemUsed: 3885952 kB' 'SwapCached: 0 kB' 'Active: 1418484 kB' 'Inactive: 90956 kB' 'Active(anon): 1259384 kB' 'Inactive(anon): 0 kB' 'Active(file): 159100 kB' 'Inactive(file): 90956 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1130284 kB' 'Mapped: 51104 kB' 'AnonPages: 379360 kB' 'Shmem: 880228 kB' 'KernelStack: 9048 kB' 'PageTables: 4108 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104352 kB' 'Slab: 455824 kB' 'SReclaimable: 104352 kB' 'SUnreclaim: 351472 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.381 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.381 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # continue 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # IFS=': ' 00:03:12.382 14:07:26 -- setup/common.sh@31 -- # read -r var val _ 00:03:12.382 14:07:26 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:12.382 14:07:26 -- setup/common.sh@33 -- # echo 0 00:03:12.382 14:07:26 -- setup/common.sh@33 -- # return 0 00:03:12.382 14:07:26 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:12.382 14:07:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:12.382 14:07:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:12.382 14:07:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:12.382 14:07:26 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:12.382 node0=512 expecting 512 00:03:12.382 14:07:26 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:12.382 14:07:26 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:12.382 14:07:26 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:12.382 14:07:26 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:12.382 node1=512 expecting 512 00:03:12.382 14:07:26 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:12.382 00:03:12.382 real 0m2.524s 00:03:12.382 user 0m0.990s 00:03:12.382 sys 0m1.533s 00:03:12.382 14:07:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:12.382 14:07:26 -- common/autotest_common.sh@10 -- # set +x 00:03:12.382 ************************************ 00:03:12.382 END TEST per_node_1G_alloc 00:03:12.382 ************************************ 00:03:12.382 14:07:26 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:03:12.382 14:07:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:12.382 14:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:12.382 14:07:26 -- common/autotest_common.sh@10 -- # set +x 00:03:12.382 ************************************ 00:03:12.382 START TEST even_2G_alloc 00:03:12.382 ************************************ 00:03:12.382 14:07:26 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:03:12.382 14:07:26 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:03:12.382 14:07:26 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:12.382 14:07:26 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:12.382 14:07:26 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:12.382 14:07:26 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:12.382 14:07:26 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:12.382 14:07:26 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:12.382 14:07:26 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:12.382 14:07:26 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:12.382 14:07:26 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:12.382 14:07:26 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:12.382 14:07:26 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:12.382 14:07:26 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:12.382 14:07:26 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:12.382 14:07:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.382 14:07:26 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:12.382 14:07:26 -- setup/hugepages.sh@83 -- # : 512 00:03:12.382 14:07:26 -- setup/hugepages.sh@84 -- # : 1 00:03:12.382 14:07:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.382 14:07:26 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:12.382 14:07:26 -- setup/hugepages.sh@83 -- # : 0 00:03:12.382 14:07:26 -- setup/hugepages.sh@84 -- # : 0 00:03:12.382 14:07:26 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:12.382 14:07:26 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:03:12.382 14:07:26 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:03:12.382 14:07:26 -- setup/hugepages.sh@153 -- # setup output 00:03:12.382 14:07:26 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:12.382 14:07:26 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:14.922 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:14.922 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:14.922 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:14.922 14:07:29 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:03:14.922 14:07:29 -- setup/hugepages.sh@89 -- # local node 00:03:14.922 14:07:29 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:14.922 14:07:29 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:14.922 14:07:29 -- setup/hugepages.sh@92 -- # local surp 00:03:14.922 14:07:29 -- setup/hugepages.sh@93 -- # local resv 00:03:14.922 14:07:29 -- setup/hugepages.sh@94 -- # local anon 00:03:14.922 14:07:29 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:14.922 14:07:29 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:14.922 14:07:29 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:14.922 14:07:29 -- setup/common.sh@18 -- # local node= 00:03:14.922 14:07:29 -- setup/common.sh@19 -- # local var val 00:03:14.922 14:07:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.922 14:07:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.922 14:07:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.922 14:07:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.922 14:07:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.922 14:07:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.922 14:07:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77373696 kB' 'MemAvailable: 81116180 kB' 'Buffers: 4136 kB' 'Cached: 10608356 kB' 'SwapCached: 0 kB' 'Active: 7261116 kB' 'Inactive: 3831116 kB' 'Active(anon): 6863708 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482436 kB' 'Mapped: 185328 kB' 'Shmem: 6383968 kB' 'KReclaimable: 220276 kB' 'Slab: 972228 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 751952 kB' 'KernelStack: 19808 kB' 'PageTables: 8696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8101548 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215420 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.922 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.922 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:14.923 14:07:29 -- setup/common.sh@33 -- # echo 0 00:03:14.923 14:07:29 -- setup/common.sh@33 -- # return 0 00:03:14.923 14:07:29 -- setup/hugepages.sh@97 -- # anon=0 00:03:14.923 14:07:29 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:14.923 14:07:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.923 14:07:29 -- setup/common.sh@18 -- # local node= 00:03:14.923 14:07:29 -- setup/common.sh@19 -- # local var val 00:03:14.923 14:07:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.923 14:07:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.923 14:07:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.923 14:07:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.923 14:07:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.923 14:07:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.923 14:07:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77381360 kB' 'MemAvailable: 81123844 kB' 'Buffers: 4136 kB' 'Cached: 10608360 kB' 'SwapCached: 0 kB' 'Active: 7261588 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864180 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482976 kB' 'Mapped: 185380 kB' 'Shmem: 6383972 kB' 'KReclaimable: 220276 kB' 'Slab: 972268 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 751992 kB' 'KernelStack: 19712 kB' 'PageTables: 8324 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8103056 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215388 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.923 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.923 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.924 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.924 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.925 14:07:29 -- setup/common.sh@33 -- # echo 0 00:03:14.925 14:07:29 -- setup/common.sh@33 -- # return 0 00:03:14.925 14:07:29 -- setup/hugepages.sh@99 -- # surp=0 00:03:14.925 14:07:29 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:14.925 14:07:29 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:14.925 14:07:29 -- setup/common.sh@18 -- # local node= 00:03:14.925 14:07:29 -- setup/common.sh@19 -- # local var val 00:03:14.925 14:07:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.925 14:07:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.925 14:07:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.925 14:07:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.925 14:07:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.925 14:07:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77381964 kB' 'MemAvailable: 81124448 kB' 'Buffers: 4136 kB' 'Cached: 10608376 kB' 'SwapCached: 0 kB' 'Active: 7261176 kB' 'Inactive: 3831116 kB' 'Active(anon): 6863768 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 482916 kB' 'Mapped: 185304 kB' 'Shmem: 6383988 kB' 'KReclaimable: 220276 kB' 'Slab: 972248 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 751972 kB' 'KernelStack: 19776 kB' 'PageTables: 8516 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8103076 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215420 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.925 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.925 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:14.926 14:07:29 -- setup/common.sh@33 -- # echo 0 00:03:14.926 14:07:29 -- setup/common.sh@33 -- # return 0 00:03:14.926 14:07:29 -- setup/hugepages.sh@100 -- # resv=0 00:03:14.926 14:07:29 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:14.926 nr_hugepages=1024 00:03:14.926 14:07:29 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:14.926 resv_hugepages=0 00:03:14.926 14:07:29 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:14.926 surplus_hugepages=0 00:03:14.926 14:07:29 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:14.926 anon_hugepages=0 00:03:14.926 14:07:29 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:14.926 14:07:29 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:14.926 14:07:29 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:14.926 14:07:29 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:14.926 14:07:29 -- setup/common.sh@18 -- # local node= 00:03:14.926 14:07:29 -- setup/common.sh@19 -- # local var val 00:03:14.926 14:07:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.926 14:07:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.926 14:07:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:14.926 14:07:29 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:14.926 14:07:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.926 14:07:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77380848 kB' 'MemAvailable: 81123332 kB' 'Buffers: 4136 kB' 'Cached: 10608388 kB' 'SwapCached: 0 kB' 'Active: 7261608 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864200 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483376 kB' 'Mapped: 185304 kB' 'Shmem: 6384000 kB' 'KReclaimable: 220276 kB' 'Slab: 972248 kB' 'SReclaimable: 220276 kB' 'SUnreclaim: 751972 kB' 'KernelStack: 19792 kB' 'PageTables: 8708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8103088 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215420 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.926 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.926 14:07:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.927 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.927 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:14.928 14:07:29 -- setup/common.sh@33 -- # echo 1024 00:03:14.928 14:07:29 -- setup/common.sh@33 -- # return 0 00:03:14.928 14:07:29 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:14.928 14:07:29 -- setup/hugepages.sh@112 -- # get_nodes 00:03:14.928 14:07:29 -- setup/hugepages.sh@27 -- # local node 00:03:14.928 14:07:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.928 14:07:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:14.928 14:07:29 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:14.928 14:07:29 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:14.928 14:07:29 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:14.928 14:07:29 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:14.928 14:07:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.928 14:07:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.928 14:07:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:14.928 14:07:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.928 14:07:29 -- setup/common.sh@18 -- # local node=0 00:03:14.928 14:07:29 -- setup/common.sh@19 -- # local var val 00:03:14.928 14:07:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.928 14:07:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.928 14:07:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:14.928 14:07:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:14.928 14:07:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.928 14:07:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32630596 kB' 'MemFree: 20574936 kB' 'MemUsed: 12055660 kB' 'SwapCached: 0 kB' 'Active: 5842600 kB' 'Inactive: 3740160 kB' 'Active(anon): 5604292 kB' 'Inactive(anon): 0 kB' 'Active(file): 238308 kB' 'Inactive(file): 3740160 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9482232 kB' 'Mapped: 135132 kB' 'AnonPages: 103688 kB' 'Shmem: 5503764 kB' 'KernelStack: 10792 kB' 'PageTables: 4504 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115924 kB' 'Slab: 516600 kB' 'SReclaimable: 115924 kB' 'SUnreclaim: 400676 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.928 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.928 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # continue 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:14.929 14:07:29 -- setup/common.sh@33 -- # echo 0 00:03:14.929 14:07:29 -- setup/common.sh@33 -- # return 0 00:03:14.929 14:07:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:14.929 14:07:29 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:14.929 14:07:29 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:14.929 14:07:29 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:14.929 14:07:29 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:14.929 14:07:29 -- setup/common.sh@18 -- # local node=1 00:03:14.929 14:07:29 -- setup/common.sh@19 -- # local var val 00:03:14.929 14:07:29 -- setup/common.sh@20 -- # local mem_f mem 00:03:14.929 14:07:29 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:14.929 14:07:29 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:14.929 14:07:29 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:14.929 14:07:29 -- setup/common.sh@28 -- # mapfile -t mem 00:03:14.929 14:07:29 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:14.929 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:14.929 14:07:29 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60682300 kB' 'MemFree: 56805828 kB' 'MemUsed: 3876472 kB' 'SwapCached: 0 kB' 'Active: 1418260 kB' 'Inactive: 90956 kB' 'Active(anon): 1259160 kB' 'Inactive(anon): 0 kB' 'Active(file): 159100 kB' 'Inactive(file): 90956 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1130308 kB' 'Mapped: 50172 kB' 'AnonPages: 378920 kB' 'Shmem: 880252 kB' 'KernelStack: 8904 kB' 'PageTables: 3692 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104352 kB' 'Slab: 455648 kB' 'SReclaimable: 104352 kB' 'SUnreclaim: 351296 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.189 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.189 14:07:29 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # continue 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # IFS=': ' 00:03:15.190 14:07:29 -- setup/common.sh@31 -- # read -r var val _ 00:03:15.190 14:07:29 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:15.190 14:07:29 -- setup/common.sh@33 -- # echo 0 00:03:15.190 14:07:29 -- setup/common.sh@33 -- # return 0 00:03:15.190 14:07:29 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:15.190 14:07:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.190 14:07:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.190 14:07:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.190 14:07:29 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:15.190 node0=512 expecting 512 00:03:15.190 14:07:29 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:15.190 14:07:29 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:15.190 14:07:29 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:15.190 14:07:29 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:03:15.190 node1=512 expecting 512 00:03:15.190 14:07:29 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:03:15.190 00:03:15.190 real 0m2.737s 00:03:15.190 user 0m1.101s 00:03:15.190 sys 0m1.661s 00:03:15.190 14:07:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:15.190 14:07:29 -- common/autotest_common.sh@10 -- # set +x 00:03:15.190 ************************************ 00:03:15.190 END TEST even_2G_alloc 00:03:15.190 ************************************ 00:03:15.190 14:07:29 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:03:15.190 14:07:29 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:15.190 14:07:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:15.190 14:07:29 -- common/autotest_common.sh@10 -- # set +x 00:03:15.190 ************************************ 00:03:15.190 START TEST odd_alloc 00:03:15.190 ************************************ 00:03:15.190 14:07:29 -- common/autotest_common.sh@1114 -- # odd_alloc 00:03:15.190 14:07:29 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:03:15.190 14:07:29 -- setup/hugepages.sh@49 -- # local size=2098176 00:03:15.190 14:07:29 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:15.190 14:07:29 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:15.190 14:07:29 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:03:15.190 14:07:29 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:15.190 14:07:29 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:15.190 14:07:29 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:15.190 14:07:29 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:03:15.190 14:07:29 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:15.190 14:07:29 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:15.190 14:07:29 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:15.190 14:07:29 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:15.190 14:07:29 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:15.190 14:07:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.190 14:07:29 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:03:15.190 14:07:29 -- setup/hugepages.sh@83 -- # : 513 00:03:15.190 14:07:29 -- setup/hugepages.sh@84 -- # : 1 00:03:15.190 14:07:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.190 14:07:29 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:03:15.190 14:07:29 -- setup/hugepages.sh@83 -- # : 0 00:03:15.190 14:07:29 -- setup/hugepages.sh@84 -- # : 0 00:03:15.190 14:07:29 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:15.190 14:07:29 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:03:15.190 14:07:29 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:03:15.190 14:07:29 -- setup/hugepages.sh@160 -- # setup output 00:03:15.190 14:07:29 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:15.190 14:07:29 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:17.735 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:17.735 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:17.735 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:17.735 14:07:32 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:03:17.735 14:07:32 -- setup/hugepages.sh@89 -- # local node 00:03:17.735 14:07:32 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:17.735 14:07:32 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:17.735 14:07:32 -- setup/hugepages.sh@92 -- # local surp 00:03:17.735 14:07:32 -- setup/hugepages.sh@93 -- # local resv 00:03:17.735 14:07:32 -- setup/hugepages.sh@94 -- # local anon 00:03:17.735 14:07:32 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:17.735 14:07:32 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:17.735 14:07:32 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:17.735 14:07:32 -- setup/common.sh@18 -- # local node= 00:03:17.735 14:07:32 -- setup/common.sh@19 -- # local var val 00:03:17.735 14:07:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.735 14:07:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.735 14:07:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.735 14:07:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.735 14:07:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.735 14:07:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77401888 kB' 'MemAvailable: 81144356 kB' 'Buffers: 4136 kB' 'Cached: 10608476 kB' 'SwapCached: 0 kB' 'Active: 7263084 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865676 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484828 kB' 'Mapped: 185852 kB' 'Shmem: 6384088 kB' 'KReclaimable: 220244 kB' 'Slab: 972520 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752276 kB' 'KernelStack: 19552 kB' 'PageTables: 7924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53995452 kB' 'Committed_AS: 8103180 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215276 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.735 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.735 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:17.736 14:07:32 -- setup/common.sh@33 -- # echo 0 00:03:17.736 14:07:32 -- setup/common.sh@33 -- # return 0 00:03:17.736 14:07:32 -- setup/hugepages.sh@97 -- # anon=0 00:03:17.736 14:07:32 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:17.736 14:07:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.736 14:07:32 -- setup/common.sh@18 -- # local node= 00:03:17.736 14:07:32 -- setup/common.sh@19 -- # local var val 00:03:17.736 14:07:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.736 14:07:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.736 14:07:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.736 14:07:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.736 14:07:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.736 14:07:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.736 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.736 14:07:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77396716 kB' 'MemAvailable: 81139184 kB' 'Buffers: 4136 kB' 'Cached: 10608480 kB' 'SwapCached: 0 kB' 'Active: 7267672 kB' 'Inactive: 3831116 kB' 'Active(anon): 6870264 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 490100 kB' 'Mapped: 185836 kB' 'Shmem: 6384092 kB' 'KReclaimable: 220244 kB' 'Slab: 972508 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752264 kB' 'KernelStack: 19728 kB' 'PageTables: 8308 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53995452 kB' 'Committed_AS: 8109824 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215296 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.736 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.737 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.737 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.738 14:07:32 -- setup/common.sh@33 -- # echo 0 00:03:17.738 14:07:32 -- setup/common.sh@33 -- # return 0 00:03:17.738 14:07:32 -- setup/hugepages.sh@99 -- # surp=0 00:03:17.738 14:07:32 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:17.738 14:07:32 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:17.738 14:07:32 -- setup/common.sh@18 -- # local node= 00:03:17.738 14:07:32 -- setup/common.sh@19 -- # local var val 00:03:17.738 14:07:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.738 14:07:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.738 14:07:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.738 14:07:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.738 14:07:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.738 14:07:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77401016 kB' 'MemAvailable: 81143484 kB' 'Buffers: 4136 kB' 'Cached: 10608488 kB' 'SwapCached: 0 kB' 'Active: 7262588 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865180 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484488 kB' 'Mapped: 185728 kB' 'Shmem: 6384100 kB' 'KReclaimable: 220244 kB' 'Slab: 972508 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752264 kB' 'KernelStack: 19712 kB' 'PageTables: 8120 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53995452 kB' 'Committed_AS: 8103108 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215308 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.738 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.738 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.739 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:17.739 14:07:32 -- setup/common.sh@33 -- # echo 0 00:03:17.739 14:07:32 -- setup/common.sh@33 -- # return 0 00:03:17.739 14:07:32 -- setup/hugepages.sh@100 -- # resv=0 00:03:17.739 14:07:32 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:03:17.739 nr_hugepages=1025 00:03:17.739 14:07:32 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:17.739 resv_hugepages=0 00:03:17.739 14:07:32 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:17.739 surplus_hugepages=0 00:03:17.739 14:07:32 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:17.739 anon_hugepages=0 00:03:17.739 14:07:32 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:17.739 14:07:32 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:03:17.739 14:07:32 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:17.739 14:07:32 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:17.739 14:07:32 -- setup/common.sh@18 -- # local node= 00:03:17.739 14:07:32 -- setup/common.sh@19 -- # local var val 00:03:17.739 14:07:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.739 14:07:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.739 14:07:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:17.739 14:07:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:17.739 14:07:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.739 14:07:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.739 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77399292 kB' 'MemAvailable: 81141760 kB' 'Buffers: 4136 kB' 'Cached: 10608504 kB' 'SwapCached: 0 kB' 'Active: 7262216 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864808 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484104 kB' 'Mapped: 185316 kB' 'Shmem: 6384116 kB' 'KReclaimable: 220244 kB' 'Slab: 972648 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752404 kB' 'KernelStack: 19840 kB' 'PageTables: 8608 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53995452 kB' 'Committed_AS: 8102236 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215292 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.740 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.740 14:07:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:17.741 14:07:32 -- setup/common.sh@33 -- # echo 1025 00:03:17.741 14:07:32 -- setup/common.sh@33 -- # return 0 00:03:17.741 14:07:32 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:03:17.741 14:07:32 -- setup/hugepages.sh@112 -- # get_nodes 00:03:17.741 14:07:32 -- setup/hugepages.sh@27 -- # local node 00:03:17.741 14:07:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.741 14:07:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:17.741 14:07:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:17.741 14:07:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:03:17.741 14:07:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:17.741 14:07:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:17.741 14:07:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.741 14:07:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.741 14:07:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:17.741 14:07:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.741 14:07:32 -- setup/common.sh@18 -- # local node=0 00:03:17.741 14:07:32 -- setup/common.sh@19 -- # local var val 00:03:17.741 14:07:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.741 14:07:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.741 14:07:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:17.741 14:07:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:17.741 14:07:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.741 14:07:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32630596 kB' 'MemFree: 20581496 kB' 'MemUsed: 12049100 kB' 'SwapCached: 0 kB' 'Active: 5842288 kB' 'Inactive: 3740160 kB' 'Active(anon): 5603980 kB' 'Inactive(anon): 0 kB' 'Active(file): 238308 kB' 'Inactive(file): 3740160 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9482312 kB' 'Mapped: 135144 kB' 'AnonPages: 103284 kB' 'Shmem: 5503844 kB' 'KernelStack: 10680 kB' 'PageTables: 4052 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115892 kB' 'Slab: 516744 kB' 'SReclaimable: 115892 kB' 'SUnreclaim: 400852 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.741 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.741 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@33 -- # echo 0 00:03:17.742 14:07:32 -- setup/common.sh@33 -- # return 0 00:03:17.742 14:07:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.742 14:07:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:17.742 14:07:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:17.742 14:07:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:17.742 14:07:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:17.742 14:07:32 -- setup/common.sh@18 -- # local node=1 00:03:17.742 14:07:32 -- setup/common.sh@19 -- # local var val 00:03:17.742 14:07:32 -- setup/common.sh@20 -- # local mem_f mem 00:03:17.742 14:07:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:17.742 14:07:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:17.742 14:07:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:17.742 14:07:32 -- setup/common.sh@28 -- # mapfile -t mem 00:03:17.742 14:07:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60682300 kB' 'MemFree: 56815168 kB' 'MemUsed: 3867132 kB' 'SwapCached: 0 kB' 'Active: 1420336 kB' 'Inactive: 90956 kB' 'Active(anon): 1261236 kB' 'Inactive(anon): 0 kB' 'Active(file): 159100 kB' 'Inactive(file): 90956 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1130344 kB' 'Mapped: 50172 kB' 'AnonPages: 381184 kB' 'Shmem: 880288 kB' 'KernelStack: 9144 kB' 'PageTables: 4740 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104352 kB' 'Slab: 455904 kB' 'SReclaimable: 104352 kB' 'SUnreclaim: 351552 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.742 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.742 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # continue 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # IFS=': ' 00:03:17.743 14:07:32 -- setup/common.sh@31 -- # read -r var val _ 00:03:17.743 14:07:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:17.743 14:07:32 -- setup/common.sh@33 -- # echo 0 00:03:17.743 14:07:32 -- setup/common.sh@33 -- # return 0 00:03:17.743 14:07:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.743 14:07:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.743 14:07:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.743 14:07:32 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:03:17.743 node0=512 expecting 513 00:03:17.743 14:07:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:17.743 14:07:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:17.743 14:07:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:17.743 14:07:32 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:03:17.743 node1=513 expecting 512 00:03:17.743 14:07:32 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:03:17.743 00:03:17.743 real 0m2.645s 00:03:17.743 user 0m1.017s 00:03:17.743 sys 0m1.666s 00:03:17.743 14:07:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:17.743 14:07:32 -- common/autotest_common.sh@10 -- # set +x 00:03:17.743 ************************************ 00:03:17.743 END TEST odd_alloc 00:03:17.743 ************************************ 00:03:17.743 14:07:32 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:03:17.743 14:07:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:17.743 14:07:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:17.743 14:07:32 -- common/autotest_common.sh@10 -- # set +x 00:03:17.743 ************************************ 00:03:17.743 START TEST custom_alloc 00:03:17.743 ************************************ 00:03:17.743 14:07:32 -- common/autotest_common.sh@1114 -- # custom_alloc 00:03:17.743 14:07:32 -- setup/hugepages.sh@167 -- # local IFS=, 00:03:17.743 14:07:32 -- setup/hugepages.sh@169 -- # local node 00:03:17.743 14:07:32 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:03:17.743 14:07:32 -- setup/hugepages.sh@170 -- # local nodes_hp 00:03:17.743 14:07:32 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:03:17.743 14:07:32 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:03:17.743 14:07:32 -- setup/hugepages.sh@49 -- # local size=1048576 00:03:17.743 14:07:32 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:03:17.743 14:07:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:17.743 14:07:32 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:17.743 14:07:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.743 14:07:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:03:17.743 14:07:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.743 14:07:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.743 14:07:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.743 14:07:32 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:17.743 14:07:32 -- setup/hugepages.sh@83 -- # : 256 00:03:17.743 14:07:32 -- setup/hugepages.sh@84 -- # : 1 00:03:17.743 14:07:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:03:17.743 14:07:32 -- setup/hugepages.sh@83 -- # : 0 00:03:17.743 14:07:32 -- setup/hugepages.sh@84 -- # : 0 00:03:17.743 14:07:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:03:17.743 14:07:32 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:03:17.743 14:07:32 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:17.743 14:07:32 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:17.743 14:07:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:17.743 14:07:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:03:17.743 14:07:32 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:17.743 14:07:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.743 14:07:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:17.744 14:07:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.744 14:07:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.744 14:07:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.744 14:07:32 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:17.744 14:07:32 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:03:17.744 14:07:32 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:17.744 14:07:32 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:17.744 14:07:32 -- setup/hugepages.sh@78 -- # return 0 00:03:17.744 14:07:32 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:03:17.744 14:07:32 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:17.744 14:07:32 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:17.744 14:07:32 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:17.744 14:07:32 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:03:17.744 14:07:32 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:03:17.744 14:07:32 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:03:17.744 14:07:32 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:03:17.744 14:07:32 -- setup/hugepages.sh@62 -- # user_nodes=() 00:03:17.744 14:07:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:17.744 14:07:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:17.744 14:07:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:17.744 14:07:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:17.744 14:07:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:17.744 14:07:32 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:03:17.744 14:07:32 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:03:17.744 14:07:32 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:17.744 14:07:32 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:03:17.744 14:07:32 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:03:17.744 14:07:32 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:03:17.744 14:07:32 -- setup/hugepages.sh@78 -- # return 0 00:03:17.744 14:07:32 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:03:17.744 14:07:32 -- setup/hugepages.sh@187 -- # setup output 00:03:17.744 14:07:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:17.744 14:07:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:20.280 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:20.280 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:20.280 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:20.543 14:07:34 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:03:20.543 14:07:34 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:03:20.543 14:07:34 -- setup/hugepages.sh@89 -- # local node 00:03:20.543 14:07:34 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:20.543 14:07:34 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:20.543 14:07:34 -- setup/hugepages.sh@92 -- # local surp 00:03:20.543 14:07:34 -- setup/hugepages.sh@93 -- # local resv 00:03:20.543 14:07:34 -- setup/hugepages.sh@94 -- # local anon 00:03:20.543 14:07:34 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:20.543 14:07:34 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:20.543 14:07:34 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:20.543 14:07:34 -- setup/common.sh@18 -- # local node= 00:03:20.543 14:07:34 -- setup/common.sh@19 -- # local var val 00:03:20.543 14:07:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.543 14:07:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.543 14:07:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.543 14:07:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.543 14:07:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.543 14:07:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 76332052 kB' 'MemAvailable: 80074828 kB' 'Buffers: 4136 kB' 'Cached: 10608600 kB' 'SwapCached: 0 kB' 'Active: 7262984 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865576 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484608 kB' 'Mapped: 185340 kB' 'Shmem: 6384212 kB' 'KReclaimable: 220244 kB' 'Slab: 973016 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752772 kB' 'KernelStack: 19712 kB' 'PageTables: 8572 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53472188 kB' 'Committed_AS: 8102584 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215356 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.543 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.543 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:20.544 14:07:34 -- setup/common.sh@33 -- # echo 0 00:03:20.544 14:07:34 -- setup/common.sh@33 -- # return 0 00:03:20.544 14:07:34 -- setup/hugepages.sh@97 -- # anon=0 00:03:20.544 14:07:34 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:20.544 14:07:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.544 14:07:34 -- setup/common.sh@18 -- # local node= 00:03:20.544 14:07:34 -- setup/common.sh@19 -- # local var val 00:03:20.544 14:07:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.544 14:07:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.544 14:07:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.544 14:07:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.544 14:07:34 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.544 14:07:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 76335424 kB' 'MemAvailable: 80077892 kB' 'Buffers: 4136 kB' 'Cached: 10608600 kB' 'SwapCached: 0 kB' 'Active: 7263556 kB' 'Inactive: 3831116 kB' 'Active(anon): 6866148 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484952 kB' 'Mapped: 185324 kB' 'Shmem: 6384212 kB' 'KReclaimable: 220244 kB' 'Slab: 973024 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752780 kB' 'KernelStack: 19728 kB' 'PageTables: 8424 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53472188 kB' 'Committed_AS: 8104104 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215436 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.544 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.544 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:34 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.545 14:07:34 -- setup/common.sh@33 -- # echo 0 00:03:20.545 14:07:34 -- setup/common.sh@33 -- # return 0 00:03:20.545 14:07:34 -- setup/hugepages.sh@99 -- # surp=0 00:03:20.545 14:07:34 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:20.545 14:07:34 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:20.545 14:07:34 -- setup/common.sh@18 -- # local node= 00:03:20.545 14:07:34 -- setup/common.sh@19 -- # local var val 00:03:20.545 14:07:34 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.545 14:07:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.545 14:07:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.545 14:07:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.545 14:07:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.545 14:07:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 76335520 kB' 'MemAvailable: 80077988 kB' 'Buffers: 4136 kB' 'Cached: 10608616 kB' 'SwapCached: 0 kB' 'Active: 7262712 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865304 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484300 kB' 'Mapped: 185324 kB' 'Shmem: 6384228 kB' 'KReclaimable: 220244 kB' 'Slab: 973004 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752760 kB' 'KernelStack: 19696 kB' 'PageTables: 8268 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53472188 kB' 'Committed_AS: 8104120 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215420 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.545 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.545 14:07:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.546 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.546 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:20.547 14:07:35 -- setup/common.sh@33 -- # echo 0 00:03:20.547 14:07:35 -- setup/common.sh@33 -- # return 0 00:03:20.547 14:07:35 -- setup/hugepages.sh@100 -- # resv=0 00:03:20.547 14:07:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:03:20.547 nr_hugepages=1536 00:03:20.547 14:07:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:20.547 resv_hugepages=0 00:03:20.547 14:07:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:20.547 surplus_hugepages=0 00:03:20.547 14:07:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:20.547 anon_hugepages=0 00:03:20.547 14:07:35 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:20.547 14:07:35 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:03:20.547 14:07:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:20.547 14:07:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:20.547 14:07:35 -- setup/common.sh@18 -- # local node= 00:03:20.547 14:07:35 -- setup/common.sh@19 -- # local var val 00:03:20.547 14:07:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.547 14:07:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.547 14:07:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:20.547 14:07:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:20.547 14:07:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.547 14:07:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 76335032 kB' 'MemAvailable: 80077500 kB' 'Buffers: 4136 kB' 'Cached: 10608628 kB' 'SwapCached: 0 kB' 'Active: 7262804 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865396 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484392 kB' 'Mapped: 185324 kB' 'Shmem: 6384240 kB' 'KReclaimable: 220244 kB' 'Slab: 973004 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752760 kB' 'KernelStack: 19696 kB' 'PageTables: 8220 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53472188 kB' 'Committed_AS: 8104132 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215420 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.547 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.547 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:20.548 14:07:35 -- setup/common.sh@33 -- # echo 1536 00:03:20.548 14:07:35 -- setup/common.sh@33 -- # return 0 00:03:20.548 14:07:35 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:03:20.548 14:07:35 -- setup/hugepages.sh@112 -- # get_nodes 00:03:20.548 14:07:35 -- setup/hugepages.sh@27 -- # local node 00:03:20.548 14:07:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.548 14:07:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:03:20.548 14:07:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:20.548 14:07:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:20.548 14:07:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:20.548 14:07:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:20.548 14:07:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.548 14:07:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.548 14:07:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:20.548 14:07:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.548 14:07:35 -- setup/common.sh@18 -- # local node=0 00:03:20.548 14:07:35 -- setup/common.sh@19 -- # local var val 00:03:20.548 14:07:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.548 14:07:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.548 14:07:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:20.548 14:07:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:20.548 14:07:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.548 14:07:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32630596 kB' 'MemFree: 20571388 kB' 'MemUsed: 12059208 kB' 'SwapCached: 0 kB' 'Active: 5843156 kB' 'Inactive: 3740160 kB' 'Active(anon): 5604848 kB' 'Inactive(anon): 0 kB' 'Active(file): 238308 kB' 'Inactive(file): 3740160 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9482404 kB' 'Mapped: 135152 kB' 'AnonPages: 104096 kB' 'Shmem: 5503936 kB' 'KernelStack: 10712 kB' 'PageTables: 4208 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115892 kB' 'Slab: 517144 kB' 'SReclaimable: 115892 kB' 'SUnreclaim: 401252 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.548 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.548 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@33 -- # echo 0 00:03:20.549 14:07:35 -- setup/common.sh@33 -- # return 0 00:03:20.549 14:07:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.549 14:07:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:20.549 14:07:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:20.549 14:07:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:03:20.549 14:07:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:20.549 14:07:35 -- setup/common.sh@18 -- # local node=1 00:03:20.549 14:07:35 -- setup/common.sh@19 -- # local var val 00:03:20.549 14:07:35 -- setup/common.sh@20 -- # local mem_f mem 00:03:20.549 14:07:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:20.549 14:07:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:03:20.549 14:07:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:03:20.549 14:07:35 -- setup/common.sh@28 -- # mapfile -t mem 00:03:20.549 14:07:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60682300 kB' 'MemFree: 55762492 kB' 'MemUsed: 4919808 kB' 'SwapCached: 0 kB' 'Active: 1419596 kB' 'Inactive: 90956 kB' 'Active(anon): 1260496 kB' 'Inactive(anon): 0 kB' 'Active(file): 159100 kB' 'Inactive(file): 90956 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 1130376 kB' 'Mapped: 50172 kB' 'AnonPages: 380232 kB' 'Shmem: 880320 kB' 'KernelStack: 8840 kB' 'PageTables: 3716 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 104352 kB' 'Slab: 455860 kB' 'SReclaimable: 104352 kB' 'SUnreclaim: 351508 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.549 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.549 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.808 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.808 14:07:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # continue 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # IFS=': ' 00:03:20.809 14:07:35 -- setup/common.sh@31 -- # read -r var val _ 00:03:20.809 14:07:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:20.809 14:07:35 -- setup/common.sh@33 -- # echo 0 00:03:20.809 14:07:35 -- setup/common.sh@33 -- # return 0 00:03:20.809 14:07:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:20.809 14:07:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.809 14:07:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.809 14:07:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.809 14:07:35 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:03:20.809 node0=512 expecting 512 00:03:20.809 14:07:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:20.809 14:07:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:20.809 14:07:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:20.809 14:07:35 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:03:20.809 node1=1024 expecting 1024 00:03:20.809 14:07:35 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:03:20.809 00:03:20.809 real 0m2.904s 00:03:20.809 user 0m1.204s 00:03:20.809 sys 0m1.772s 00:03:20.809 14:07:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:20.809 14:07:35 -- common/autotest_common.sh@10 -- # set +x 00:03:20.809 ************************************ 00:03:20.809 END TEST custom_alloc 00:03:20.809 ************************************ 00:03:20.809 14:07:35 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:03:20.809 14:07:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:20.809 14:07:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:20.809 14:07:35 -- common/autotest_common.sh@10 -- # set +x 00:03:20.809 ************************************ 00:03:20.809 START TEST no_shrink_alloc 00:03:20.809 ************************************ 00:03:20.809 14:07:35 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:03:20.809 14:07:35 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:03:20.809 14:07:35 -- setup/hugepages.sh@49 -- # local size=2097152 00:03:20.809 14:07:35 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:03:20.809 14:07:35 -- setup/hugepages.sh@51 -- # shift 00:03:20.809 14:07:35 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:03:20.809 14:07:35 -- setup/hugepages.sh@52 -- # local node_ids 00:03:20.809 14:07:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:03:20.809 14:07:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:03:20.809 14:07:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:03:20.809 14:07:35 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:03:20.809 14:07:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:03:20.809 14:07:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:03:20.809 14:07:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:03:20.809 14:07:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:03:20.809 14:07:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:03:20.809 14:07:35 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:03:20.809 14:07:35 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:03:20.809 14:07:35 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:03:20.809 14:07:35 -- setup/hugepages.sh@73 -- # return 0 00:03:20.809 14:07:35 -- setup/hugepages.sh@198 -- # setup output 00:03:20.809 14:07:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:20.809 14:07:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:23.347 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:23.347 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:23.347 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:23.347 14:07:37 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:03:23.347 14:07:37 -- setup/hugepages.sh@89 -- # local node 00:03:23.347 14:07:37 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:23.347 14:07:37 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:23.347 14:07:37 -- setup/hugepages.sh@92 -- # local surp 00:03:23.347 14:07:37 -- setup/hugepages.sh@93 -- # local resv 00:03:23.347 14:07:37 -- setup/hugepages.sh@94 -- # local anon 00:03:23.347 14:07:37 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:23.347 14:07:37 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:23.347 14:07:37 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:23.347 14:07:37 -- setup/common.sh@18 -- # local node= 00:03:23.347 14:07:37 -- setup/common.sh@19 -- # local var val 00:03:23.347 14:07:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.347 14:07:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.347 14:07:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.347 14:07:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.347 14:07:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.347 14:07:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77390828 kB' 'MemAvailable: 81133296 kB' 'Buffers: 4136 kB' 'Cached: 10608720 kB' 'SwapCached: 0 kB' 'Active: 7263028 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865620 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484564 kB' 'Mapped: 185480 kB' 'Shmem: 6384332 kB' 'KReclaimable: 220244 kB' 'Slab: 972576 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752332 kB' 'KernelStack: 19584 kB' 'PageTables: 8152 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8100328 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215276 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.347 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.347 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:23.348 14:07:37 -- setup/common.sh@33 -- # echo 0 00:03:23.348 14:07:37 -- setup/common.sh@33 -- # return 0 00:03:23.348 14:07:37 -- setup/hugepages.sh@97 -- # anon=0 00:03:23.348 14:07:37 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:23.348 14:07:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.348 14:07:37 -- setup/common.sh@18 -- # local node= 00:03:23.348 14:07:37 -- setup/common.sh@19 -- # local var val 00:03:23.348 14:07:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.348 14:07:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.348 14:07:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.348 14:07:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.348 14:07:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.348 14:07:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77392028 kB' 'MemAvailable: 81134496 kB' 'Buffers: 4136 kB' 'Cached: 10608724 kB' 'SwapCached: 0 kB' 'Active: 7262392 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864984 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483916 kB' 'Mapped: 185332 kB' 'Shmem: 6384336 kB' 'KReclaimable: 220244 kB' 'Slab: 972528 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752284 kB' 'KernelStack: 19552 kB' 'PageTables: 8004 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8100340 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215260 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.348 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.348 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.610 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.610 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.611 14:07:37 -- setup/common.sh@33 -- # echo 0 00:03:23.611 14:07:37 -- setup/common.sh@33 -- # return 0 00:03:23.611 14:07:37 -- setup/hugepages.sh@99 -- # surp=0 00:03:23.611 14:07:37 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:23.611 14:07:37 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:23.611 14:07:37 -- setup/common.sh@18 -- # local node= 00:03:23.611 14:07:37 -- setup/common.sh@19 -- # local var val 00:03:23.611 14:07:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.611 14:07:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.611 14:07:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.611 14:07:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.611 14:07:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.611 14:07:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77392872 kB' 'MemAvailable: 81135340 kB' 'Buffers: 4136 kB' 'Cached: 10608736 kB' 'SwapCached: 0 kB' 'Active: 7262616 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865208 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484120 kB' 'Mapped: 185332 kB' 'Shmem: 6384348 kB' 'KReclaimable: 220244 kB' 'Slab: 972528 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752284 kB' 'KernelStack: 19552 kB' 'PageTables: 8008 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8100356 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215244 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.611 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.611 14:07:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.612 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.612 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:23.613 14:07:37 -- setup/common.sh@33 -- # echo 0 00:03:23.613 14:07:37 -- setup/common.sh@33 -- # return 0 00:03:23.613 14:07:37 -- setup/hugepages.sh@100 -- # resv=0 00:03:23.613 14:07:37 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:23.613 nr_hugepages=1024 00:03:23.613 14:07:37 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:23.613 resv_hugepages=0 00:03:23.613 14:07:37 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:23.613 surplus_hugepages=0 00:03:23.613 14:07:37 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:23.613 anon_hugepages=0 00:03:23.613 14:07:37 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.613 14:07:37 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:23.613 14:07:37 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:23.613 14:07:37 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:23.613 14:07:37 -- setup/common.sh@18 -- # local node= 00:03:23.613 14:07:37 -- setup/common.sh@19 -- # local var val 00:03:23.613 14:07:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.613 14:07:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.613 14:07:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:23.613 14:07:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:23.613 14:07:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.613 14:07:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77393252 kB' 'MemAvailable: 81135720 kB' 'Buffers: 4136 kB' 'Cached: 10608748 kB' 'SwapCached: 0 kB' 'Active: 7262564 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865156 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484080 kB' 'Mapped: 185332 kB' 'Shmem: 6384360 kB' 'KReclaimable: 220244 kB' 'Slab: 972528 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752284 kB' 'KernelStack: 19536 kB' 'PageTables: 7960 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8100372 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215260 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.613 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.613 14:07:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:23.614 14:07:37 -- setup/common.sh@33 -- # echo 1024 00:03:23.614 14:07:37 -- setup/common.sh@33 -- # return 0 00:03:23.614 14:07:37 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:23.614 14:07:37 -- setup/hugepages.sh@112 -- # get_nodes 00:03:23.614 14:07:37 -- setup/hugepages.sh@27 -- # local node 00:03:23.614 14:07:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.614 14:07:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:23.614 14:07:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:23.614 14:07:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:23.614 14:07:37 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:23.614 14:07:37 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:23.614 14:07:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:23.614 14:07:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:23.614 14:07:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:23.614 14:07:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:23.614 14:07:37 -- setup/common.sh@18 -- # local node=0 00:03:23.614 14:07:37 -- setup/common.sh@19 -- # local var val 00:03:23.614 14:07:37 -- setup/common.sh@20 -- # local mem_f mem 00:03:23.614 14:07:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:23.614 14:07:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:23.614 14:07:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:23.614 14:07:37 -- setup/common.sh@28 -- # mapfile -t mem 00:03:23.614 14:07:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32630596 kB' 'MemFree: 19536804 kB' 'MemUsed: 13093792 kB' 'SwapCached: 0 kB' 'Active: 5842428 kB' 'Inactive: 3740160 kB' 'Active(anon): 5604120 kB' 'Inactive(anon): 0 kB' 'Active(file): 238308 kB' 'Inactive(file): 3740160 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9482480 kB' 'Mapped: 135160 kB' 'AnonPages: 103244 kB' 'Shmem: 5504012 kB' 'KernelStack: 10680 kB' 'PageTables: 4100 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115892 kB' 'Slab: 516312 kB' 'SReclaimable: 115892 kB' 'SUnreclaim: 400420 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.614 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.614 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:37 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:37 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # continue 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # IFS=': ' 00:03:23.615 14:07:38 -- setup/common.sh@31 -- # read -r var val _ 00:03:23.615 14:07:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:23.615 14:07:38 -- setup/common.sh@33 -- # echo 0 00:03:23.615 14:07:38 -- setup/common.sh@33 -- # return 0 00:03:23.615 14:07:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:23.615 14:07:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:23.615 14:07:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:23.615 14:07:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:23.615 14:07:38 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:23.615 node0=1024 expecting 1024 00:03:23.615 14:07:38 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:23.615 14:07:38 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:03:23.615 14:07:38 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:03:23.615 14:07:38 -- setup/hugepages.sh@202 -- # setup output 00:03:23.615 14:07:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:23.615 14:07:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:03:26.150 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:03:26.150 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:03:26.150 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:03:26.150 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:03:26.411 14:07:40 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:03:26.411 14:07:40 -- setup/hugepages.sh@89 -- # local node 00:03:26.411 14:07:40 -- setup/hugepages.sh@90 -- # local sorted_t 00:03:26.411 14:07:40 -- setup/hugepages.sh@91 -- # local sorted_s 00:03:26.411 14:07:40 -- setup/hugepages.sh@92 -- # local surp 00:03:26.411 14:07:40 -- setup/hugepages.sh@93 -- # local resv 00:03:26.411 14:07:40 -- setup/hugepages.sh@94 -- # local anon 00:03:26.411 14:07:40 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:03:26.411 14:07:40 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:03:26.411 14:07:40 -- setup/common.sh@17 -- # local get=AnonHugePages 00:03:26.411 14:07:40 -- setup/common.sh@18 -- # local node= 00:03:26.411 14:07:40 -- setup/common.sh@19 -- # local var val 00:03:26.411 14:07:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.411 14:07:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.411 14:07:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.411 14:07:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.411 14:07:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.411 14:07:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.411 14:07:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77389656 kB' 'MemAvailable: 81132124 kB' 'Buffers: 4136 kB' 'Cached: 10608816 kB' 'SwapCached: 0 kB' 'Active: 7262476 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865068 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 484000 kB' 'Mapped: 185380 kB' 'Shmem: 6384428 kB' 'KReclaimable: 220244 kB' 'Slab: 972368 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752124 kB' 'KernelStack: 19536 kB' 'PageTables: 7972 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8100812 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215292 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.411 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.411 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:03:26.412 14:07:40 -- setup/common.sh@33 -- # echo 0 00:03:26.412 14:07:40 -- setup/common.sh@33 -- # return 0 00:03:26.412 14:07:40 -- setup/hugepages.sh@97 -- # anon=0 00:03:26.412 14:07:40 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:03:26.412 14:07:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.412 14:07:40 -- setup/common.sh@18 -- # local node= 00:03:26.412 14:07:40 -- setup/common.sh@19 -- # local var val 00:03:26.412 14:07:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.412 14:07:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.412 14:07:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.412 14:07:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.412 14:07:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.412 14:07:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77391252 kB' 'MemAvailable: 81133720 kB' 'Buffers: 4136 kB' 'Cached: 10608820 kB' 'SwapCached: 0 kB' 'Active: 7262464 kB' 'Inactive: 3831116 kB' 'Active(anon): 6865056 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483956 kB' 'Mapped: 185424 kB' 'Shmem: 6384432 kB' 'KReclaimable: 220244 kB' 'Slab: 972432 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752188 kB' 'KernelStack: 19520 kB' 'PageTables: 7932 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8100824 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215260 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.412 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.412 14:07:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.413 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.413 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.414 14:07:40 -- setup/common.sh@33 -- # echo 0 00:03:26.414 14:07:40 -- setup/common.sh@33 -- # return 0 00:03:26.414 14:07:40 -- setup/hugepages.sh@99 -- # surp=0 00:03:26.414 14:07:40 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:03:26.414 14:07:40 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:03:26.414 14:07:40 -- setup/common.sh@18 -- # local node= 00:03:26.414 14:07:40 -- setup/common.sh@19 -- # local var val 00:03:26.414 14:07:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.414 14:07:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.414 14:07:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.414 14:07:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.414 14:07:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.414 14:07:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77391292 kB' 'MemAvailable: 81133760 kB' 'Buffers: 4136 kB' 'Cached: 10608832 kB' 'SwapCached: 0 kB' 'Active: 7262212 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864804 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483712 kB' 'Mapped: 185424 kB' 'Shmem: 6384444 kB' 'KReclaimable: 220244 kB' 'Slab: 972356 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752112 kB' 'KernelStack: 19472 kB' 'PageTables: 7772 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8100840 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215260 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.414 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.414 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:03:26.415 14:07:40 -- setup/common.sh@33 -- # echo 0 00:03:26.415 14:07:40 -- setup/common.sh@33 -- # return 0 00:03:26.415 14:07:40 -- setup/hugepages.sh@100 -- # resv=0 00:03:26.415 14:07:40 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:03:26.415 nr_hugepages=1024 00:03:26.415 14:07:40 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:03:26.415 resv_hugepages=0 00:03:26.415 14:07:40 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:03:26.415 surplus_hugepages=0 00:03:26.415 14:07:40 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:03:26.415 anon_hugepages=0 00:03:26.415 14:07:40 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.415 14:07:40 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:03:26.415 14:07:40 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:03:26.415 14:07:40 -- setup/common.sh@17 -- # local get=HugePages_Total 00:03:26.415 14:07:40 -- setup/common.sh@18 -- # local node= 00:03:26.415 14:07:40 -- setup/common.sh@19 -- # local var val 00:03:26.415 14:07:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.415 14:07:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.415 14:07:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:03:26.415 14:07:40 -- setup/common.sh@25 -- # [[ -n '' ]] 00:03:26.415 14:07:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.415 14:07:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 93312896 kB' 'MemFree: 77392080 kB' 'MemAvailable: 81134548 kB' 'Buffers: 4136 kB' 'Cached: 10608844 kB' 'SwapCached: 0 kB' 'Active: 7261844 kB' 'Inactive: 3831116 kB' 'Active(anon): 6864436 kB' 'Inactive(anon): 0 kB' 'Active(file): 397408 kB' 'Inactive(file): 3831116 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 483324 kB' 'Mapped: 185340 kB' 'Shmem: 6384456 kB' 'KReclaimable: 220244 kB' 'Slab: 972324 kB' 'SReclaimable: 220244 kB' 'SUnreclaim: 752080 kB' 'KernelStack: 19552 kB' 'PageTables: 8004 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 53996476 kB' 'Committed_AS: 8100856 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 215260 kB' 'VmallocChunk: 0 kB' 'Percpu: 66816 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 2720724 kB' 'DirectMap2M: 11638784 kB' 'DirectMap1G: 89128960 kB' 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.415 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.415 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.416 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.416 14:07:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:03:26.417 14:07:40 -- setup/common.sh@33 -- # echo 1024 00:03:26.417 14:07:40 -- setup/common.sh@33 -- # return 0 00:03:26.417 14:07:40 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:03:26.417 14:07:40 -- setup/hugepages.sh@112 -- # get_nodes 00:03:26.417 14:07:40 -- setup/hugepages.sh@27 -- # local node 00:03:26.417 14:07:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.417 14:07:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:03:26.417 14:07:40 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:03:26.417 14:07:40 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:03:26.417 14:07:40 -- setup/hugepages.sh@32 -- # no_nodes=2 00:03:26.417 14:07:40 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:03:26.417 14:07:40 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:03:26.417 14:07:40 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:03:26.417 14:07:40 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:03:26.417 14:07:40 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:03:26.417 14:07:40 -- setup/common.sh@18 -- # local node=0 00:03:26.417 14:07:40 -- setup/common.sh@19 -- # local var val 00:03:26.417 14:07:40 -- setup/common.sh@20 -- # local mem_f mem 00:03:26.417 14:07:40 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:03:26.417 14:07:40 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:03:26.417 14:07:40 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:03:26.417 14:07:40 -- setup/common.sh@28 -- # mapfile -t mem 00:03:26.417 14:07:40 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:03:26.417 14:07:40 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32630596 kB' 'MemFree: 19532028 kB' 'MemUsed: 13098568 kB' 'SwapCached: 0 kB' 'Active: 5841424 kB' 'Inactive: 3740160 kB' 'Active(anon): 5603116 kB' 'Inactive(anon): 0 kB' 'Active(file): 238308 kB' 'Inactive(file): 3740160 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9482560 kB' 'Mapped: 135168 kB' 'AnonPages: 102252 kB' 'Shmem: 5504092 kB' 'KernelStack: 10712 kB' 'PageTables: 4148 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 115892 kB' 'Slab: 516152 kB' 'SReclaimable: 115892 kB' 'SUnreclaim: 400260 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.417 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.417 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # continue 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # IFS=': ' 00:03:26.418 14:07:40 -- setup/common.sh@31 -- # read -r var val _ 00:03:26.418 14:07:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:03:26.418 14:07:40 -- setup/common.sh@33 -- # echo 0 00:03:26.418 14:07:40 -- setup/common.sh@33 -- # return 0 00:03:26.418 14:07:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:03:26.418 14:07:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:03:26.418 14:07:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:03:26.418 14:07:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:03:26.418 14:07:40 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:03:26.418 node0=1024 expecting 1024 00:03:26.418 14:07:40 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:03:26.418 00:03:26.418 real 0m5.733s 00:03:26.418 user 0m2.389s 00:03:26.418 sys 0m3.472s 00:03:26.418 14:07:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.418 14:07:40 -- common/autotest_common.sh@10 -- # set +x 00:03:26.418 ************************************ 00:03:26.418 END TEST no_shrink_alloc 00:03:26.418 ************************************ 00:03:26.418 14:07:40 -- setup/hugepages.sh@217 -- # clear_hp 00:03:26.418 14:07:40 -- setup/hugepages.sh@37 -- # local node hp 00:03:26.418 14:07:40 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:26.418 14:07:40 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:26.418 14:07:40 -- setup/hugepages.sh@41 -- # echo 0 00:03:26.418 14:07:40 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:26.418 14:07:40 -- setup/hugepages.sh@41 -- # echo 0 00:03:26.418 14:07:40 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:03:26.418 14:07:40 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:26.418 14:07:40 -- setup/hugepages.sh@41 -- # echo 0 00:03:26.418 14:07:40 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:03:26.418 14:07:40 -- setup/hugepages.sh@41 -- # echo 0 00:03:26.418 14:07:40 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:03:26.418 14:07:40 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:03:26.418 00:03:26.418 real 0m20.974s 00:03:26.418 user 0m8.209s 00:03:26.418 sys 0m12.365s 00:03:26.418 14:07:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:26.418 14:07:40 -- common/autotest_common.sh@10 -- # set +x 00:03:26.418 ************************************ 00:03:26.418 END TEST hugepages 00:03:26.418 ************************************ 00:03:26.418 14:07:40 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:26.418 14:07:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:26.418 14:07:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:26.418 14:07:40 -- common/autotest_common.sh@10 -- # set +x 00:03:26.418 ************************************ 00:03:26.418 START TEST driver 00:03:26.418 ************************************ 00:03:26.418 14:07:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:03:26.677 * Looking for test storage... 00:03:26.677 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:26.677 14:07:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:26.677 14:07:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:26.677 14:07:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:26.677 14:07:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:26.677 14:07:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:26.677 14:07:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:26.677 14:07:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:26.677 14:07:41 -- scripts/common.sh@335 -- # IFS=.-: 00:03:26.677 14:07:41 -- scripts/common.sh@335 -- # read -ra ver1 00:03:26.677 14:07:41 -- scripts/common.sh@336 -- # IFS=.-: 00:03:26.677 14:07:41 -- scripts/common.sh@336 -- # read -ra ver2 00:03:26.677 14:07:41 -- scripts/common.sh@337 -- # local 'op=<' 00:03:26.677 14:07:41 -- scripts/common.sh@339 -- # ver1_l=2 00:03:26.677 14:07:41 -- scripts/common.sh@340 -- # ver2_l=1 00:03:26.677 14:07:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:26.677 14:07:41 -- scripts/common.sh@343 -- # case "$op" in 00:03:26.677 14:07:41 -- scripts/common.sh@344 -- # : 1 00:03:26.677 14:07:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:26.677 14:07:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:26.677 14:07:41 -- scripts/common.sh@364 -- # decimal 1 00:03:26.677 14:07:41 -- scripts/common.sh@352 -- # local d=1 00:03:26.677 14:07:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:26.677 14:07:41 -- scripts/common.sh@354 -- # echo 1 00:03:26.677 14:07:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:26.677 14:07:41 -- scripts/common.sh@365 -- # decimal 2 00:03:26.677 14:07:41 -- scripts/common.sh@352 -- # local d=2 00:03:26.677 14:07:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:26.677 14:07:41 -- scripts/common.sh@354 -- # echo 2 00:03:26.677 14:07:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:26.677 14:07:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:26.677 14:07:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:26.677 14:07:41 -- scripts/common.sh@367 -- # return 0 00:03:26.677 14:07:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:26.677 14:07:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:26.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.677 --rc genhtml_branch_coverage=1 00:03:26.677 --rc genhtml_function_coverage=1 00:03:26.677 --rc genhtml_legend=1 00:03:26.677 --rc geninfo_all_blocks=1 00:03:26.677 --rc geninfo_unexecuted_blocks=1 00:03:26.677 00:03:26.677 ' 00:03:26.677 14:07:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:26.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.677 --rc genhtml_branch_coverage=1 00:03:26.677 --rc genhtml_function_coverage=1 00:03:26.677 --rc genhtml_legend=1 00:03:26.677 --rc geninfo_all_blocks=1 00:03:26.677 --rc geninfo_unexecuted_blocks=1 00:03:26.677 00:03:26.677 ' 00:03:26.677 14:07:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:26.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.677 --rc genhtml_branch_coverage=1 00:03:26.677 --rc genhtml_function_coverage=1 00:03:26.677 --rc genhtml_legend=1 00:03:26.677 --rc geninfo_all_blocks=1 00:03:26.677 --rc geninfo_unexecuted_blocks=1 00:03:26.677 00:03:26.677 ' 00:03:26.677 14:07:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:26.677 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:26.677 --rc genhtml_branch_coverage=1 00:03:26.677 --rc genhtml_function_coverage=1 00:03:26.677 --rc genhtml_legend=1 00:03:26.677 --rc geninfo_all_blocks=1 00:03:26.677 --rc geninfo_unexecuted_blocks=1 00:03:26.677 00:03:26.677 ' 00:03:26.677 14:07:41 -- setup/driver.sh@68 -- # setup reset 00:03:26.677 14:07:41 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:26.677 14:07:41 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:30.867 14:07:45 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:03:30.867 14:07:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:30.867 14:07:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:30.867 14:07:45 -- common/autotest_common.sh@10 -- # set +x 00:03:30.867 ************************************ 00:03:30.867 START TEST guess_driver 00:03:30.867 ************************************ 00:03:30.867 14:07:45 -- common/autotest_common.sh@1114 -- # guess_driver 00:03:30.867 14:07:45 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:03:30.867 14:07:45 -- setup/driver.sh@47 -- # local fail=0 00:03:30.867 14:07:45 -- setup/driver.sh@49 -- # pick_driver 00:03:30.867 14:07:45 -- setup/driver.sh@36 -- # vfio 00:03:30.867 14:07:45 -- setup/driver.sh@21 -- # local iommu_grups 00:03:30.867 14:07:45 -- setup/driver.sh@22 -- # local unsafe_vfio 00:03:30.867 14:07:45 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:03:30.867 14:07:45 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:03:30.867 14:07:45 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:03:30.867 14:07:45 -- setup/driver.sh@29 -- # (( 171 > 0 )) 00:03:30.867 14:07:45 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:03:30.867 14:07:45 -- setup/driver.sh@14 -- # mod vfio_pci 00:03:30.867 14:07:45 -- setup/driver.sh@12 -- # dep vfio_pci 00:03:30.867 14:07:45 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:03:30.867 14:07:45 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:03:30.867 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:30.867 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:30.867 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:03:30.867 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:03:30.868 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:03:30.868 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:03:30.868 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:03:30.868 14:07:45 -- setup/driver.sh@30 -- # return 0 00:03:30.868 14:07:45 -- setup/driver.sh@37 -- # echo vfio-pci 00:03:30.868 14:07:45 -- setup/driver.sh@49 -- # driver=vfio-pci 00:03:30.868 14:07:45 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:03:30.868 14:07:45 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:03:30.868 Looking for driver=vfio-pci 00:03:30.868 14:07:45 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:30.868 14:07:45 -- setup/driver.sh@45 -- # setup output config 00:03:30.868 14:07:45 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:30.868 14:07:45 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.402 14:07:47 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.402 14:07:47 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.402 14:07:47 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:33.970 14:07:48 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:03:33.970 14:07:48 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:03:33.970 14:07:48 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:03:34.229 14:07:48 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:03:34.229 14:07:48 -- setup/driver.sh@65 -- # setup reset 00:03:34.229 14:07:48 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:34.229 14:07:48 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:38.419 00:03:38.419 real 0m7.485s 00:03:38.419 user 0m2.118s 00:03:38.419 sys 0m3.870s 00:03:38.419 14:07:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.419 14:07:52 -- common/autotest_common.sh@10 -- # set +x 00:03:38.419 ************************************ 00:03:38.419 END TEST guess_driver 00:03:38.419 ************************************ 00:03:38.419 00:03:38.419 real 0m11.633s 00:03:38.419 user 0m3.375s 00:03:38.419 sys 0m6.047s 00:03:38.419 14:07:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:38.419 14:07:52 -- common/autotest_common.sh@10 -- # set +x 00:03:38.419 ************************************ 00:03:38.419 END TEST driver 00:03:38.419 ************************************ 00:03:38.419 14:07:52 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:38.419 14:07:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:38.419 14:07:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:38.419 14:07:52 -- common/autotest_common.sh@10 -- # set +x 00:03:38.419 ************************************ 00:03:38.419 START TEST devices 00:03:38.419 ************************************ 00:03:38.419 14:07:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:03:38.419 * Looking for test storage... 00:03:38.419 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:03:38.419 14:07:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:38.419 14:07:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:38.419 14:07:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:38.419 14:07:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:38.419 14:07:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:38.419 14:07:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:38.419 14:07:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:38.419 14:07:52 -- scripts/common.sh@335 -- # IFS=.-: 00:03:38.419 14:07:52 -- scripts/common.sh@335 -- # read -ra ver1 00:03:38.419 14:07:52 -- scripts/common.sh@336 -- # IFS=.-: 00:03:38.419 14:07:52 -- scripts/common.sh@336 -- # read -ra ver2 00:03:38.419 14:07:52 -- scripts/common.sh@337 -- # local 'op=<' 00:03:38.419 14:07:52 -- scripts/common.sh@339 -- # ver1_l=2 00:03:38.419 14:07:52 -- scripts/common.sh@340 -- # ver2_l=1 00:03:38.419 14:07:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:38.419 14:07:52 -- scripts/common.sh@343 -- # case "$op" in 00:03:38.419 14:07:52 -- scripts/common.sh@344 -- # : 1 00:03:38.419 14:07:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:38.419 14:07:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:38.419 14:07:52 -- scripts/common.sh@364 -- # decimal 1 00:03:38.419 14:07:52 -- scripts/common.sh@352 -- # local d=1 00:03:38.419 14:07:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:38.419 14:07:52 -- scripts/common.sh@354 -- # echo 1 00:03:38.419 14:07:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:38.419 14:07:52 -- scripts/common.sh@365 -- # decimal 2 00:03:38.419 14:07:52 -- scripts/common.sh@352 -- # local d=2 00:03:38.419 14:07:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:38.419 14:07:52 -- scripts/common.sh@354 -- # echo 2 00:03:38.419 14:07:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:38.419 14:07:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:38.419 14:07:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:38.419 14:07:52 -- scripts/common.sh@367 -- # return 0 00:03:38.419 14:07:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:38.419 14:07:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:38.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.419 --rc genhtml_branch_coverage=1 00:03:38.419 --rc genhtml_function_coverage=1 00:03:38.419 --rc genhtml_legend=1 00:03:38.419 --rc geninfo_all_blocks=1 00:03:38.419 --rc geninfo_unexecuted_blocks=1 00:03:38.419 00:03:38.419 ' 00:03:38.419 14:07:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:38.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.419 --rc genhtml_branch_coverage=1 00:03:38.419 --rc genhtml_function_coverage=1 00:03:38.419 --rc genhtml_legend=1 00:03:38.419 --rc geninfo_all_blocks=1 00:03:38.419 --rc geninfo_unexecuted_blocks=1 00:03:38.419 00:03:38.419 ' 00:03:38.419 14:07:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:38.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.419 --rc genhtml_branch_coverage=1 00:03:38.419 --rc genhtml_function_coverage=1 00:03:38.419 --rc genhtml_legend=1 00:03:38.419 --rc geninfo_all_blocks=1 00:03:38.419 --rc geninfo_unexecuted_blocks=1 00:03:38.419 00:03:38.419 ' 00:03:38.419 14:07:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:38.419 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:38.419 --rc genhtml_branch_coverage=1 00:03:38.419 --rc genhtml_function_coverage=1 00:03:38.419 --rc genhtml_legend=1 00:03:38.419 --rc geninfo_all_blocks=1 00:03:38.419 --rc geninfo_unexecuted_blocks=1 00:03:38.419 00:03:38.419 ' 00:03:38.419 14:07:52 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:03:38.419 14:07:52 -- setup/devices.sh@192 -- # setup reset 00:03:38.419 14:07:52 -- setup/common.sh@9 -- # [[ reset == output ]] 00:03:38.419 14:07:52 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:03:41.709 14:07:55 -- setup/devices.sh@194 -- # get_zoned_devs 00:03:41.709 14:07:55 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:03:41.709 14:07:55 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:03:41.709 14:07:55 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:03:41.709 14:07:55 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:03:41.709 14:07:55 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:03:41.709 14:07:55 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:03:41.709 14:07:55 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:03:41.709 14:07:55 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:03:41.709 14:07:55 -- setup/devices.sh@196 -- # blocks=() 00:03:41.709 14:07:55 -- setup/devices.sh@196 -- # declare -a blocks 00:03:41.709 14:07:55 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:03:41.709 14:07:55 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:03:41.709 14:07:55 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:03:41.709 14:07:55 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:03:41.709 14:07:55 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:03:41.709 14:07:55 -- setup/devices.sh@201 -- # ctrl=nvme0 00:03:41.709 14:07:55 -- setup/devices.sh@202 -- # pci=0000:5e:00.0 00:03:41.709 14:07:55 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\5\e\:\0\0\.\0* ]] 00:03:41.709 14:07:55 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:03:41.709 14:07:55 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:03:41.709 14:07:55 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:03:41.709 No valid GPT data, bailing 00:03:41.709 14:07:55 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:03:41.709 14:07:55 -- scripts/common.sh@393 -- # pt= 00:03:41.709 14:07:55 -- scripts/common.sh@394 -- # return 1 00:03:41.709 14:07:55 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:03:41.709 14:07:55 -- setup/common.sh@76 -- # local dev=nvme0n1 00:03:41.709 14:07:55 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:03:41.709 14:07:55 -- setup/common.sh@80 -- # echo 1000204886016 00:03:41.709 14:07:55 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:03:41.709 14:07:55 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:03:41.709 14:07:55 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:5e:00.0 00:03:41.709 14:07:55 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:03:41.709 14:07:55 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:03:41.709 14:07:55 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:03:41.709 14:07:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:41.709 14:07:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:41.709 14:07:55 -- common/autotest_common.sh@10 -- # set +x 00:03:41.709 ************************************ 00:03:41.709 START TEST nvme_mount 00:03:41.709 ************************************ 00:03:41.709 14:07:55 -- common/autotest_common.sh@1114 -- # nvme_mount 00:03:41.709 14:07:55 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:03:41.709 14:07:55 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:03:41.709 14:07:55 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:41.709 14:07:55 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:41.709 14:07:55 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:03:41.709 14:07:55 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:41.709 14:07:55 -- setup/common.sh@40 -- # local part_no=1 00:03:41.709 14:07:55 -- setup/common.sh@41 -- # local size=1073741824 00:03:41.709 14:07:55 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:41.709 14:07:55 -- setup/common.sh@44 -- # parts=() 00:03:41.709 14:07:55 -- setup/common.sh@44 -- # local parts 00:03:41.709 14:07:55 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:41.709 14:07:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:41.709 14:07:55 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:41.709 14:07:55 -- setup/common.sh@46 -- # (( part++ )) 00:03:41.709 14:07:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:41.709 14:07:55 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:41.709 14:07:55 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:41.709 14:07:55 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:03:42.645 Creating new GPT entries in memory. 00:03:42.645 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:42.645 other utilities. 00:03:42.645 14:07:56 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:42.645 14:07:56 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:42.645 14:07:56 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:42.645 14:07:56 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:42.645 14:07:56 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:43.582 Creating new GPT entries in memory. 00:03:43.582 The operation has completed successfully. 00:03:43.582 14:07:57 -- setup/common.sh@57 -- # (( part++ )) 00:03:43.582 14:07:57 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:43.582 14:07:57 -- setup/common.sh@62 -- # wait 178001 00:03:43.582 14:07:58 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.582 14:07:58 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:03:43.582 14:07:58 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.582 14:07:58 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:03:43.582 14:07:58 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:03:43.582 14:07:58 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.582 14:07:58 -- setup/devices.sh@105 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:43.582 14:07:58 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:43.582 14:07:58 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:03:43.582 14:07:58 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:43.582 14:07:58 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:43.582 14:07:58 -- setup/devices.sh@53 -- # local found=0 00:03:43.582 14:07:58 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:43.582 14:07:58 -- setup/devices.sh@56 -- # : 00:03:43.582 14:07:58 -- setup/devices.sh@59 -- # local pci status 00:03:43.582 14:07:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:43.582 14:07:58 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:43.582 14:07:58 -- setup/devices.sh@47 -- # setup output config 00:03:43.582 14:07:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:43.582 14:07:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:03:46.117 14:08:00 -- setup/devices.sh@63 -- # found=1 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.117 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.117 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.376 14:08:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:46.376 14:08:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.376 14:08:00 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:46.376 14:08:00 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:46.376 14:08:00 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.376 14:08:00 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:46.376 14:08:00 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.376 14:08:00 -- setup/devices.sh@110 -- # cleanup_nvme 00:03:46.376 14:08:00 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.376 14:08:00 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.376 14:08:00 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:46.377 14:08:00 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:03:46.377 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:46.377 14:08:00 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:46.377 14:08:00 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:46.635 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:03:46.635 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:03:46.635 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:03:46.635 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:03:46.635 14:08:01 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:03:46.635 14:08:01 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:03:46.635 14:08:01 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.635 14:08:01 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:03:46.635 14:08:01 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:03:46.894 14:08:01 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.894 14:08:01 -- setup/devices.sh@116 -- # verify 0000:5e:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.894 14:08:01 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:46.894 14:08:01 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:03:46.894 14:08:01 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:46.894 14:08:01 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:46.894 14:08:01 -- setup/devices.sh@53 -- # local found=0 00:03:46.894 14:08:01 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:46.894 14:08:01 -- setup/devices.sh@56 -- # : 00:03:46.894 14:08:01 -- setup/devices.sh@59 -- # local pci status 00:03:46.894 14:08:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:46.894 14:08:01 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:46.894 14:08:01 -- setup/devices.sh@47 -- # setup output config 00:03:46.894 14:08:01 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:46.894 14:08:01 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:49.599 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.599 14:08:03 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:03:49.599 14:08:03 -- setup/devices.sh@63 -- # found=1 00:03:49.599 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.599 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.599 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:03 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:49.600 14:08:03 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:04 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:49.600 14:08:04 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:03:49.600 14:08:04 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.600 14:08:04 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:03:49.600 14:08:04 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:03:49.600 14:08:04 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:49.600 14:08:04 -- setup/devices.sh@125 -- # verify 0000:5e:00.0 data@nvme0n1 '' '' 00:03:49.600 14:08:04 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:49.600 14:08:04 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:03:49.600 14:08:04 -- setup/devices.sh@50 -- # local mount_point= 00:03:49.600 14:08:04 -- setup/devices.sh@51 -- # local test_file= 00:03:49.600 14:08:04 -- setup/devices.sh@53 -- # local found=0 00:03:49.600 14:08:04 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:49.600 14:08:04 -- setup/devices.sh@59 -- # local pci status 00:03:49.600 14:08:04 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:49.600 14:08:04 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:49.600 14:08:04 -- setup/devices.sh@47 -- # setup output config 00:03:49.600 14:08:04 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:49.600 14:08:04 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:03:52.135 14:08:06 -- setup/devices.sh@63 -- # found=1 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.135 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.135 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.136 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.136 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.136 14:08:06 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:52.136 14:08:06 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:52.395 14:08:06 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:52.395 14:08:06 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:03:52.395 14:08:06 -- setup/devices.sh@68 -- # return 0 00:03:52.395 14:08:06 -- setup/devices.sh@128 -- # cleanup_nvme 00:03:52.395 14:08:06 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:03:52.395 14:08:06 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:03:52.395 14:08:06 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:03:52.395 14:08:06 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:03:52.395 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:03:52.395 00:03:52.395 real 0m10.861s 00:03:52.395 user 0m3.311s 00:03:52.395 sys 0m5.386s 00:03:52.395 14:08:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:03:52.395 14:08:06 -- common/autotest_common.sh@10 -- # set +x 00:03:52.395 ************************************ 00:03:52.395 END TEST nvme_mount 00:03:52.395 ************************************ 00:03:52.395 14:08:06 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:03:52.395 14:08:06 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:03:52.395 14:08:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:03:52.395 14:08:06 -- common/autotest_common.sh@10 -- # set +x 00:03:52.395 ************************************ 00:03:52.395 START TEST dm_mount 00:03:52.395 ************************************ 00:03:52.395 14:08:06 -- common/autotest_common.sh@1114 -- # dm_mount 00:03:52.395 14:08:06 -- setup/devices.sh@144 -- # pv=nvme0n1 00:03:52.395 14:08:06 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:03:52.395 14:08:06 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:03:52.395 14:08:06 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:03:52.395 14:08:06 -- setup/common.sh@39 -- # local disk=nvme0n1 00:03:52.395 14:08:06 -- setup/common.sh@40 -- # local part_no=2 00:03:52.395 14:08:06 -- setup/common.sh@41 -- # local size=1073741824 00:03:52.395 14:08:06 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:03:52.395 14:08:06 -- setup/common.sh@44 -- # parts=() 00:03:52.395 14:08:06 -- setup/common.sh@44 -- # local parts 00:03:52.395 14:08:06 -- setup/common.sh@46 -- # (( part = 1 )) 00:03:52.395 14:08:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:52.395 14:08:06 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:52.395 14:08:06 -- setup/common.sh@46 -- # (( part++ )) 00:03:52.395 14:08:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:52.395 14:08:06 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:03:52.395 14:08:06 -- setup/common.sh@46 -- # (( part++ )) 00:03:52.395 14:08:06 -- setup/common.sh@46 -- # (( part <= part_no )) 00:03:52.395 14:08:06 -- setup/common.sh@51 -- # (( size /= 512 )) 00:03:52.395 14:08:06 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:03:52.395 14:08:06 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:03:53.332 Creating new GPT entries in memory. 00:03:53.332 GPT data structures destroyed! You may now partition the disk using fdisk or 00:03:53.332 other utilities. 00:03:53.332 14:08:07 -- setup/common.sh@57 -- # (( part = 1 )) 00:03:53.332 14:08:07 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:53.332 14:08:07 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:53.332 14:08:07 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:53.332 14:08:07 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:03:54.710 Creating new GPT entries in memory. 00:03:54.710 The operation has completed successfully. 00:03:54.710 14:08:08 -- setup/common.sh@57 -- # (( part++ )) 00:03:54.710 14:08:08 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:54.710 14:08:08 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:03:54.710 14:08:08 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:03:54.710 14:08:08 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:03:55.648 The operation has completed successfully. 00:03:55.648 14:08:09 -- setup/common.sh@57 -- # (( part++ )) 00:03:55.648 14:08:09 -- setup/common.sh@57 -- # (( part <= part_no )) 00:03:55.648 14:08:09 -- setup/common.sh@62 -- # wait 182193 00:03:55.648 14:08:09 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:03:55.648 14:08:09 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.648 14:08:09 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:55.648 14:08:09 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:03:55.648 14:08:09 -- setup/devices.sh@160 -- # for t in {1..5} 00:03:55.648 14:08:09 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:55.648 14:08:09 -- setup/devices.sh@161 -- # break 00:03:55.648 14:08:09 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:55.648 14:08:09 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:03:55.648 14:08:09 -- setup/devices.sh@165 -- # dm=/dev/dm-2 00:03:55.648 14:08:09 -- setup/devices.sh@166 -- # dm=dm-2 00:03:55.648 14:08:09 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-2 ]] 00:03:55.648 14:08:09 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-2 ]] 00:03:55.648 14:08:09 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.648 14:08:09 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:03:55.648 14:08:09 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.648 14:08:09 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:03:55.648 14:08:09 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:03:55.648 14:08:10 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.648 14:08:10 -- setup/devices.sh@174 -- # verify 0000:5e:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:55.648 14:08:10 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:55.648 14:08:10 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:03:55.648 14:08:10 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:55.648 14:08:10 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:55.648 14:08:10 -- setup/devices.sh@53 -- # local found=0 00:03:55.648 14:08:10 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:55.648 14:08:10 -- setup/devices.sh@56 -- # : 00:03:55.648 14:08:10 -- setup/devices.sh@59 -- # local pci status 00:03:55.648 14:08:10 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:55.648 14:08:10 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:55.648 14:08:10 -- setup/devices.sh@47 -- # setup output config 00:03:55.648 14:08:10 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:55.648 14:08:10 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:03:58.184 14:08:12 -- setup/devices.sh@63 -- # found=1 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.184 14:08:12 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:03:58.184 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.443 14:08:12 -- setup/devices.sh@66 -- # (( found == 1 )) 00:03:58.443 14:08:12 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:03:58.443 14:08:12 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:58.443 14:08:12 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:03:58.443 14:08:12 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:03:58.443 14:08:12 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:03:58.443 14:08:12 -- setup/devices.sh@184 -- # verify 0000:5e:00.0 holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2 '' '' 00:03:58.443 14:08:12 -- setup/devices.sh@48 -- # local dev=0000:5e:00.0 00:03:58.443 14:08:12 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2 00:03:58.443 14:08:12 -- setup/devices.sh@50 -- # local mount_point= 00:03:58.443 14:08:12 -- setup/devices.sh@51 -- # local test_file= 00:03:58.443 14:08:12 -- setup/devices.sh@53 -- # local found=0 00:03:58.443 14:08:12 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:03:58.443 14:08:12 -- setup/devices.sh@59 -- # local pci status 00:03:58.443 14:08:12 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:03:58.443 14:08:12 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:5e:00.0 00:03:58.443 14:08:12 -- setup/devices.sh@47 -- # setup output config 00:03:58.443 14:08:12 -- setup/common.sh@9 -- # [[ output == output ]] 00:03:58.443 14:08:12 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:5e:00.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-2,holder@nvme0n1p2:dm-2, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\2\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\2* ]] 00:04:00.980 14:08:15 -- setup/devices.sh@63 -- # found=1 00:04:00.980 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.980 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.980 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.980 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.980 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.980 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.980 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.980 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.980 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:00.981 14:08:15 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\5\e\:\0\0\.\0 ]] 00:04:00.981 14:08:15 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:04:01.240 14:08:15 -- setup/devices.sh@66 -- # (( found == 1 )) 00:04:01.240 14:08:15 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:04:01.240 14:08:15 -- setup/devices.sh@68 -- # return 0 00:04:01.240 14:08:15 -- setup/devices.sh@187 -- # cleanup_dm 00:04:01.240 14:08:15 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:01.240 14:08:15 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:01.240 14:08:15 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:04:01.240 14:08:15 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:01.240 14:08:15 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:04:01.240 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:04:01.240 14:08:15 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:01.240 14:08:15 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:04:01.240 00:04:01.240 real 0m8.799s 00:04:01.240 user 0m2.141s 00:04:01.240 sys 0m3.698s 00:04:01.240 14:08:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.240 14:08:15 -- common/autotest_common.sh@10 -- # set +x 00:04:01.240 ************************************ 00:04:01.240 END TEST dm_mount 00:04:01.240 ************************************ 00:04:01.240 14:08:15 -- setup/devices.sh@1 -- # cleanup 00:04:01.240 14:08:15 -- setup/devices.sh@11 -- # cleanup_nvme 00:04:01.240 14:08:15 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:01.240 14:08:15 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:01.240 14:08:15 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:04:01.240 14:08:15 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:04:01.240 14:08:15 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:04:01.500 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:04:01.500 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:04:01.500 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:04:01.500 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:04:01.500 14:08:15 -- setup/devices.sh@12 -- # cleanup_dm 00:04:01.500 14:08:15 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:04:01.500 14:08:15 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:04:01.500 14:08:15 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:04:01.500 14:08:15 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:04:01.500 14:08:15 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:04:01.500 14:08:15 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:04:01.500 00:04:01.500 real 0m23.306s 00:04:01.500 user 0m6.771s 00:04:01.500 sys 0m11.299s 00:04:01.500 14:08:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.500 14:08:15 -- common/autotest_common.sh@10 -- # set +x 00:04:01.500 ************************************ 00:04:01.500 END TEST devices 00:04:01.500 ************************************ 00:04:01.500 00:04:01.500 real 1m15.210s 00:04:01.500 user 0m24.637s 00:04:01.500 sys 0m41.263s 00:04:01.500 14:08:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:01.500 14:08:15 -- common/autotest_common.sh@10 -- # set +x 00:04:01.500 ************************************ 00:04:01.500 END TEST setup.sh 00:04:01.500 ************************************ 00:04:01.500 14:08:16 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:04.036 Hugepages 00:04:04.036 node hugesize free / total 00:04:04.036 node0 1048576kB 0 / 0 00:04:04.036 node0 2048kB 2048 / 2048 00:04:04.036 node1 1048576kB 0 / 0 00:04:04.036 node1 2048kB 0 / 0 00:04:04.036 00:04:04.036 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:04.036 I/OAT 0000:00:04.0 8086 2021 0 ioatdma - - 00:04:04.036 I/OAT 0000:00:04.1 8086 2021 0 ioatdma - - 00:04:04.036 I/OAT 0000:00:04.2 8086 2021 0 ioatdma - - 00:04:04.036 I/OAT 0000:00:04.3 8086 2021 0 ioatdma - - 00:04:04.036 I/OAT 0000:00:04.4 8086 2021 0 ioatdma - - 00:04:04.036 I/OAT 0000:00:04.5 8086 2021 0 ioatdma - - 00:04:04.036 I/OAT 0000:00:04.6 8086 2021 0 ioatdma - - 00:04:04.036 I/OAT 0000:00:04.7 8086 2021 0 ioatdma - - 00:04:04.036 NVMe 0000:5e:00.0 8086 0a54 0 nvme nvme0 nvme0n1 00:04:04.036 I/OAT 0000:80:04.0 8086 2021 1 ioatdma - - 00:04:04.036 I/OAT 0000:80:04.1 8086 2021 1 ioatdma - - 00:04:04.036 I/OAT 0000:80:04.2 8086 2021 1 ioatdma - - 00:04:04.036 I/OAT 0000:80:04.3 8086 2021 1 ioatdma - - 00:04:04.036 I/OAT 0000:80:04.4 8086 2021 1 ioatdma - - 00:04:04.036 I/OAT 0000:80:04.5 8086 2021 1 ioatdma - - 00:04:04.037 I/OAT 0000:80:04.6 8086 2021 1 ioatdma - - 00:04:04.037 I/OAT 0000:80:04.7 8086 2021 1 ioatdma - - 00:04:04.037 14:08:18 -- spdk/autotest.sh@128 -- # uname -s 00:04:04.037 14:08:18 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:04:04.037 14:08:18 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:04:04.037 14:08:18 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:06.573 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:06.573 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:07.511 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:04:07.511 14:08:22 -- common/autotest_common.sh@1527 -- # sleep 1 00:04:08.448 14:08:23 -- common/autotest_common.sh@1528 -- # bdfs=() 00:04:08.448 14:08:23 -- common/autotest_common.sh@1528 -- # local bdfs 00:04:08.448 14:08:23 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:04:08.448 14:08:23 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:04:08.448 14:08:23 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:08.448 14:08:23 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:08.448 14:08:23 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:08.448 14:08:23 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:08.448 14:08:23 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:08.707 14:08:23 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:08.707 14:08:23 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:5e:00.0 00:04:08.707 14:08:23 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:11.245 Waiting for block devices as requested 00:04:11.245 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:04:11.503 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:04:11.503 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:04:11.503 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:04:11.762 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:04:11.762 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:04:11.762 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:04:11.762 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:04:12.021 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:04:12.021 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:04:12.021 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:04:12.021 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:04:12.279 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:04:12.279 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:04:12.279 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:04:12.538 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:04:12.538 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:04:12.538 14:08:27 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:04:12.538 14:08:27 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:5e:00.0 00:04:12.538 14:08:27 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:04:12.538 14:08:27 -- common/autotest_common.sh@1497 -- # grep 0000:5e:00.0/nvme/nvme 00:04:12.538 14:08:27 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:04:12.538 14:08:27 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 ]] 00:04:12.538 14:08:27 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:5d/0000:5d:02.0/0000:5e:00.0/nvme/nvme0 00:04:12.538 14:08:27 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:04:12.538 14:08:27 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:04:12.538 14:08:27 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:04:12.538 14:08:27 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:04:12.538 14:08:27 -- common/autotest_common.sh@1540 -- # grep oacs 00:04:12.538 14:08:27 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:04:12.538 14:08:27 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:04:12.538 14:08:27 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:04:12.538 14:08:27 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:04:12.538 14:08:27 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:04:12.538 14:08:27 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:04:12.538 14:08:27 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:04:12.538 14:08:27 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:04:12.538 14:08:27 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:04:12.538 14:08:27 -- common/autotest_common.sh@1552 -- # continue 00:04:12.538 14:08:27 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:04:12.538 14:08:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:12.538 14:08:27 -- common/autotest_common.sh@10 -- # set +x 00:04:12.797 14:08:27 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:04:12.797 14:08:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:12.797 14:08:27 -- common/autotest_common.sh@10 -- # set +x 00:04:12.797 14:08:27 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:15.330 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:04:15.330 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:04:15.589 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:04:15.589 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:04:16.156 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:04:16.415 14:08:30 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:04:16.415 14:08:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:16.415 14:08:30 -- common/autotest_common.sh@10 -- # set +x 00:04:16.415 14:08:30 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:04:16.415 14:08:30 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:04:16.415 14:08:30 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:04:16.415 14:08:30 -- common/autotest_common.sh@1572 -- # bdfs=() 00:04:16.415 14:08:30 -- common/autotest_common.sh@1572 -- # local bdfs 00:04:16.415 14:08:30 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:04:16.415 14:08:30 -- common/autotest_common.sh@1508 -- # bdfs=() 00:04:16.415 14:08:30 -- common/autotest_common.sh@1508 -- # local bdfs 00:04:16.415 14:08:30 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:04:16.415 14:08:30 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:04:16.415 14:08:30 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:04:16.415 14:08:30 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:04:16.415 14:08:30 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:5e:00.0 00:04:16.415 14:08:30 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:04:16.415 14:08:30 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:5e:00.0/device 00:04:16.415 14:08:30 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:04:16.415 14:08:30 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:04:16.415 14:08:30 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:04:16.415 14:08:30 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:5e:00.0 00:04:16.415 14:08:30 -- common/autotest_common.sh@1587 -- # [[ -z 0000:5e:00.0 ]] 00:04:16.415 14:08:30 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=190976 00:04:16.415 14:08:30 -- common/autotest_common.sh@1593 -- # waitforlisten 190976 00:04:16.415 14:08:30 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:16.415 14:08:30 -- common/autotest_common.sh@829 -- # '[' -z 190976 ']' 00:04:16.415 14:08:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:16.415 14:08:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:16.415 14:08:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:16.416 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:16.416 14:08:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:16.416 14:08:30 -- common/autotest_common.sh@10 -- # set +x 00:04:16.675 [2024-12-16 14:08:30.989284] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:16.675 [2024-12-16 14:08:30.989331] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid190976 ] 00:04:16.675 EAL: No free 2048 kB hugepages reported on node 1 00:04:16.675 [2024-12-16 14:08:31.045402] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:16.675 [2024-12-16 14:08:31.121062] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:16.675 [2024-12-16 14:08:31.121169] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:17.242 14:08:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:17.242 14:08:31 -- common/autotest_common.sh@862 -- # return 0 00:04:17.242 14:08:31 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:04:17.242 14:08:31 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:04:17.242 14:08:31 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:5e:00.0 00:04:20.531 nvme0n1 00:04:20.531 14:08:34 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:04:20.531 [2024-12-16 14:08:34.965975] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:04:20.531 [2024-12-16 14:08:34.966005] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:04:20.531 request: 00:04:20.531 { 00:04:20.531 "nvme_ctrlr_name": "nvme0", 00:04:20.531 "password": "test", 00:04:20.531 "method": "bdev_nvme_opal_revert", 00:04:20.531 "req_id": 1 00:04:20.531 } 00:04:20.531 Got JSON-RPC error response 00:04:20.531 response: 00:04:20.531 { 00:04:20.531 "code": -32603, 00:04:20.531 "message": "Internal error" 00:04:20.531 } 00:04:20.531 14:08:34 -- common/autotest_common.sh@1599 -- # true 00:04:20.531 14:08:34 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:04:20.531 14:08:34 -- common/autotest_common.sh@1603 -- # killprocess 190976 00:04:20.531 14:08:34 -- common/autotest_common.sh@936 -- # '[' -z 190976 ']' 00:04:20.531 14:08:34 -- common/autotest_common.sh@940 -- # kill -0 190976 00:04:20.531 14:08:34 -- common/autotest_common.sh@941 -- # uname 00:04:20.531 14:08:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:20.531 14:08:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 190976 00:04:20.531 14:08:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:20.531 14:08:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:20.531 14:08:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 190976' 00:04:20.531 killing process with pid 190976 00:04:20.531 14:08:35 -- common/autotest_common.sh@955 -- # kill 190976 00:04:20.531 14:08:35 -- common/autotest_common.sh@960 -- # wait 190976 00:04:22.433 14:08:36 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:04:22.433 14:08:36 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:04:22.433 14:08:36 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:22.433 14:08:36 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:04:22.433 14:08:36 -- spdk/autotest.sh@160 -- # timing_enter lib 00:04:22.433 14:08:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:22.433 14:08:36 -- common/autotest_common.sh@10 -- # set +x 00:04:22.433 14:08:36 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:22.433 14:08:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.433 14:08:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.433 14:08:36 -- common/autotest_common.sh@10 -- # set +x 00:04:22.433 ************************************ 00:04:22.433 START TEST env 00:04:22.433 ************************************ 00:04:22.433 14:08:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:04:22.433 * Looking for test storage... 00:04:22.433 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:04:22.433 14:08:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:22.433 14:08:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:22.433 14:08:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:22.433 14:08:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:22.433 14:08:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:22.433 14:08:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:22.433 14:08:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:22.433 14:08:36 -- scripts/common.sh@335 -- # IFS=.-: 00:04:22.434 14:08:36 -- scripts/common.sh@335 -- # read -ra ver1 00:04:22.434 14:08:36 -- scripts/common.sh@336 -- # IFS=.-: 00:04:22.434 14:08:36 -- scripts/common.sh@336 -- # read -ra ver2 00:04:22.434 14:08:36 -- scripts/common.sh@337 -- # local 'op=<' 00:04:22.434 14:08:36 -- scripts/common.sh@339 -- # ver1_l=2 00:04:22.434 14:08:36 -- scripts/common.sh@340 -- # ver2_l=1 00:04:22.434 14:08:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:22.434 14:08:36 -- scripts/common.sh@343 -- # case "$op" in 00:04:22.434 14:08:36 -- scripts/common.sh@344 -- # : 1 00:04:22.434 14:08:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:22.434 14:08:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:22.434 14:08:36 -- scripts/common.sh@364 -- # decimal 1 00:04:22.434 14:08:36 -- scripts/common.sh@352 -- # local d=1 00:04:22.434 14:08:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:22.434 14:08:36 -- scripts/common.sh@354 -- # echo 1 00:04:22.434 14:08:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:22.434 14:08:36 -- scripts/common.sh@365 -- # decimal 2 00:04:22.434 14:08:36 -- scripts/common.sh@352 -- # local d=2 00:04:22.434 14:08:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:22.434 14:08:36 -- scripts/common.sh@354 -- # echo 2 00:04:22.434 14:08:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:22.434 14:08:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:22.434 14:08:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:22.434 14:08:36 -- scripts/common.sh@367 -- # return 0 00:04:22.434 14:08:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:22.434 14:08:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:22.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:22.434 --rc genhtml_branch_coverage=1 00:04:22.434 --rc genhtml_function_coverage=1 00:04:22.434 --rc genhtml_legend=1 00:04:22.434 --rc geninfo_all_blocks=1 00:04:22.434 --rc geninfo_unexecuted_blocks=1 00:04:22.434 00:04:22.434 ' 00:04:22.434 14:08:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:22.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:22.434 --rc genhtml_branch_coverage=1 00:04:22.434 --rc genhtml_function_coverage=1 00:04:22.434 --rc genhtml_legend=1 00:04:22.434 --rc geninfo_all_blocks=1 00:04:22.434 --rc geninfo_unexecuted_blocks=1 00:04:22.434 00:04:22.434 ' 00:04:22.434 14:08:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:22.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:22.434 --rc genhtml_branch_coverage=1 00:04:22.434 --rc genhtml_function_coverage=1 00:04:22.434 --rc genhtml_legend=1 00:04:22.434 --rc geninfo_all_blocks=1 00:04:22.434 --rc geninfo_unexecuted_blocks=1 00:04:22.434 00:04:22.434 ' 00:04:22.434 14:08:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:22.434 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:22.434 --rc genhtml_branch_coverage=1 00:04:22.434 --rc genhtml_function_coverage=1 00:04:22.434 --rc genhtml_legend=1 00:04:22.434 --rc geninfo_all_blocks=1 00:04:22.434 --rc geninfo_unexecuted_blocks=1 00:04:22.434 00:04:22.434 ' 00:04:22.434 14:08:36 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:22.434 14:08:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.434 14:08:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.434 14:08:36 -- common/autotest_common.sh@10 -- # set +x 00:04:22.434 ************************************ 00:04:22.434 START TEST env_memory 00:04:22.434 ************************************ 00:04:22.434 14:08:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:04:22.434 00:04:22.434 00:04:22.434 CUnit - A unit testing framework for C - Version 2.1-3 00:04:22.434 http://cunit.sourceforge.net/ 00:04:22.434 00:04:22.434 00:04:22.434 Suite: memory 00:04:22.434 Test: alloc and free memory map ...[2024-12-16 14:08:36.901981] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:04:22.434 passed 00:04:22.434 Test: mem map translation ...[2024-12-16 14:08:36.919655] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:04:22.434 [2024-12-16 14:08:36.919668] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:04:22.434 [2024-12-16 14:08:36.919701] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:04:22.434 [2024-12-16 14:08:36.919707] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:04:22.434 passed 00:04:22.434 Test: mem map registration ...[2024-12-16 14:08:36.955882] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:04:22.434 [2024-12-16 14:08:36.955905] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:04:22.434 passed 00:04:22.434 Test: mem map adjacent registrations ...passed 00:04:22.434 00:04:22.434 Run Summary: Type Total Ran Passed Failed Inactive 00:04:22.434 suites 1 1 n/a 0 0 00:04:22.434 tests 4 4 4 0 0 00:04:22.434 asserts 152 152 152 0 n/a 00:04:22.434 00:04:22.434 Elapsed time = 0.136 seconds 00:04:22.434 00:04:22.434 real 0m0.147s 00:04:22.434 user 0m0.139s 00:04:22.434 sys 0m0.008s 00:04:22.434 14:08:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:22.434 14:08:37 -- common/autotest_common.sh@10 -- # set +x 00:04:22.434 ************************************ 00:04:22.434 END TEST env_memory 00:04:22.434 ************************************ 00:04:22.694 14:08:37 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:22.694 14:08:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:22.694 14:08:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:22.694 14:08:37 -- common/autotest_common.sh@10 -- # set +x 00:04:22.694 ************************************ 00:04:22.694 START TEST env_vtophys 00:04:22.694 ************************************ 00:04:22.694 14:08:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:04:22.694 EAL: lib.eal log level changed from notice to debug 00:04:22.694 EAL: Detected lcore 0 as core 0 on socket 0 00:04:22.694 EAL: Detected lcore 1 as core 1 on socket 0 00:04:22.694 EAL: Detected lcore 2 as core 2 on socket 0 00:04:22.694 EAL: Detected lcore 3 as core 3 on socket 0 00:04:22.694 EAL: Detected lcore 4 as core 4 on socket 0 00:04:22.694 EAL: Detected lcore 5 as core 5 on socket 0 00:04:22.694 EAL: Detected lcore 6 as core 6 on socket 0 00:04:22.694 EAL: Detected lcore 7 as core 8 on socket 0 00:04:22.694 EAL: Detected lcore 8 as core 9 on socket 0 00:04:22.694 EAL: Detected lcore 9 as core 10 on socket 0 00:04:22.694 EAL: Detected lcore 10 as core 11 on socket 0 00:04:22.694 EAL: Detected lcore 11 as core 12 on socket 0 00:04:22.694 EAL: Detected lcore 12 as core 13 on socket 0 00:04:22.694 EAL: Detected lcore 13 as core 16 on socket 0 00:04:22.694 EAL: Detected lcore 14 as core 17 on socket 0 00:04:22.694 EAL: Detected lcore 15 as core 18 on socket 0 00:04:22.694 EAL: Detected lcore 16 as core 19 on socket 0 00:04:22.694 EAL: Detected lcore 17 as core 20 on socket 0 00:04:22.694 EAL: Detected lcore 18 as core 21 on socket 0 00:04:22.694 EAL: Detected lcore 19 as core 25 on socket 0 00:04:22.694 EAL: Detected lcore 20 as core 26 on socket 0 00:04:22.694 EAL: Detected lcore 21 as core 27 on socket 0 00:04:22.694 EAL: Detected lcore 22 as core 28 on socket 0 00:04:22.694 EAL: Detected lcore 23 as core 29 on socket 0 00:04:22.694 EAL: Detected lcore 24 as core 0 on socket 1 00:04:22.694 EAL: Detected lcore 25 as core 1 on socket 1 00:04:22.694 EAL: Detected lcore 26 as core 2 on socket 1 00:04:22.694 EAL: Detected lcore 27 as core 3 on socket 1 00:04:22.694 EAL: Detected lcore 28 as core 4 on socket 1 00:04:22.694 EAL: Detected lcore 29 as core 5 on socket 1 00:04:22.694 EAL: Detected lcore 30 as core 6 on socket 1 00:04:22.694 EAL: Detected lcore 31 as core 8 on socket 1 00:04:22.694 EAL: Detected lcore 32 as core 9 on socket 1 00:04:22.694 EAL: Detected lcore 33 as core 10 on socket 1 00:04:22.694 EAL: Detected lcore 34 as core 11 on socket 1 00:04:22.694 EAL: Detected lcore 35 as core 12 on socket 1 00:04:22.694 EAL: Detected lcore 36 as core 13 on socket 1 00:04:22.694 EAL: Detected lcore 37 as core 16 on socket 1 00:04:22.694 EAL: Detected lcore 38 as core 17 on socket 1 00:04:22.694 EAL: Detected lcore 39 as core 18 on socket 1 00:04:22.694 EAL: Detected lcore 40 as core 19 on socket 1 00:04:22.694 EAL: Detected lcore 41 as core 20 on socket 1 00:04:22.694 EAL: Detected lcore 42 as core 21 on socket 1 00:04:22.694 EAL: Detected lcore 43 as core 25 on socket 1 00:04:22.694 EAL: Detected lcore 44 as core 26 on socket 1 00:04:22.694 EAL: Detected lcore 45 as core 27 on socket 1 00:04:22.694 EAL: Detected lcore 46 as core 28 on socket 1 00:04:22.694 EAL: Detected lcore 47 as core 29 on socket 1 00:04:22.694 EAL: Detected lcore 48 as core 0 on socket 0 00:04:22.694 EAL: Detected lcore 49 as core 1 on socket 0 00:04:22.694 EAL: Detected lcore 50 as core 2 on socket 0 00:04:22.694 EAL: Detected lcore 51 as core 3 on socket 0 00:04:22.694 EAL: Detected lcore 52 as core 4 on socket 0 00:04:22.694 EAL: Detected lcore 53 as core 5 on socket 0 00:04:22.694 EAL: Detected lcore 54 as core 6 on socket 0 00:04:22.694 EAL: Detected lcore 55 as core 8 on socket 0 00:04:22.694 EAL: Detected lcore 56 as core 9 on socket 0 00:04:22.694 EAL: Detected lcore 57 as core 10 on socket 0 00:04:22.694 EAL: Detected lcore 58 as core 11 on socket 0 00:04:22.694 EAL: Detected lcore 59 as core 12 on socket 0 00:04:22.694 EAL: Detected lcore 60 as core 13 on socket 0 00:04:22.694 EAL: Detected lcore 61 as core 16 on socket 0 00:04:22.694 EAL: Detected lcore 62 as core 17 on socket 0 00:04:22.694 EAL: Detected lcore 63 as core 18 on socket 0 00:04:22.694 EAL: Detected lcore 64 as core 19 on socket 0 00:04:22.694 EAL: Detected lcore 65 as core 20 on socket 0 00:04:22.694 EAL: Detected lcore 66 as core 21 on socket 0 00:04:22.694 EAL: Detected lcore 67 as core 25 on socket 0 00:04:22.694 EAL: Detected lcore 68 as core 26 on socket 0 00:04:22.694 EAL: Detected lcore 69 as core 27 on socket 0 00:04:22.694 EAL: Detected lcore 70 as core 28 on socket 0 00:04:22.694 EAL: Detected lcore 71 as core 29 on socket 0 00:04:22.694 EAL: Detected lcore 72 as core 0 on socket 1 00:04:22.694 EAL: Detected lcore 73 as core 1 on socket 1 00:04:22.694 EAL: Detected lcore 74 as core 2 on socket 1 00:04:22.694 EAL: Detected lcore 75 as core 3 on socket 1 00:04:22.694 EAL: Detected lcore 76 as core 4 on socket 1 00:04:22.694 EAL: Detected lcore 77 as core 5 on socket 1 00:04:22.694 EAL: Detected lcore 78 as core 6 on socket 1 00:04:22.694 EAL: Detected lcore 79 as core 8 on socket 1 00:04:22.694 EAL: Detected lcore 80 as core 9 on socket 1 00:04:22.694 EAL: Detected lcore 81 as core 10 on socket 1 00:04:22.694 EAL: Detected lcore 82 as core 11 on socket 1 00:04:22.694 EAL: Detected lcore 83 as core 12 on socket 1 00:04:22.694 EAL: Detected lcore 84 as core 13 on socket 1 00:04:22.694 EAL: Detected lcore 85 as core 16 on socket 1 00:04:22.694 EAL: Detected lcore 86 as core 17 on socket 1 00:04:22.694 EAL: Detected lcore 87 as core 18 on socket 1 00:04:22.694 EAL: Detected lcore 88 as core 19 on socket 1 00:04:22.694 EAL: Detected lcore 89 as core 20 on socket 1 00:04:22.694 EAL: Detected lcore 90 as core 21 on socket 1 00:04:22.694 EAL: Detected lcore 91 as core 25 on socket 1 00:04:22.694 EAL: Detected lcore 92 as core 26 on socket 1 00:04:22.694 EAL: Detected lcore 93 as core 27 on socket 1 00:04:22.694 EAL: Detected lcore 94 as core 28 on socket 1 00:04:22.694 EAL: Detected lcore 95 as core 29 on socket 1 00:04:22.694 EAL: Maximum logical cores by configuration: 128 00:04:22.694 EAL: Detected CPU lcores: 96 00:04:22.694 EAL: Detected NUMA nodes: 2 00:04:22.694 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:04:22.694 EAL: Detected shared linkage of DPDK 00:04:22.694 EAL: No shared files mode enabled, IPC will be disabled 00:04:22.694 EAL: Bus pci wants IOVA as 'DC' 00:04:22.694 EAL: Buses did not request a specific IOVA mode. 00:04:22.694 EAL: IOMMU is available, selecting IOVA as VA mode. 00:04:22.694 EAL: Selected IOVA mode 'VA' 00:04:22.694 EAL: No free 2048 kB hugepages reported on node 1 00:04:22.694 EAL: Probing VFIO support... 00:04:22.694 EAL: IOMMU type 1 (Type 1) is supported 00:04:22.694 EAL: IOMMU type 7 (sPAPR) is not supported 00:04:22.694 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:04:22.694 EAL: VFIO support initialized 00:04:22.694 EAL: Ask a virtual area of 0x2e000 bytes 00:04:22.694 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:04:22.694 EAL: Setting up physically contiguous memory... 00:04:22.694 EAL: Setting maximum number of open files to 524288 00:04:22.695 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:04:22.695 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:04:22.695 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:04:22.695 EAL: Ask a virtual area of 0x61000 bytes 00:04:22.695 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:04:22.695 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:22.695 EAL: Ask a virtual area of 0x400000000 bytes 00:04:22.695 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:04:22.695 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:04:22.695 EAL: Ask a virtual area of 0x61000 bytes 00:04:22.695 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:04:22.695 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:22.695 EAL: Ask a virtual area of 0x400000000 bytes 00:04:22.695 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:04:22.695 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:04:22.695 EAL: Ask a virtual area of 0x61000 bytes 00:04:22.695 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:04:22.695 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:22.695 EAL: Ask a virtual area of 0x400000000 bytes 00:04:22.695 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:04:22.695 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:04:22.695 EAL: Ask a virtual area of 0x61000 bytes 00:04:22.695 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:04:22.695 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:04:22.695 EAL: Ask a virtual area of 0x400000000 bytes 00:04:22.695 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:04:22.695 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:04:22.695 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:04:22.695 EAL: Ask a virtual area of 0x61000 bytes 00:04:22.695 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:04:22.695 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:22.695 EAL: Ask a virtual area of 0x400000000 bytes 00:04:22.695 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:04:22.695 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:04:22.695 EAL: Ask a virtual area of 0x61000 bytes 00:04:22.695 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:04:22.695 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:22.695 EAL: Ask a virtual area of 0x400000000 bytes 00:04:22.695 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:04:22.695 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:04:22.695 EAL: Ask a virtual area of 0x61000 bytes 00:04:22.695 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:04:22.695 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:22.695 EAL: Ask a virtual area of 0x400000000 bytes 00:04:22.695 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:04:22.695 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:04:22.695 EAL: Ask a virtual area of 0x61000 bytes 00:04:22.695 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:04:22.695 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:04:22.695 EAL: Ask a virtual area of 0x400000000 bytes 00:04:22.695 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:04:22.695 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:04:22.695 EAL: Hugepages will be freed exactly as allocated. 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: TSC frequency is ~2100000 KHz 00:04:22.695 EAL: Main lcore 0 is ready (tid=7f53a377ba00;cpuset=[0]) 00:04:22.695 EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.695 EAL: Restoring previous memory policy: 0 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was expanded by 2MB 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: No PCI address specified using 'addr=' in: bus=pci 00:04:22.695 EAL: Mem event callback 'spdk:(nil)' registered 00:04:22.695 00:04:22.695 00:04:22.695 CUnit - A unit testing framework for C - Version 2.1-3 00:04:22.695 http://cunit.sourceforge.net/ 00:04:22.695 00:04:22.695 00:04:22.695 Suite: components_suite 00:04:22.695 Test: vtophys_malloc_test ...passed 00:04:22.695 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.695 EAL: Restoring previous memory policy: 4 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was expanded by 4MB 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was shrunk by 4MB 00:04:22.695 EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.695 EAL: Restoring previous memory policy: 4 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was expanded by 6MB 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was shrunk by 6MB 00:04:22.695 EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.695 EAL: Restoring previous memory policy: 4 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was expanded by 10MB 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was shrunk by 10MB 00:04:22.695 EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.695 EAL: Restoring previous memory policy: 4 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was expanded by 18MB 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was shrunk by 18MB 00:04:22.695 EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.695 EAL: Restoring previous memory policy: 4 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was expanded by 34MB 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was shrunk by 34MB 00:04:22.695 EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.695 EAL: Restoring previous memory policy: 4 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was expanded by 66MB 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was shrunk by 66MB 00:04:22.695 EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.695 EAL: Restoring previous memory policy: 4 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was expanded by 130MB 00:04:22.695 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.695 EAL: request: mp_malloc_sync 00:04:22.695 EAL: No shared files mode enabled, IPC is disabled 00:04:22.695 EAL: Heap on socket 0 was shrunk by 130MB 00:04:22.695 EAL: Trying to obtain current memory policy. 00:04:22.695 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.955 EAL: Restoring previous memory policy: 4 00:04:22.955 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.955 EAL: request: mp_malloc_sync 00:04:22.955 EAL: No shared files mode enabled, IPC is disabled 00:04:22.955 EAL: Heap on socket 0 was expanded by 258MB 00:04:22.955 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.955 EAL: request: mp_malloc_sync 00:04:22.955 EAL: No shared files mode enabled, IPC is disabled 00:04:22.955 EAL: Heap on socket 0 was shrunk by 258MB 00:04:22.955 EAL: Trying to obtain current memory policy. 00:04:22.955 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:22.955 EAL: Restoring previous memory policy: 4 00:04:22.955 EAL: Calling mem event callback 'spdk:(nil)' 00:04:22.955 EAL: request: mp_malloc_sync 00:04:22.955 EAL: No shared files mode enabled, IPC is disabled 00:04:22.955 EAL: Heap on socket 0 was expanded by 514MB 00:04:22.955 EAL: Calling mem event callback 'spdk:(nil)' 00:04:23.214 EAL: request: mp_malloc_sync 00:04:23.214 EAL: No shared files mode enabled, IPC is disabled 00:04:23.214 EAL: Heap on socket 0 was shrunk by 514MB 00:04:23.214 EAL: Trying to obtain current memory policy. 00:04:23.214 EAL: Setting policy MPOL_PREFERRED for socket 0 00:04:23.473 EAL: Restoring previous memory policy: 4 00:04:23.473 EAL: Calling mem event callback 'spdk:(nil)' 00:04:23.473 EAL: request: mp_malloc_sync 00:04:23.473 EAL: No shared files mode enabled, IPC is disabled 00:04:23.473 EAL: Heap on socket 0 was expanded by 1026MB 00:04:23.473 EAL: Calling mem event callback 'spdk:(nil)' 00:04:23.732 EAL: request: mp_malloc_sync 00:04:23.732 EAL: No shared files mode enabled, IPC is disabled 00:04:23.732 EAL: Heap on socket 0 was shrunk by 1026MB 00:04:23.732 passed 00:04:23.732 00:04:23.732 Run Summary: Type Total Ran Passed Failed Inactive 00:04:23.732 suites 1 1 n/a 0 0 00:04:23.732 tests 2 2 2 0 0 00:04:23.732 asserts 497 497 497 0 n/a 00:04:23.732 00:04:23.732 Elapsed time = 0.958 seconds 00:04:23.732 EAL: Calling mem event callback 'spdk:(nil)' 00:04:23.732 EAL: request: mp_malloc_sync 00:04:23.732 EAL: No shared files mode enabled, IPC is disabled 00:04:23.732 EAL: Heap on socket 0 was shrunk by 2MB 00:04:23.732 EAL: No shared files mode enabled, IPC is disabled 00:04:23.732 EAL: No shared files mode enabled, IPC is disabled 00:04:23.732 EAL: No shared files mode enabled, IPC is disabled 00:04:23.732 00:04:23.732 real 0m1.077s 00:04:23.732 user 0m0.635s 00:04:23.732 sys 0m0.409s 00:04:23.732 14:08:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:23.732 14:08:38 -- common/autotest_common.sh@10 -- # set +x 00:04:23.732 ************************************ 00:04:23.732 END TEST env_vtophys 00:04:23.732 ************************************ 00:04:23.732 14:08:38 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:23.732 14:08:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:23.732 14:08:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.732 14:08:38 -- common/autotest_common.sh@10 -- # set +x 00:04:23.732 ************************************ 00:04:23.732 START TEST env_pci 00:04:23.732 ************************************ 00:04:23.732 14:08:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:04:23.732 00:04:23.732 00:04:23.732 CUnit - A unit testing framework for C - Version 2.1-3 00:04:23.732 http://cunit.sourceforge.net/ 00:04:23.732 00:04:23.732 00:04:23.732 Suite: pci 00:04:23.732 Test: pci_hook ...[2024-12-16 14:08:38.175155] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 192269 has claimed it 00:04:23.732 EAL: Cannot find device (10000:00:01.0) 00:04:23.732 EAL: Failed to attach device on primary process 00:04:23.732 passed 00:04:23.732 00:04:23.732 Run Summary: Type Total Ran Passed Failed Inactive 00:04:23.732 suites 1 1 n/a 0 0 00:04:23.732 tests 1 1 1 0 0 00:04:23.732 asserts 25 25 25 0 n/a 00:04:23.732 00:04:23.732 Elapsed time = 0.026 seconds 00:04:23.732 00:04:23.732 real 0m0.045s 00:04:23.732 user 0m0.012s 00:04:23.732 sys 0m0.032s 00:04:23.732 14:08:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:23.732 14:08:38 -- common/autotest_common.sh@10 -- # set +x 00:04:23.732 ************************************ 00:04:23.732 END TEST env_pci 00:04:23.732 ************************************ 00:04:23.732 14:08:38 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:04:23.732 14:08:38 -- env/env.sh@15 -- # uname 00:04:23.732 14:08:38 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:04:23.732 14:08:38 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:04:23.733 14:08:38 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:23.733 14:08:38 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:04:23.733 14:08:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:23.733 14:08:38 -- common/autotest_common.sh@10 -- # set +x 00:04:23.733 ************************************ 00:04:23.733 START TEST env_dpdk_post_init 00:04:23.733 ************************************ 00:04:23.733 14:08:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:04:23.733 EAL: Detected CPU lcores: 96 00:04:23.733 EAL: Detected NUMA nodes: 2 00:04:23.733 EAL: Detected shared linkage of DPDK 00:04:23.733 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:23.733 EAL: Selected IOVA mode 'VA' 00:04:23.733 EAL: No free 2048 kB hugepages reported on node 1 00:04:23.733 EAL: VFIO support initialized 00:04:23.733 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:23.992 EAL: Using IOMMU type 1 (Type 1) 00:04:23.992 EAL: Ignore mapping IO port bar(1) 00:04:23.992 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.0 (socket 0) 00:04:23.992 EAL: Ignore mapping IO port bar(1) 00:04:23.992 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.1 (socket 0) 00:04:23.992 EAL: Ignore mapping IO port bar(1) 00:04:23.992 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.2 (socket 0) 00:04:23.992 EAL: Ignore mapping IO port bar(1) 00:04:23.992 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.3 (socket 0) 00:04:23.992 EAL: Ignore mapping IO port bar(1) 00:04:23.992 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.4 (socket 0) 00:04:23.992 EAL: Ignore mapping IO port bar(1) 00:04:23.992 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.5 (socket 0) 00:04:23.992 EAL: Ignore mapping IO port bar(1) 00:04:23.992 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.6 (socket 0) 00:04:23.992 EAL: Ignore mapping IO port bar(1) 00:04:23.992 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:00:04.7 (socket 0) 00:04:24.929 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:5e:00.0 (socket 0) 00:04:24.929 EAL: Ignore mapping IO port bar(1) 00:04:24.929 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.0 (socket 1) 00:04:24.929 EAL: Ignore mapping IO port bar(1) 00:04:24.929 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.1 (socket 1) 00:04:24.929 EAL: Ignore mapping IO port bar(1) 00:04:24.929 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.2 (socket 1) 00:04:24.929 EAL: Ignore mapping IO port bar(1) 00:04:24.929 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.3 (socket 1) 00:04:24.929 EAL: Ignore mapping IO port bar(1) 00:04:24.929 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.4 (socket 1) 00:04:24.929 EAL: Ignore mapping IO port bar(1) 00:04:24.929 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.5 (socket 1) 00:04:24.929 EAL: Ignore mapping IO port bar(1) 00:04:24.929 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.6 (socket 1) 00:04:24.929 EAL: Ignore mapping IO port bar(1) 00:04:24.929 EAL: Probe PCI driver: spdk_ioat (8086:2021) device: 0000:80:04.7 (socket 1) 00:04:28.215 EAL: Releasing PCI mapped resource for 0000:5e:00.0 00:04:28.215 EAL: Calling pci_unmap_resource for 0000:5e:00.0 at 0x202001020000 00:04:28.215 Starting DPDK initialization... 00:04:28.215 Starting SPDK post initialization... 00:04:28.215 SPDK NVMe probe 00:04:28.215 Attaching to 0000:5e:00.0 00:04:28.215 Attached to 0000:5e:00.0 00:04:28.215 Cleaning up... 00:04:28.215 00:04:28.215 real 0m4.375s 00:04:28.215 user 0m3.309s 00:04:28.215 sys 0m0.141s 00:04:28.215 14:08:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.215 14:08:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.215 ************************************ 00:04:28.215 END TEST env_dpdk_post_init 00:04:28.215 ************************************ 00:04:28.215 14:08:42 -- env/env.sh@26 -- # uname 00:04:28.215 14:08:42 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:04:28.215 14:08:42 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:28.215 14:08:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.215 14:08:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.215 14:08:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.215 ************************************ 00:04:28.215 START TEST env_mem_callbacks 00:04:28.215 ************************************ 00:04:28.215 14:08:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:04:28.215 EAL: Detected CPU lcores: 96 00:04:28.215 EAL: Detected NUMA nodes: 2 00:04:28.215 EAL: Detected shared linkage of DPDK 00:04:28.215 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:04:28.215 EAL: Selected IOVA mode 'VA' 00:04:28.215 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.215 EAL: VFIO support initialized 00:04:28.215 TELEMETRY: No legacy callbacks, legacy socket not created 00:04:28.215 00:04:28.215 00:04:28.215 CUnit - A unit testing framework for C - Version 2.1-3 00:04:28.215 http://cunit.sourceforge.net/ 00:04:28.215 00:04:28.215 00:04:28.215 Suite: memory 00:04:28.215 Test: test ... 00:04:28.215 register 0x200000200000 2097152 00:04:28.215 malloc 3145728 00:04:28.215 register 0x200000400000 4194304 00:04:28.215 buf 0x200000500000 len 3145728 PASSED 00:04:28.215 malloc 64 00:04:28.215 buf 0x2000004fff40 len 64 PASSED 00:04:28.215 malloc 4194304 00:04:28.215 register 0x200000800000 6291456 00:04:28.215 buf 0x200000a00000 len 4194304 PASSED 00:04:28.215 free 0x200000500000 3145728 00:04:28.215 free 0x2000004fff40 64 00:04:28.215 unregister 0x200000400000 4194304 PASSED 00:04:28.215 free 0x200000a00000 4194304 00:04:28.215 unregister 0x200000800000 6291456 PASSED 00:04:28.215 malloc 8388608 00:04:28.215 register 0x200000400000 10485760 00:04:28.215 buf 0x200000600000 len 8388608 PASSED 00:04:28.215 free 0x200000600000 8388608 00:04:28.215 unregister 0x200000400000 10485760 PASSED 00:04:28.215 passed 00:04:28.215 00:04:28.215 Run Summary: Type Total Ran Passed Failed Inactive 00:04:28.215 suites 1 1 n/a 0 0 00:04:28.215 tests 1 1 1 0 0 00:04:28.215 asserts 15 15 15 0 n/a 00:04:28.215 00:04:28.215 Elapsed time = 0.005 seconds 00:04:28.215 00:04:28.215 real 0m0.050s 00:04:28.215 user 0m0.016s 00:04:28.215 sys 0m0.035s 00:04:28.215 14:08:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.215 14:08:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.215 ************************************ 00:04:28.215 END TEST env_mem_callbacks 00:04:28.215 ************************************ 00:04:28.215 00:04:28.215 real 0m6.065s 00:04:28.215 user 0m4.286s 00:04:28.215 sys 0m0.864s 00:04:28.215 14:08:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:28.215 14:08:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.215 ************************************ 00:04:28.215 END TEST env 00:04:28.215 ************************************ 00:04:28.215 14:08:42 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:28.215 14:08:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:28.215 14:08:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:28.215 14:08:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.215 ************************************ 00:04:28.215 START TEST rpc 00:04:28.215 ************************************ 00:04:28.215 14:08:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:04:28.474 * Looking for test storage... 00:04:28.474 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:28.474 14:08:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:28.474 14:08:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:28.474 14:08:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:28.474 14:08:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:28.474 14:08:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:28.474 14:08:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:28.474 14:08:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:28.474 14:08:42 -- scripts/common.sh@335 -- # IFS=.-: 00:04:28.474 14:08:42 -- scripts/common.sh@335 -- # read -ra ver1 00:04:28.474 14:08:42 -- scripts/common.sh@336 -- # IFS=.-: 00:04:28.474 14:08:42 -- scripts/common.sh@336 -- # read -ra ver2 00:04:28.474 14:08:42 -- scripts/common.sh@337 -- # local 'op=<' 00:04:28.474 14:08:42 -- scripts/common.sh@339 -- # ver1_l=2 00:04:28.474 14:08:42 -- scripts/common.sh@340 -- # ver2_l=1 00:04:28.474 14:08:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:28.474 14:08:42 -- scripts/common.sh@343 -- # case "$op" in 00:04:28.474 14:08:42 -- scripts/common.sh@344 -- # : 1 00:04:28.474 14:08:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:28.474 14:08:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:28.474 14:08:42 -- scripts/common.sh@364 -- # decimal 1 00:04:28.474 14:08:42 -- scripts/common.sh@352 -- # local d=1 00:04:28.474 14:08:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:28.474 14:08:42 -- scripts/common.sh@354 -- # echo 1 00:04:28.474 14:08:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:28.474 14:08:42 -- scripts/common.sh@365 -- # decimal 2 00:04:28.474 14:08:42 -- scripts/common.sh@352 -- # local d=2 00:04:28.474 14:08:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:28.474 14:08:42 -- scripts/common.sh@354 -- # echo 2 00:04:28.474 14:08:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:28.474 14:08:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:28.474 14:08:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:28.474 14:08:42 -- scripts/common.sh@367 -- # return 0 00:04:28.474 14:08:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:28.474 14:08:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:28.474 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.474 --rc genhtml_branch_coverage=1 00:04:28.474 --rc genhtml_function_coverage=1 00:04:28.474 --rc genhtml_legend=1 00:04:28.474 --rc geninfo_all_blocks=1 00:04:28.474 --rc geninfo_unexecuted_blocks=1 00:04:28.474 00:04:28.474 ' 00:04:28.474 14:08:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:28.474 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.474 --rc genhtml_branch_coverage=1 00:04:28.474 --rc genhtml_function_coverage=1 00:04:28.474 --rc genhtml_legend=1 00:04:28.474 --rc geninfo_all_blocks=1 00:04:28.474 --rc geninfo_unexecuted_blocks=1 00:04:28.474 00:04:28.474 ' 00:04:28.474 14:08:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:28.474 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.474 --rc genhtml_branch_coverage=1 00:04:28.474 --rc genhtml_function_coverage=1 00:04:28.474 --rc genhtml_legend=1 00:04:28.474 --rc geninfo_all_blocks=1 00:04:28.474 --rc geninfo_unexecuted_blocks=1 00:04:28.474 00:04:28.474 ' 00:04:28.474 14:08:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:28.474 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:28.474 --rc genhtml_branch_coverage=1 00:04:28.474 --rc genhtml_function_coverage=1 00:04:28.474 --rc genhtml_legend=1 00:04:28.474 --rc geninfo_all_blocks=1 00:04:28.474 --rc geninfo_unexecuted_blocks=1 00:04:28.474 00:04:28.474 ' 00:04:28.475 14:08:42 -- rpc/rpc.sh@65 -- # spdk_pid=193079 00:04:28.475 14:08:42 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:04:28.475 14:08:42 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:04:28.475 14:08:42 -- rpc/rpc.sh@67 -- # waitforlisten 193079 00:04:28.475 14:08:42 -- common/autotest_common.sh@829 -- # '[' -z 193079 ']' 00:04:28.475 14:08:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:28.475 14:08:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:28.475 14:08:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:28.475 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:28.475 14:08:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:28.475 14:08:42 -- common/autotest_common.sh@10 -- # set +x 00:04:28.475 [2024-12-16 14:08:42.978636] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:28.475 [2024-12-16 14:08:42.978685] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid193079 ] 00:04:28.475 EAL: No free 2048 kB hugepages reported on node 1 00:04:28.475 [2024-12-16 14:08:43.036452] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:28.734 [2024-12-16 14:08:43.109786] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:28.734 [2024-12-16 14:08:43.109920] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:04:28.734 [2024-12-16 14:08:43.109928] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 193079' to capture a snapshot of events at runtime. 00:04:28.734 [2024-12-16 14:08:43.109935] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid193079 for offline analysis/debug. 00:04:28.734 [2024-12-16 14:08:43.109953] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:29.301 14:08:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:29.301 14:08:43 -- common/autotest_common.sh@862 -- # return 0 00:04:29.301 14:08:43 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:29.301 14:08:43 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:04:29.301 14:08:43 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:04:29.301 14:08:43 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:04:29.301 14:08:43 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:29.301 14:08:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:29.301 14:08:43 -- common/autotest_common.sh@10 -- # set +x 00:04:29.301 ************************************ 00:04:29.301 START TEST rpc_integrity 00:04:29.301 ************************************ 00:04:29.301 14:08:43 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:29.301 14:08:43 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:29.301 14:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.301 14:08:43 -- common/autotest_common.sh@10 -- # set +x 00:04:29.301 14:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.301 14:08:43 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:29.301 14:08:43 -- rpc/rpc.sh@13 -- # jq length 00:04:29.301 14:08:43 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:29.301 14:08:43 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:29.301 14:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.301 14:08:43 -- common/autotest_common.sh@10 -- # set +x 00:04:29.301 14:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.301 14:08:43 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:04:29.301 14:08:43 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:29.301 14:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.301 14:08:43 -- common/autotest_common.sh@10 -- # set +x 00:04:29.301 14:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.301 14:08:43 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:29.301 { 00:04:29.301 "name": "Malloc0", 00:04:29.301 "aliases": [ 00:04:29.301 "ca2a2495-9083-4762-9815-f3001acfc204" 00:04:29.301 ], 00:04:29.301 "product_name": "Malloc disk", 00:04:29.301 "block_size": 512, 00:04:29.301 "num_blocks": 16384, 00:04:29.301 "uuid": "ca2a2495-9083-4762-9815-f3001acfc204", 00:04:29.301 "assigned_rate_limits": { 00:04:29.301 "rw_ios_per_sec": 0, 00:04:29.301 "rw_mbytes_per_sec": 0, 00:04:29.301 "r_mbytes_per_sec": 0, 00:04:29.301 "w_mbytes_per_sec": 0 00:04:29.301 }, 00:04:29.301 "claimed": false, 00:04:29.301 "zoned": false, 00:04:29.301 "supported_io_types": { 00:04:29.301 "read": true, 00:04:29.301 "write": true, 00:04:29.301 "unmap": true, 00:04:29.301 "write_zeroes": true, 00:04:29.301 "flush": true, 00:04:29.301 "reset": true, 00:04:29.301 "compare": false, 00:04:29.301 "compare_and_write": false, 00:04:29.301 "abort": true, 00:04:29.301 "nvme_admin": false, 00:04:29.301 "nvme_io": false 00:04:29.301 }, 00:04:29.301 "memory_domains": [ 00:04:29.302 { 00:04:29.302 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:29.302 "dma_device_type": 2 00:04:29.302 } 00:04:29.302 ], 00:04:29.302 "driver_specific": {} 00:04:29.302 } 00:04:29.302 ]' 00:04:29.302 14:08:43 -- rpc/rpc.sh@17 -- # jq length 00:04:29.561 14:08:43 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:29.561 14:08:43 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:04:29.561 14:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.561 14:08:43 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 [2024-12-16 14:08:43.917721] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:04:29.561 [2024-12-16 14:08:43.917751] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:29.561 [2024-12-16 14:08:43.917762] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1ee3750 00:04:29.561 [2024-12-16 14:08:43.917784] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:29.561 [2024-12-16 14:08:43.918841] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:29.561 [2024-12-16 14:08:43.918870] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:29.561 Passthru0 00:04:29.561 14:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.561 14:08:43 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:29.561 14:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.561 14:08:43 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 14:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.561 14:08:43 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:29.561 { 00:04:29.561 "name": "Malloc0", 00:04:29.561 "aliases": [ 00:04:29.561 "ca2a2495-9083-4762-9815-f3001acfc204" 00:04:29.561 ], 00:04:29.561 "product_name": "Malloc disk", 00:04:29.561 "block_size": 512, 00:04:29.561 "num_blocks": 16384, 00:04:29.561 "uuid": "ca2a2495-9083-4762-9815-f3001acfc204", 00:04:29.561 "assigned_rate_limits": { 00:04:29.561 "rw_ios_per_sec": 0, 00:04:29.561 "rw_mbytes_per_sec": 0, 00:04:29.561 "r_mbytes_per_sec": 0, 00:04:29.561 "w_mbytes_per_sec": 0 00:04:29.561 }, 00:04:29.561 "claimed": true, 00:04:29.561 "claim_type": "exclusive_write", 00:04:29.561 "zoned": false, 00:04:29.561 "supported_io_types": { 00:04:29.561 "read": true, 00:04:29.561 "write": true, 00:04:29.561 "unmap": true, 00:04:29.561 "write_zeroes": true, 00:04:29.561 "flush": true, 00:04:29.561 "reset": true, 00:04:29.561 "compare": false, 00:04:29.561 "compare_and_write": false, 00:04:29.561 "abort": true, 00:04:29.561 "nvme_admin": false, 00:04:29.561 "nvme_io": false 00:04:29.561 }, 00:04:29.561 "memory_domains": [ 00:04:29.561 { 00:04:29.561 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:29.561 "dma_device_type": 2 00:04:29.561 } 00:04:29.561 ], 00:04:29.561 "driver_specific": {} 00:04:29.561 }, 00:04:29.561 { 00:04:29.561 "name": "Passthru0", 00:04:29.561 "aliases": [ 00:04:29.561 "514c822b-9482-5fa8-be7b-db3be10d3478" 00:04:29.561 ], 00:04:29.561 "product_name": "passthru", 00:04:29.561 "block_size": 512, 00:04:29.561 "num_blocks": 16384, 00:04:29.561 "uuid": "514c822b-9482-5fa8-be7b-db3be10d3478", 00:04:29.561 "assigned_rate_limits": { 00:04:29.561 "rw_ios_per_sec": 0, 00:04:29.561 "rw_mbytes_per_sec": 0, 00:04:29.561 "r_mbytes_per_sec": 0, 00:04:29.561 "w_mbytes_per_sec": 0 00:04:29.561 }, 00:04:29.561 "claimed": false, 00:04:29.561 "zoned": false, 00:04:29.561 "supported_io_types": { 00:04:29.561 "read": true, 00:04:29.561 "write": true, 00:04:29.561 "unmap": true, 00:04:29.561 "write_zeroes": true, 00:04:29.561 "flush": true, 00:04:29.561 "reset": true, 00:04:29.561 "compare": false, 00:04:29.561 "compare_and_write": false, 00:04:29.561 "abort": true, 00:04:29.561 "nvme_admin": false, 00:04:29.561 "nvme_io": false 00:04:29.561 }, 00:04:29.561 "memory_domains": [ 00:04:29.561 { 00:04:29.561 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:29.561 "dma_device_type": 2 00:04:29.561 } 00:04:29.561 ], 00:04:29.561 "driver_specific": { 00:04:29.561 "passthru": { 00:04:29.561 "name": "Passthru0", 00:04:29.561 "base_bdev_name": "Malloc0" 00:04:29.561 } 00:04:29.561 } 00:04:29.561 } 00:04:29.561 ]' 00:04:29.561 14:08:43 -- rpc/rpc.sh@21 -- # jq length 00:04:29.561 14:08:43 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:29.561 14:08:43 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:29.561 14:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.561 14:08:43 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 14:08:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.561 14:08:43 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:04:29.561 14:08:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.561 14:08:43 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.561 14:08:44 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:29.561 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.561 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.561 14:08:44 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:29.561 14:08:44 -- rpc/rpc.sh@26 -- # jq length 00:04:29.561 14:08:44 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:29.561 00:04:29.561 real 0m0.266s 00:04:29.561 user 0m0.157s 00:04:29.561 sys 0m0.039s 00:04:29.561 14:08:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:29.561 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 ************************************ 00:04:29.561 END TEST rpc_integrity 00:04:29.561 ************************************ 00:04:29.561 14:08:44 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:04:29.561 14:08:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:29.561 14:08:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:29.561 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 ************************************ 00:04:29.561 START TEST rpc_plugins 00:04:29.561 ************************************ 00:04:29.561 14:08:44 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:04:29.561 14:08:44 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:04:29.561 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.561 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.561 14:08:44 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:04:29.561 14:08:44 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:04:29.561 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.561 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.561 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.561 14:08:44 -- rpc/rpc.sh@31 -- # bdevs='[ 00:04:29.561 { 00:04:29.561 "name": "Malloc1", 00:04:29.561 "aliases": [ 00:04:29.561 "8d3fb2fb-dcb2-48da-81f3-23b2b04ed333" 00:04:29.561 ], 00:04:29.561 "product_name": "Malloc disk", 00:04:29.561 "block_size": 4096, 00:04:29.561 "num_blocks": 256, 00:04:29.561 "uuid": "8d3fb2fb-dcb2-48da-81f3-23b2b04ed333", 00:04:29.561 "assigned_rate_limits": { 00:04:29.561 "rw_ios_per_sec": 0, 00:04:29.561 "rw_mbytes_per_sec": 0, 00:04:29.561 "r_mbytes_per_sec": 0, 00:04:29.561 "w_mbytes_per_sec": 0 00:04:29.561 }, 00:04:29.561 "claimed": false, 00:04:29.561 "zoned": false, 00:04:29.561 "supported_io_types": { 00:04:29.561 "read": true, 00:04:29.561 "write": true, 00:04:29.561 "unmap": true, 00:04:29.561 "write_zeroes": true, 00:04:29.561 "flush": true, 00:04:29.561 "reset": true, 00:04:29.561 "compare": false, 00:04:29.561 "compare_and_write": false, 00:04:29.561 "abort": true, 00:04:29.561 "nvme_admin": false, 00:04:29.561 "nvme_io": false 00:04:29.561 }, 00:04:29.562 "memory_domains": [ 00:04:29.562 { 00:04:29.562 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:29.562 "dma_device_type": 2 00:04:29.562 } 00:04:29.562 ], 00:04:29.562 "driver_specific": {} 00:04:29.562 } 00:04:29.562 ]' 00:04:29.562 14:08:44 -- rpc/rpc.sh@32 -- # jq length 00:04:29.820 14:08:44 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:04:29.820 14:08:44 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:04:29.820 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.820 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.820 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.821 14:08:44 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:04:29.821 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.821 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.821 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.821 14:08:44 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:04:29.821 14:08:44 -- rpc/rpc.sh@36 -- # jq length 00:04:29.821 14:08:44 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:04:29.821 00:04:29.821 real 0m0.123s 00:04:29.821 user 0m0.078s 00:04:29.821 sys 0m0.014s 00:04:29.821 14:08:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:29.821 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.821 ************************************ 00:04:29.821 END TEST rpc_plugins 00:04:29.821 ************************************ 00:04:29.821 14:08:44 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:04:29.821 14:08:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:29.821 14:08:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:29.821 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.821 ************************************ 00:04:29.821 START TEST rpc_trace_cmd_test 00:04:29.821 ************************************ 00:04:29.821 14:08:44 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:04:29.821 14:08:44 -- rpc/rpc.sh@40 -- # local info 00:04:29.821 14:08:44 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:04:29.821 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:29.821 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:29.821 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:29.821 14:08:44 -- rpc/rpc.sh@42 -- # info='{ 00:04:29.821 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid193079", 00:04:29.821 "tpoint_group_mask": "0x8", 00:04:29.821 "iscsi_conn": { 00:04:29.821 "mask": "0x2", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "scsi": { 00:04:29.821 "mask": "0x4", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "bdev": { 00:04:29.821 "mask": "0x8", 00:04:29.821 "tpoint_mask": "0xffffffffffffffff" 00:04:29.821 }, 00:04:29.821 "nvmf_rdma": { 00:04:29.821 "mask": "0x10", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "nvmf_tcp": { 00:04:29.821 "mask": "0x20", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "ftl": { 00:04:29.821 "mask": "0x40", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "blobfs": { 00:04:29.821 "mask": "0x80", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "dsa": { 00:04:29.821 "mask": "0x200", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "thread": { 00:04:29.821 "mask": "0x400", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "nvme_pcie": { 00:04:29.821 "mask": "0x800", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "iaa": { 00:04:29.821 "mask": "0x1000", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "nvme_tcp": { 00:04:29.821 "mask": "0x2000", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 }, 00:04:29.821 "bdev_nvme": { 00:04:29.821 "mask": "0x4000", 00:04:29.821 "tpoint_mask": "0x0" 00:04:29.821 } 00:04:29.821 }' 00:04:29.821 14:08:44 -- rpc/rpc.sh@43 -- # jq length 00:04:29.821 14:08:44 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:04:29.821 14:08:44 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:04:29.821 14:08:44 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:04:29.821 14:08:44 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:04:30.080 14:08:44 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:04:30.080 14:08:44 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:04:30.080 14:08:44 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:04:30.080 14:08:44 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:04:30.080 14:08:44 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:04:30.080 00:04:30.080 real 0m0.213s 00:04:30.080 user 0m0.180s 00:04:30.080 sys 0m0.026s 00:04:30.080 14:08:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.080 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.080 ************************************ 00:04:30.080 END TEST rpc_trace_cmd_test 00:04:30.080 ************************************ 00:04:30.080 14:08:44 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:04:30.080 14:08:44 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:04:30.080 14:08:44 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:04:30.080 14:08:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.080 14:08:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.080 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.080 ************************************ 00:04:30.080 START TEST rpc_daemon_integrity 00:04:30.080 ************************************ 00:04:30.080 14:08:44 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:04:30.080 14:08:44 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:04:30.080 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:30.080 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.080 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:30.080 14:08:44 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:04:30.080 14:08:44 -- rpc/rpc.sh@13 -- # jq length 00:04:30.080 14:08:44 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:04:30.080 14:08:44 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:04:30.080 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:30.080 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.080 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:30.080 14:08:44 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:04:30.080 14:08:44 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:04:30.080 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:30.080 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.080 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:30.080 14:08:44 -- rpc/rpc.sh@16 -- # bdevs='[ 00:04:30.080 { 00:04:30.080 "name": "Malloc2", 00:04:30.080 "aliases": [ 00:04:30.080 "cbced9a0-cbb5-425c-af9a-3e20bcb88155" 00:04:30.080 ], 00:04:30.080 "product_name": "Malloc disk", 00:04:30.080 "block_size": 512, 00:04:30.080 "num_blocks": 16384, 00:04:30.080 "uuid": "cbced9a0-cbb5-425c-af9a-3e20bcb88155", 00:04:30.080 "assigned_rate_limits": { 00:04:30.080 "rw_ios_per_sec": 0, 00:04:30.080 "rw_mbytes_per_sec": 0, 00:04:30.080 "r_mbytes_per_sec": 0, 00:04:30.080 "w_mbytes_per_sec": 0 00:04:30.080 }, 00:04:30.080 "claimed": false, 00:04:30.080 "zoned": false, 00:04:30.080 "supported_io_types": { 00:04:30.080 "read": true, 00:04:30.080 "write": true, 00:04:30.080 "unmap": true, 00:04:30.080 "write_zeroes": true, 00:04:30.080 "flush": true, 00:04:30.080 "reset": true, 00:04:30.080 "compare": false, 00:04:30.080 "compare_and_write": false, 00:04:30.080 "abort": true, 00:04:30.080 "nvme_admin": false, 00:04:30.080 "nvme_io": false 00:04:30.080 }, 00:04:30.080 "memory_domains": [ 00:04:30.080 { 00:04:30.080 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:30.080 "dma_device_type": 2 00:04:30.080 } 00:04:30.080 ], 00:04:30.080 "driver_specific": {} 00:04:30.080 } 00:04:30.080 ]' 00:04:30.080 14:08:44 -- rpc/rpc.sh@17 -- # jq length 00:04:30.080 14:08:44 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:04:30.080 14:08:44 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:04:30.080 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:30.080 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.080 [2024-12-16 14:08:44.631665] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:04:30.080 [2024-12-16 14:08:44.631694] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:04:30.080 [2024-12-16 14:08:44.631705] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x2083430 00:04:30.080 [2024-12-16 14:08:44.631711] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:04:30.080 [2024-12-16 14:08:44.632651] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:04:30.080 [2024-12-16 14:08:44.632669] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:04:30.080 Passthru0 00:04:30.080 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:30.080 14:08:44 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:04:30.080 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:30.080 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.339 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:30.339 14:08:44 -- rpc/rpc.sh@20 -- # bdevs='[ 00:04:30.339 { 00:04:30.339 "name": "Malloc2", 00:04:30.339 "aliases": [ 00:04:30.339 "cbced9a0-cbb5-425c-af9a-3e20bcb88155" 00:04:30.339 ], 00:04:30.339 "product_name": "Malloc disk", 00:04:30.339 "block_size": 512, 00:04:30.339 "num_blocks": 16384, 00:04:30.339 "uuid": "cbced9a0-cbb5-425c-af9a-3e20bcb88155", 00:04:30.339 "assigned_rate_limits": { 00:04:30.339 "rw_ios_per_sec": 0, 00:04:30.339 "rw_mbytes_per_sec": 0, 00:04:30.339 "r_mbytes_per_sec": 0, 00:04:30.339 "w_mbytes_per_sec": 0 00:04:30.339 }, 00:04:30.339 "claimed": true, 00:04:30.339 "claim_type": "exclusive_write", 00:04:30.339 "zoned": false, 00:04:30.339 "supported_io_types": { 00:04:30.339 "read": true, 00:04:30.339 "write": true, 00:04:30.339 "unmap": true, 00:04:30.339 "write_zeroes": true, 00:04:30.339 "flush": true, 00:04:30.339 "reset": true, 00:04:30.339 "compare": false, 00:04:30.339 "compare_and_write": false, 00:04:30.339 "abort": true, 00:04:30.339 "nvme_admin": false, 00:04:30.339 "nvme_io": false 00:04:30.339 }, 00:04:30.339 "memory_domains": [ 00:04:30.339 { 00:04:30.339 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:30.339 "dma_device_type": 2 00:04:30.339 } 00:04:30.339 ], 00:04:30.339 "driver_specific": {} 00:04:30.339 }, 00:04:30.339 { 00:04:30.339 "name": "Passthru0", 00:04:30.339 "aliases": [ 00:04:30.339 "4a5beab0-5e85-5fbf-a8ab-de1c7cfc13b6" 00:04:30.339 ], 00:04:30.339 "product_name": "passthru", 00:04:30.339 "block_size": 512, 00:04:30.339 "num_blocks": 16384, 00:04:30.339 "uuid": "4a5beab0-5e85-5fbf-a8ab-de1c7cfc13b6", 00:04:30.339 "assigned_rate_limits": { 00:04:30.339 "rw_ios_per_sec": 0, 00:04:30.339 "rw_mbytes_per_sec": 0, 00:04:30.339 "r_mbytes_per_sec": 0, 00:04:30.339 "w_mbytes_per_sec": 0 00:04:30.339 }, 00:04:30.339 "claimed": false, 00:04:30.339 "zoned": false, 00:04:30.339 "supported_io_types": { 00:04:30.339 "read": true, 00:04:30.339 "write": true, 00:04:30.339 "unmap": true, 00:04:30.339 "write_zeroes": true, 00:04:30.339 "flush": true, 00:04:30.339 "reset": true, 00:04:30.339 "compare": false, 00:04:30.339 "compare_and_write": false, 00:04:30.339 "abort": true, 00:04:30.339 "nvme_admin": false, 00:04:30.339 "nvme_io": false 00:04:30.339 }, 00:04:30.339 "memory_domains": [ 00:04:30.339 { 00:04:30.339 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:04:30.339 "dma_device_type": 2 00:04:30.339 } 00:04:30.339 ], 00:04:30.339 "driver_specific": { 00:04:30.339 "passthru": { 00:04:30.339 "name": "Passthru0", 00:04:30.339 "base_bdev_name": "Malloc2" 00:04:30.339 } 00:04:30.339 } 00:04:30.339 } 00:04:30.339 ]' 00:04:30.339 14:08:44 -- rpc/rpc.sh@21 -- # jq length 00:04:30.339 14:08:44 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:04:30.339 14:08:44 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:04:30.339 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:30.339 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.339 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:30.339 14:08:44 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:04:30.339 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:30.339 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.339 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:30.339 14:08:44 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:04:30.339 14:08:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:30.339 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.339 14:08:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:30.339 14:08:44 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:04:30.339 14:08:44 -- rpc/rpc.sh@26 -- # jq length 00:04:30.339 14:08:44 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:04:30.339 00:04:30.339 real 0m0.264s 00:04:30.339 user 0m0.165s 00:04:30.339 sys 0m0.029s 00:04:30.339 14:08:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.339 14:08:44 -- common/autotest_common.sh@10 -- # set +x 00:04:30.339 ************************************ 00:04:30.339 END TEST rpc_daemon_integrity 00:04:30.339 ************************************ 00:04:30.339 14:08:44 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:04:30.339 14:08:44 -- rpc/rpc.sh@84 -- # killprocess 193079 00:04:30.339 14:08:44 -- common/autotest_common.sh@936 -- # '[' -z 193079 ']' 00:04:30.339 14:08:44 -- common/autotest_common.sh@940 -- # kill -0 193079 00:04:30.339 14:08:44 -- common/autotest_common.sh@941 -- # uname 00:04:30.339 14:08:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:30.339 14:08:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 193079 00:04:30.339 14:08:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:30.339 14:08:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:30.339 14:08:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 193079' 00:04:30.339 killing process with pid 193079 00:04:30.339 14:08:44 -- common/autotest_common.sh@955 -- # kill 193079 00:04:30.339 14:08:44 -- common/autotest_common.sh@960 -- # wait 193079 00:04:30.907 00:04:30.907 real 0m2.404s 00:04:30.907 user 0m3.046s 00:04:30.907 sys 0m0.603s 00:04:30.907 14:08:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.907 14:08:45 -- common/autotest_common.sh@10 -- # set +x 00:04:30.907 ************************************ 00:04:30.907 END TEST rpc 00:04:30.907 ************************************ 00:04:30.907 14:08:45 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:30.907 14:08:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.907 14:08:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.907 14:08:45 -- common/autotest_common.sh@10 -- # set +x 00:04:30.907 ************************************ 00:04:30.907 START TEST rpc_client 00:04:30.907 ************************************ 00:04:30.907 14:08:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:04:30.907 * Looking for test storage... 00:04:30.907 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:04:30.907 14:08:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:30.907 14:08:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:30.907 14:08:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:30.907 14:08:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:30.907 14:08:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:30.907 14:08:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:30.907 14:08:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:30.907 14:08:45 -- scripts/common.sh@335 -- # IFS=.-: 00:04:30.907 14:08:45 -- scripts/common.sh@335 -- # read -ra ver1 00:04:30.907 14:08:45 -- scripts/common.sh@336 -- # IFS=.-: 00:04:30.907 14:08:45 -- scripts/common.sh@336 -- # read -ra ver2 00:04:30.907 14:08:45 -- scripts/common.sh@337 -- # local 'op=<' 00:04:30.907 14:08:45 -- scripts/common.sh@339 -- # ver1_l=2 00:04:30.907 14:08:45 -- scripts/common.sh@340 -- # ver2_l=1 00:04:30.907 14:08:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:30.907 14:08:45 -- scripts/common.sh@343 -- # case "$op" in 00:04:30.907 14:08:45 -- scripts/common.sh@344 -- # : 1 00:04:30.907 14:08:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:30.907 14:08:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:30.907 14:08:45 -- scripts/common.sh@364 -- # decimal 1 00:04:30.907 14:08:45 -- scripts/common.sh@352 -- # local d=1 00:04:30.907 14:08:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:30.907 14:08:45 -- scripts/common.sh@354 -- # echo 1 00:04:30.907 14:08:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:30.907 14:08:45 -- scripts/common.sh@365 -- # decimal 2 00:04:30.907 14:08:45 -- scripts/common.sh@352 -- # local d=2 00:04:30.907 14:08:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:30.907 14:08:45 -- scripts/common.sh@354 -- # echo 2 00:04:30.907 14:08:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:30.907 14:08:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:30.907 14:08:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:30.907 14:08:45 -- scripts/common.sh@367 -- # return 0 00:04:30.907 14:08:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:30.907 14:08:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:30.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.907 --rc genhtml_branch_coverage=1 00:04:30.907 --rc genhtml_function_coverage=1 00:04:30.907 --rc genhtml_legend=1 00:04:30.907 --rc geninfo_all_blocks=1 00:04:30.907 --rc geninfo_unexecuted_blocks=1 00:04:30.907 00:04:30.907 ' 00:04:30.907 14:08:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:30.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.907 --rc genhtml_branch_coverage=1 00:04:30.907 --rc genhtml_function_coverage=1 00:04:30.907 --rc genhtml_legend=1 00:04:30.907 --rc geninfo_all_blocks=1 00:04:30.907 --rc geninfo_unexecuted_blocks=1 00:04:30.907 00:04:30.907 ' 00:04:30.907 14:08:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:30.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.907 --rc genhtml_branch_coverage=1 00:04:30.907 --rc genhtml_function_coverage=1 00:04:30.907 --rc genhtml_legend=1 00:04:30.907 --rc geninfo_all_blocks=1 00:04:30.907 --rc geninfo_unexecuted_blocks=1 00:04:30.907 00:04:30.907 ' 00:04:30.907 14:08:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:30.907 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:30.907 --rc genhtml_branch_coverage=1 00:04:30.907 --rc genhtml_function_coverage=1 00:04:30.907 --rc genhtml_legend=1 00:04:30.907 --rc geninfo_all_blocks=1 00:04:30.907 --rc geninfo_unexecuted_blocks=1 00:04:30.907 00:04:30.907 ' 00:04:30.907 14:08:45 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:04:30.907 OK 00:04:30.907 14:08:45 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:04:30.907 00:04:30.907 real 0m0.184s 00:04:30.907 user 0m0.105s 00:04:30.907 sys 0m0.092s 00:04:30.907 14:08:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:30.907 14:08:45 -- common/autotest_common.sh@10 -- # set +x 00:04:30.907 ************************************ 00:04:30.907 END TEST rpc_client 00:04:30.907 ************************************ 00:04:30.907 14:08:45 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:30.907 14:08:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.907 14:08:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.907 14:08:45 -- common/autotest_common.sh@10 -- # set +x 00:04:30.907 ************************************ 00:04:30.907 START TEST json_config 00:04:30.907 ************************************ 00:04:30.907 14:08:45 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:04:31.167 14:08:45 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:31.167 14:08:45 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:31.167 14:08:45 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:31.167 14:08:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:31.167 14:08:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:31.167 14:08:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:31.167 14:08:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:31.167 14:08:45 -- scripts/common.sh@335 -- # IFS=.-: 00:04:31.167 14:08:45 -- scripts/common.sh@335 -- # read -ra ver1 00:04:31.167 14:08:45 -- scripts/common.sh@336 -- # IFS=.-: 00:04:31.167 14:08:45 -- scripts/common.sh@336 -- # read -ra ver2 00:04:31.167 14:08:45 -- scripts/common.sh@337 -- # local 'op=<' 00:04:31.167 14:08:45 -- scripts/common.sh@339 -- # ver1_l=2 00:04:31.167 14:08:45 -- scripts/common.sh@340 -- # ver2_l=1 00:04:31.167 14:08:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:31.167 14:08:45 -- scripts/common.sh@343 -- # case "$op" in 00:04:31.167 14:08:45 -- scripts/common.sh@344 -- # : 1 00:04:31.167 14:08:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:31.167 14:08:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:31.167 14:08:45 -- scripts/common.sh@364 -- # decimal 1 00:04:31.167 14:08:45 -- scripts/common.sh@352 -- # local d=1 00:04:31.167 14:08:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:31.167 14:08:45 -- scripts/common.sh@354 -- # echo 1 00:04:31.167 14:08:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:31.167 14:08:45 -- scripts/common.sh@365 -- # decimal 2 00:04:31.167 14:08:45 -- scripts/common.sh@352 -- # local d=2 00:04:31.167 14:08:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:31.167 14:08:45 -- scripts/common.sh@354 -- # echo 2 00:04:31.167 14:08:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:31.167 14:08:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:31.167 14:08:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:31.167 14:08:45 -- scripts/common.sh@367 -- # return 0 00:04:31.167 14:08:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:31.167 14:08:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:31.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.167 --rc genhtml_branch_coverage=1 00:04:31.167 --rc genhtml_function_coverage=1 00:04:31.167 --rc genhtml_legend=1 00:04:31.167 --rc geninfo_all_blocks=1 00:04:31.167 --rc geninfo_unexecuted_blocks=1 00:04:31.167 00:04:31.167 ' 00:04:31.167 14:08:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:31.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.167 --rc genhtml_branch_coverage=1 00:04:31.167 --rc genhtml_function_coverage=1 00:04:31.167 --rc genhtml_legend=1 00:04:31.167 --rc geninfo_all_blocks=1 00:04:31.167 --rc geninfo_unexecuted_blocks=1 00:04:31.167 00:04:31.167 ' 00:04:31.167 14:08:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:31.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.167 --rc genhtml_branch_coverage=1 00:04:31.167 --rc genhtml_function_coverage=1 00:04:31.167 --rc genhtml_legend=1 00:04:31.167 --rc geninfo_all_blocks=1 00:04:31.167 --rc geninfo_unexecuted_blocks=1 00:04:31.167 00:04:31.167 ' 00:04:31.167 14:08:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:31.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:31.167 --rc genhtml_branch_coverage=1 00:04:31.167 --rc genhtml_function_coverage=1 00:04:31.167 --rc genhtml_legend=1 00:04:31.167 --rc geninfo_all_blocks=1 00:04:31.167 --rc geninfo_unexecuted_blocks=1 00:04:31.167 00:04:31.167 ' 00:04:31.167 14:08:45 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:31.167 14:08:45 -- nvmf/common.sh@7 -- # uname -s 00:04:31.167 14:08:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:31.167 14:08:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:31.167 14:08:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:31.167 14:08:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:31.167 14:08:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:31.167 14:08:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:31.167 14:08:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:31.167 14:08:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:31.167 14:08:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:31.167 14:08:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:31.167 14:08:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:04:31.167 14:08:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:04:31.167 14:08:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:31.167 14:08:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:31.167 14:08:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:31.167 14:08:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:31.167 14:08:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:31.167 14:08:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:31.167 14:08:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:31.167 14:08:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:31.167 14:08:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:31.167 14:08:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:31.167 14:08:45 -- paths/export.sh@5 -- # export PATH 00:04:31.167 14:08:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:31.167 14:08:45 -- nvmf/common.sh@46 -- # : 0 00:04:31.167 14:08:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:31.167 14:08:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:31.167 14:08:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:31.167 14:08:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:31.167 14:08:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:31.167 14:08:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:31.167 14:08:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:31.167 14:08:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:31.167 14:08:45 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:04:31.167 14:08:45 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:04:31.167 14:08:45 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:04:31.167 14:08:45 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:04:31.167 14:08:45 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:04:31.167 14:08:45 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:04:31.167 14:08:45 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:04:31.167 14:08:45 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:04:31.167 14:08:45 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:04:31.167 14:08:45 -- json_config/json_config.sh@32 -- # declare -A app_params 00:04:31.167 14:08:45 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:04:31.167 14:08:45 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:04:31.167 14:08:45 -- json_config/json_config.sh@43 -- # last_event_id=0 00:04:31.167 14:08:45 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:31.167 14:08:45 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:04:31.167 INFO: JSON configuration test init 00:04:31.167 14:08:45 -- json_config/json_config.sh@420 -- # json_config_test_init 00:04:31.167 14:08:45 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:04:31.167 14:08:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:31.167 14:08:45 -- common/autotest_common.sh@10 -- # set +x 00:04:31.167 14:08:45 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:04:31.167 14:08:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:31.167 14:08:45 -- common/autotest_common.sh@10 -- # set +x 00:04:31.167 14:08:45 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:04:31.167 14:08:45 -- json_config/json_config.sh@98 -- # local app=target 00:04:31.167 14:08:45 -- json_config/json_config.sh@99 -- # shift 00:04:31.167 14:08:45 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:31.167 14:08:45 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:31.167 14:08:45 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:31.167 14:08:45 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:31.167 14:08:45 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:31.168 14:08:45 -- json_config/json_config.sh@111 -- # app_pid[$app]=193761 00:04:31.168 14:08:45 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:31.168 Waiting for target to run... 00:04:31.168 14:08:45 -- json_config/json_config.sh@114 -- # waitforlisten 193761 /var/tmp/spdk_tgt.sock 00:04:31.168 14:08:45 -- common/autotest_common.sh@829 -- # '[' -z 193761 ']' 00:04:31.168 14:08:45 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:04:31.168 14:08:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:31.168 14:08:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:31.168 14:08:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:31.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:31.168 14:08:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:31.168 14:08:45 -- common/autotest_common.sh@10 -- # set +x 00:04:31.168 [2024-12-16 14:08:45.671806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:31.168 [2024-12-16 14:08:45.671868] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid193761 ] 00:04:31.168 EAL: No free 2048 kB hugepages reported on node 1 00:04:31.427 [2024-12-16 14:08:45.949571] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:31.684 [2024-12-16 14:08:46.014383] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:31.684 [2024-12-16 14:08:46.014482] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:31.943 14:08:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:31.943 14:08:46 -- common/autotest_common.sh@862 -- # return 0 00:04:31.943 14:08:46 -- json_config/json_config.sh@115 -- # echo '' 00:04:31.943 00:04:31.943 14:08:46 -- json_config/json_config.sh@322 -- # create_accel_config 00:04:31.943 14:08:46 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:04:31.943 14:08:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:31.943 14:08:46 -- common/autotest_common.sh@10 -- # set +x 00:04:31.943 14:08:46 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:04:31.943 14:08:46 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:04:31.943 14:08:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:31.943 14:08:46 -- common/autotest_common.sh@10 -- # set +x 00:04:32.203 14:08:46 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:04:32.203 14:08:46 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:04:32.203 14:08:46 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:04:35.488 14:08:49 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:04:35.488 14:08:49 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:04:35.488 14:08:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:35.488 14:08:49 -- common/autotest_common.sh@10 -- # set +x 00:04:35.489 14:08:49 -- json_config/json_config.sh@48 -- # local ret=0 00:04:35.489 14:08:49 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:04:35.489 14:08:49 -- json_config/json_config.sh@49 -- # local enabled_types 00:04:35.489 14:08:49 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:04:35.489 14:08:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:04:35.489 14:08:49 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:04:35.489 14:08:49 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:04:35.489 14:08:49 -- json_config/json_config.sh@51 -- # local get_types 00:04:35.489 14:08:49 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:04:35.489 14:08:49 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:04:35.489 14:08:49 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:35.489 14:08:49 -- common/autotest_common.sh@10 -- # set +x 00:04:35.489 14:08:49 -- json_config/json_config.sh@58 -- # return 0 00:04:35.489 14:08:49 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:04:35.489 14:08:49 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:04:35.489 14:08:49 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:04:35.489 14:08:49 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:04:35.489 14:08:49 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:04:35.489 14:08:49 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:04:35.489 14:08:49 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:35.489 14:08:49 -- common/autotest_common.sh@10 -- # set +x 00:04:35.489 14:08:49 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:04:35.489 14:08:49 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:04:35.489 14:08:49 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:04:35.489 14:08:49 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:35.489 14:08:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:04:35.489 MallocForNvmf0 00:04:35.489 14:08:49 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:35.489 14:08:49 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:04:35.747 MallocForNvmf1 00:04:35.747 14:08:50 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:04:35.747 14:08:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:04:36.004 [2024-12-16 14:08:50.340821] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:36.004 14:08:50 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:36.004 14:08:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:04:36.004 14:08:50 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:36.004 14:08:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:04:36.262 14:08:50 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:36.262 14:08:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:04:36.521 14:08:50 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:36.521 14:08:50 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:04:36.521 [2024-12-16 14:08:51.034975] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:36.521 14:08:51 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:04:36.521 14:08:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:36.521 14:08:51 -- common/autotest_common.sh@10 -- # set +x 00:04:36.521 14:08:51 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:04:36.521 14:08:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:36.521 14:08:51 -- common/autotest_common.sh@10 -- # set +x 00:04:36.779 14:08:51 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:04:36.779 14:08:51 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:36.779 14:08:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:04:36.779 MallocBdevForConfigChangeCheck 00:04:36.779 14:08:51 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:04:36.779 14:08:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:36.779 14:08:51 -- common/autotest_common.sh@10 -- # set +x 00:04:36.779 14:08:51 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:04:36.779 14:08:51 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:37.345 14:08:51 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:04:37.346 INFO: shutting down applications... 00:04:37.346 14:08:51 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:04:37.346 14:08:51 -- json_config/json_config.sh@431 -- # json_config_clear target 00:04:37.346 14:08:51 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:04:37.346 14:08:51 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:04:38.720 Calling clear_iscsi_subsystem 00:04:38.720 Calling clear_nvmf_subsystem 00:04:38.720 Calling clear_nbd_subsystem 00:04:38.720 Calling clear_ublk_subsystem 00:04:38.720 Calling clear_vhost_blk_subsystem 00:04:38.720 Calling clear_vhost_scsi_subsystem 00:04:38.720 Calling clear_scheduler_subsystem 00:04:38.720 Calling clear_bdev_subsystem 00:04:38.720 Calling clear_accel_subsystem 00:04:38.720 Calling clear_vmd_subsystem 00:04:38.720 Calling clear_sock_subsystem 00:04:38.720 Calling clear_iobuf_subsystem 00:04:38.720 14:08:53 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:04:38.720 14:08:53 -- json_config/json_config.sh@396 -- # count=100 00:04:38.720 14:08:53 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:04:38.720 14:08:53 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:38.720 14:08:53 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:04:38.720 14:08:53 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:04:38.979 14:08:53 -- json_config/json_config.sh@398 -- # break 00:04:38.979 14:08:53 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:04:38.979 14:08:53 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:04:38.979 14:08:53 -- json_config/json_config.sh@120 -- # local app=target 00:04:38.979 14:08:53 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:04:38.979 14:08:53 -- json_config/json_config.sh@124 -- # [[ -n 193761 ]] 00:04:38.979 14:08:53 -- json_config/json_config.sh@127 -- # kill -SIGINT 193761 00:04:38.979 14:08:53 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:04:38.979 14:08:53 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:38.979 14:08:53 -- json_config/json_config.sh@130 -- # kill -0 193761 00:04:38.979 14:08:53 -- json_config/json_config.sh@134 -- # sleep 0.5 00:04:39.547 14:08:53 -- json_config/json_config.sh@129 -- # (( i++ )) 00:04:39.547 14:08:53 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:04:39.547 14:08:53 -- json_config/json_config.sh@130 -- # kill -0 193761 00:04:39.547 14:08:53 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:04:39.547 14:08:53 -- json_config/json_config.sh@132 -- # break 00:04:39.547 14:08:53 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:04:39.547 14:08:53 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:04:39.547 SPDK target shutdown done 00:04:39.547 14:08:53 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:04:39.547 INFO: relaunching applications... 00:04:39.547 14:08:53 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:39.547 14:08:53 -- json_config/json_config.sh@98 -- # local app=target 00:04:39.547 14:08:53 -- json_config/json_config.sh@99 -- # shift 00:04:39.547 14:08:53 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:04:39.547 14:08:53 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:04:39.547 14:08:53 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:04:39.547 14:08:53 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:39.547 14:08:53 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:04:39.547 14:08:53 -- json_config/json_config.sh@111 -- # app_pid[$app]=195395 00:04:39.547 14:08:53 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:04:39.547 Waiting for target to run... 00:04:39.547 14:08:53 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:39.547 14:08:53 -- json_config/json_config.sh@114 -- # waitforlisten 195395 /var/tmp/spdk_tgt.sock 00:04:39.547 14:08:53 -- common/autotest_common.sh@829 -- # '[' -z 195395 ']' 00:04:39.547 14:08:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:39.547 14:08:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:39.547 14:08:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:39.547 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:39.547 14:08:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:39.547 14:08:53 -- common/autotest_common.sh@10 -- # set +x 00:04:39.547 [2024-12-16 14:08:54.011314] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:39.547 [2024-12-16 14:08:54.011366] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid195395 ] 00:04:39.547 EAL: No free 2048 kB hugepages reported on node 1 00:04:40.114 [2024-12-16 14:08:54.448283] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:40.114 [2024-12-16 14:08:54.537457] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:40.114 [2024-12-16 14:08:54.537571] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:43.478 [2024-12-16 14:08:57.538451] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:04:43.478 [2024-12-16 14:08:57.570731] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:04:43.737 14:08:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:43.737 14:08:58 -- common/autotest_common.sh@862 -- # return 0 00:04:43.737 14:08:58 -- json_config/json_config.sh@115 -- # echo '' 00:04:43.737 00:04:43.737 14:08:58 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:04:43.737 14:08:58 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:04:43.737 INFO: Checking if target configuration is the same... 00:04:43.737 14:08:58 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:04:43.737 14:08:58 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:43.737 14:08:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:43.737 + '[' 2 -ne 2 ']' 00:04:43.737 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:43.737 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:43.737 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:43.737 +++ basename /dev/fd/62 00:04:43.737 ++ mktemp /tmp/62.XXX 00:04:43.737 + tmp_file_1=/tmp/62.iIN 00:04:43.737 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:43.737 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:43.737 + tmp_file_2=/tmp/spdk_tgt_config.json.Opo 00:04:43.737 + ret=0 00:04:43.737 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:43.995 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:43.995 + diff -u /tmp/62.iIN /tmp/spdk_tgt_config.json.Opo 00:04:43.995 + echo 'INFO: JSON config files are the same' 00:04:43.995 INFO: JSON config files are the same 00:04:43.995 + rm /tmp/62.iIN /tmp/spdk_tgt_config.json.Opo 00:04:43.995 + exit 0 00:04:43.995 14:08:58 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:04:43.995 14:08:58 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:04:43.995 INFO: changing configuration and checking if this can be detected... 00:04:43.995 14:08:58 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:43.995 14:08:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:04:44.253 14:08:58 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:04:44.253 14:08:58 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:04:44.253 14:08:58 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:44.253 + '[' 2 -ne 2 ']' 00:04:44.253 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:04:44.253 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:04:44.253 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:04:44.253 +++ basename /dev/fd/62 00:04:44.253 ++ mktemp /tmp/62.XXX 00:04:44.253 + tmp_file_1=/tmp/62.0Iv 00:04:44.253 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:44.253 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:04:44.253 + tmp_file_2=/tmp/spdk_tgt_config.json.uMk 00:04:44.253 + ret=0 00:04:44.253 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:44.512 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:04:44.512 + diff -u /tmp/62.0Iv /tmp/spdk_tgt_config.json.uMk 00:04:44.512 + ret=1 00:04:44.512 + echo '=== Start of file: /tmp/62.0Iv ===' 00:04:44.512 + cat /tmp/62.0Iv 00:04:44.512 + echo '=== End of file: /tmp/62.0Iv ===' 00:04:44.512 + echo '' 00:04:44.512 + echo '=== Start of file: /tmp/spdk_tgt_config.json.uMk ===' 00:04:44.512 + cat /tmp/spdk_tgt_config.json.uMk 00:04:44.512 + echo '=== End of file: /tmp/spdk_tgt_config.json.uMk ===' 00:04:44.512 + echo '' 00:04:44.512 + rm /tmp/62.0Iv /tmp/spdk_tgt_config.json.uMk 00:04:44.512 + exit 1 00:04:44.512 14:08:59 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:04:44.512 INFO: configuration change detected. 00:04:44.512 14:08:59 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:04:44.512 14:08:59 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:04:44.512 14:08:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:44.512 14:08:59 -- common/autotest_common.sh@10 -- # set +x 00:04:44.512 14:08:59 -- json_config/json_config.sh@360 -- # local ret=0 00:04:44.512 14:08:59 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:04:44.512 14:08:59 -- json_config/json_config.sh@370 -- # [[ -n 195395 ]] 00:04:44.512 14:08:59 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:04:44.512 14:08:59 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:04:44.512 14:08:59 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:44.512 14:08:59 -- common/autotest_common.sh@10 -- # set +x 00:04:44.512 14:08:59 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:04:44.512 14:08:59 -- json_config/json_config.sh@246 -- # uname -s 00:04:44.512 14:08:59 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:04:44.512 14:08:59 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:04:44.512 14:08:59 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:04:44.512 14:08:59 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:04:44.512 14:08:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:44.512 14:08:59 -- common/autotest_common.sh@10 -- # set +x 00:04:44.771 14:08:59 -- json_config/json_config.sh@376 -- # killprocess 195395 00:04:44.771 14:08:59 -- common/autotest_common.sh@936 -- # '[' -z 195395 ']' 00:04:44.771 14:08:59 -- common/autotest_common.sh@940 -- # kill -0 195395 00:04:44.771 14:08:59 -- common/autotest_common.sh@941 -- # uname 00:04:44.771 14:08:59 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:44.771 14:08:59 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 195395 00:04:44.771 14:08:59 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:44.771 14:08:59 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:44.771 14:08:59 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 195395' 00:04:44.771 killing process with pid 195395 00:04:44.771 14:08:59 -- common/autotest_common.sh@955 -- # kill 195395 00:04:44.771 14:08:59 -- common/autotest_common.sh@960 -- # wait 195395 00:04:46.146 14:09:00 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:04:46.146 14:09:00 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:04:46.146 14:09:00 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:46.146 14:09:00 -- common/autotest_common.sh@10 -- # set +x 00:04:46.146 14:09:00 -- json_config/json_config.sh@381 -- # return 0 00:04:46.146 14:09:00 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:04:46.146 INFO: Success 00:04:46.146 00:04:46.146 real 0m15.272s 00:04:46.146 user 0m16.637s 00:04:46.146 sys 0m1.911s 00:04:46.146 14:09:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.146 14:09:00 -- common/autotest_common.sh@10 -- # set +x 00:04:46.146 ************************************ 00:04:46.146 END TEST json_config 00:04:46.146 ************************************ 00:04:46.406 14:09:00 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:46.406 14:09:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.406 14:09:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.406 14:09:00 -- common/autotest_common.sh@10 -- # set +x 00:04:46.406 ************************************ 00:04:46.406 START TEST json_config_extra_key 00:04:46.406 ************************************ 00:04:46.406 14:09:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:04:46.406 14:09:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:46.406 14:09:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:46.406 14:09:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:46.406 14:09:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:46.406 14:09:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:46.406 14:09:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:46.406 14:09:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:46.406 14:09:00 -- scripts/common.sh@335 -- # IFS=.-: 00:04:46.406 14:09:00 -- scripts/common.sh@335 -- # read -ra ver1 00:04:46.406 14:09:00 -- scripts/common.sh@336 -- # IFS=.-: 00:04:46.406 14:09:00 -- scripts/common.sh@336 -- # read -ra ver2 00:04:46.406 14:09:00 -- scripts/common.sh@337 -- # local 'op=<' 00:04:46.406 14:09:00 -- scripts/common.sh@339 -- # ver1_l=2 00:04:46.406 14:09:00 -- scripts/common.sh@340 -- # ver2_l=1 00:04:46.406 14:09:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:46.406 14:09:00 -- scripts/common.sh@343 -- # case "$op" in 00:04:46.406 14:09:00 -- scripts/common.sh@344 -- # : 1 00:04:46.406 14:09:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:46.406 14:09:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:46.406 14:09:00 -- scripts/common.sh@364 -- # decimal 1 00:04:46.406 14:09:00 -- scripts/common.sh@352 -- # local d=1 00:04:46.406 14:09:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:46.406 14:09:00 -- scripts/common.sh@354 -- # echo 1 00:04:46.406 14:09:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:46.406 14:09:00 -- scripts/common.sh@365 -- # decimal 2 00:04:46.406 14:09:00 -- scripts/common.sh@352 -- # local d=2 00:04:46.406 14:09:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:46.406 14:09:00 -- scripts/common.sh@354 -- # echo 2 00:04:46.406 14:09:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:46.406 14:09:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:46.406 14:09:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:46.406 14:09:00 -- scripts/common.sh@367 -- # return 0 00:04:46.406 14:09:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:46.406 14:09:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:46.406 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.406 --rc genhtml_branch_coverage=1 00:04:46.406 --rc genhtml_function_coverage=1 00:04:46.406 --rc genhtml_legend=1 00:04:46.406 --rc geninfo_all_blocks=1 00:04:46.406 --rc geninfo_unexecuted_blocks=1 00:04:46.406 00:04:46.406 ' 00:04:46.406 14:09:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:46.406 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.406 --rc genhtml_branch_coverage=1 00:04:46.406 --rc genhtml_function_coverage=1 00:04:46.406 --rc genhtml_legend=1 00:04:46.406 --rc geninfo_all_blocks=1 00:04:46.406 --rc geninfo_unexecuted_blocks=1 00:04:46.406 00:04:46.406 ' 00:04:46.406 14:09:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:46.406 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.406 --rc genhtml_branch_coverage=1 00:04:46.406 --rc genhtml_function_coverage=1 00:04:46.406 --rc genhtml_legend=1 00:04:46.406 --rc geninfo_all_blocks=1 00:04:46.406 --rc geninfo_unexecuted_blocks=1 00:04:46.406 00:04:46.406 ' 00:04:46.406 14:09:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:46.406 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:46.406 --rc genhtml_branch_coverage=1 00:04:46.406 --rc genhtml_function_coverage=1 00:04:46.406 --rc genhtml_legend=1 00:04:46.406 --rc geninfo_all_blocks=1 00:04:46.406 --rc geninfo_unexecuted_blocks=1 00:04:46.406 00:04:46.406 ' 00:04:46.406 14:09:00 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:04:46.406 14:09:00 -- nvmf/common.sh@7 -- # uname -s 00:04:46.406 14:09:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:04:46.406 14:09:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:04:46.406 14:09:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:04:46.406 14:09:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:04:46.406 14:09:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:04:46.406 14:09:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:04:46.406 14:09:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:04:46.406 14:09:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:04:46.406 14:09:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:04:46.406 14:09:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:04:46.406 14:09:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:04:46.406 14:09:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:04:46.406 14:09:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:04:46.406 14:09:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:04:46.406 14:09:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:04:46.406 14:09:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:04:46.406 14:09:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:04:46.406 14:09:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:04:46.406 14:09:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:04:46.406 14:09:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:46.406 14:09:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:46.407 14:09:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:46.407 14:09:00 -- paths/export.sh@5 -- # export PATH 00:04:46.407 14:09:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:04:46.407 14:09:00 -- nvmf/common.sh@46 -- # : 0 00:04:46.407 14:09:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:04:46.407 14:09:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:04:46.407 14:09:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:04:46.407 14:09:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:04:46.407 14:09:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:04:46.407 14:09:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:04:46.407 14:09:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:04:46.407 14:09:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:04:46.407 INFO: launching applications... 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@25 -- # shift 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=196796 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:04:46.407 Waiting for target to run... 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 196796 /var/tmp/spdk_tgt.sock 00:04:46.407 14:09:00 -- common/autotest_common.sh@829 -- # '[' -z 196796 ']' 00:04:46.407 14:09:00 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:04:46.407 14:09:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:04:46.407 14:09:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:46.407 14:09:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:04:46.407 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:04:46.407 14:09:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:46.407 14:09:00 -- common/autotest_common.sh@10 -- # set +x 00:04:46.407 [2024-12-16 14:09:00.965979] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:46.407 [2024-12-16 14:09:00.966029] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid196796 ] 00:04:46.666 EAL: No free 2048 kB hugepages reported on node 1 00:04:46.666 [2024-12-16 14:09:01.228327] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:46.925 [2024-12-16 14:09:01.293647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:46.925 [2024-12-16 14:09:01.293745] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:47.191 14:09:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:47.191 14:09:01 -- common/autotest_common.sh@862 -- # return 0 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:04:47.191 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:04:47.191 INFO: shutting down applications... 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 196796 ]] 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 196796 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@50 -- # kill -0 196796 00:04:47.191 14:09:01 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:04:47.756 14:09:02 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:04:47.756 14:09:02 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:04:47.756 14:09:02 -- json_config/json_config_extra_key.sh@50 -- # kill -0 196796 00:04:47.756 14:09:02 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:04:47.756 14:09:02 -- json_config/json_config_extra_key.sh@52 -- # break 00:04:47.756 14:09:02 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:04:47.756 14:09:02 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:04:47.756 SPDK target shutdown done 00:04:47.756 14:09:02 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:04:47.756 Success 00:04:47.756 00:04:47.756 real 0m1.518s 00:04:47.756 user 0m1.335s 00:04:47.756 sys 0m0.368s 00:04:47.756 14:09:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:47.756 14:09:02 -- common/autotest_common.sh@10 -- # set +x 00:04:47.756 ************************************ 00:04:47.756 END TEST json_config_extra_key 00:04:47.756 ************************************ 00:04:47.756 14:09:02 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:47.756 14:09:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:47.756 14:09:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:47.756 14:09:02 -- common/autotest_common.sh@10 -- # set +x 00:04:47.756 ************************************ 00:04:47.756 START TEST alias_rpc 00:04:47.756 ************************************ 00:04:47.756 14:09:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:04:48.015 * Looking for test storage... 00:04:48.015 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:04:48.015 14:09:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:48.015 14:09:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:48.015 14:09:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:48.015 14:09:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:48.015 14:09:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:48.015 14:09:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:48.015 14:09:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:48.015 14:09:02 -- scripts/common.sh@335 -- # IFS=.-: 00:04:48.015 14:09:02 -- scripts/common.sh@335 -- # read -ra ver1 00:04:48.015 14:09:02 -- scripts/common.sh@336 -- # IFS=.-: 00:04:48.015 14:09:02 -- scripts/common.sh@336 -- # read -ra ver2 00:04:48.015 14:09:02 -- scripts/common.sh@337 -- # local 'op=<' 00:04:48.015 14:09:02 -- scripts/common.sh@339 -- # ver1_l=2 00:04:48.015 14:09:02 -- scripts/common.sh@340 -- # ver2_l=1 00:04:48.015 14:09:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:48.015 14:09:02 -- scripts/common.sh@343 -- # case "$op" in 00:04:48.015 14:09:02 -- scripts/common.sh@344 -- # : 1 00:04:48.015 14:09:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:48.015 14:09:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:48.015 14:09:02 -- scripts/common.sh@364 -- # decimal 1 00:04:48.015 14:09:02 -- scripts/common.sh@352 -- # local d=1 00:04:48.015 14:09:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:48.015 14:09:02 -- scripts/common.sh@354 -- # echo 1 00:04:48.015 14:09:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:48.015 14:09:02 -- scripts/common.sh@365 -- # decimal 2 00:04:48.015 14:09:02 -- scripts/common.sh@352 -- # local d=2 00:04:48.015 14:09:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:48.015 14:09:02 -- scripts/common.sh@354 -- # echo 2 00:04:48.015 14:09:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:48.015 14:09:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:48.015 14:09:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:48.015 14:09:02 -- scripts/common.sh@367 -- # return 0 00:04:48.015 14:09:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:48.015 14:09:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:48.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.015 --rc genhtml_branch_coverage=1 00:04:48.015 --rc genhtml_function_coverage=1 00:04:48.015 --rc genhtml_legend=1 00:04:48.015 --rc geninfo_all_blocks=1 00:04:48.015 --rc geninfo_unexecuted_blocks=1 00:04:48.015 00:04:48.015 ' 00:04:48.015 14:09:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:48.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.015 --rc genhtml_branch_coverage=1 00:04:48.015 --rc genhtml_function_coverage=1 00:04:48.015 --rc genhtml_legend=1 00:04:48.015 --rc geninfo_all_blocks=1 00:04:48.015 --rc geninfo_unexecuted_blocks=1 00:04:48.015 00:04:48.015 ' 00:04:48.015 14:09:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:48.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.015 --rc genhtml_branch_coverage=1 00:04:48.015 --rc genhtml_function_coverage=1 00:04:48.015 --rc genhtml_legend=1 00:04:48.015 --rc geninfo_all_blocks=1 00:04:48.015 --rc geninfo_unexecuted_blocks=1 00:04:48.015 00:04:48.015 ' 00:04:48.015 14:09:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:48.015 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:48.015 --rc genhtml_branch_coverage=1 00:04:48.015 --rc genhtml_function_coverage=1 00:04:48.015 --rc genhtml_legend=1 00:04:48.015 --rc geninfo_all_blocks=1 00:04:48.015 --rc geninfo_unexecuted_blocks=1 00:04:48.015 00:04:48.015 ' 00:04:48.015 14:09:02 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:04:48.015 14:09:02 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=197147 00:04:48.015 14:09:02 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 197147 00:04:48.015 14:09:02 -- common/autotest_common.sh@829 -- # '[' -z 197147 ']' 00:04:48.015 14:09:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:48.015 14:09:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:48.015 14:09:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:48.015 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:48.015 14:09:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:48.015 14:09:02 -- common/autotest_common.sh@10 -- # set +x 00:04:48.015 14:09:02 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:48.015 [2024-12-16 14:09:02.511227] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:48.015 [2024-12-16 14:09:02.511279] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid197147 ] 00:04:48.015 EAL: No free 2048 kB hugepages reported on node 1 00:04:48.015 [2024-12-16 14:09:02.564857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:48.274 [2024-12-16 14:09:02.641169] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:48.274 [2024-12-16 14:09:02.641279] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:48.841 14:09:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:48.841 14:09:03 -- common/autotest_common.sh@862 -- # return 0 00:04:48.841 14:09:03 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:04:49.099 14:09:03 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 197147 00:04:49.099 14:09:03 -- common/autotest_common.sh@936 -- # '[' -z 197147 ']' 00:04:49.099 14:09:03 -- common/autotest_common.sh@940 -- # kill -0 197147 00:04:49.099 14:09:03 -- common/autotest_common.sh@941 -- # uname 00:04:49.099 14:09:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:49.099 14:09:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 197147 00:04:49.099 14:09:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:49.099 14:09:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:49.099 14:09:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 197147' 00:04:49.099 killing process with pid 197147 00:04:49.099 14:09:03 -- common/autotest_common.sh@955 -- # kill 197147 00:04:49.099 14:09:03 -- common/autotest_common.sh@960 -- # wait 197147 00:04:49.358 00:04:49.358 real 0m1.583s 00:04:49.358 user 0m1.740s 00:04:49.358 sys 0m0.386s 00:04:49.358 14:09:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.358 14:09:03 -- common/autotest_common.sh@10 -- # set +x 00:04:49.358 ************************************ 00:04:49.358 END TEST alias_rpc 00:04:49.358 ************************************ 00:04:49.358 14:09:03 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:04:49.358 14:09:03 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:49.358 14:09:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.358 14:09:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.358 14:09:03 -- common/autotest_common.sh@10 -- # set +x 00:04:49.358 ************************************ 00:04:49.358 START TEST spdkcli_tcp 00:04:49.358 ************************************ 00:04:49.358 14:09:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:04:49.617 * Looking for test storage... 00:04:49.617 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:04:49.617 14:09:04 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:49.617 14:09:04 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:49.617 14:09:04 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:49.617 14:09:04 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:49.617 14:09:04 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:49.617 14:09:04 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:49.617 14:09:04 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:49.617 14:09:04 -- scripts/common.sh@335 -- # IFS=.-: 00:04:49.617 14:09:04 -- scripts/common.sh@335 -- # read -ra ver1 00:04:49.617 14:09:04 -- scripts/common.sh@336 -- # IFS=.-: 00:04:49.617 14:09:04 -- scripts/common.sh@336 -- # read -ra ver2 00:04:49.617 14:09:04 -- scripts/common.sh@337 -- # local 'op=<' 00:04:49.617 14:09:04 -- scripts/common.sh@339 -- # ver1_l=2 00:04:49.617 14:09:04 -- scripts/common.sh@340 -- # ver2_l=1 00:04:49.617 14:09:04 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:49.617 14:09:04 -- scripts/common.sh@343 -- # case "$op" in 00:04:49.617 14:09:04 -- scripts/common.sh@344 -- # : 1 00:04:49.617 14:09:04 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:49.617 14:09:04 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:49.617 14:09:04 -- scripts/common.sh@364 -- # decimal 1 00:04:49.617 14:09:04 -- scripts/common.sh@352 -- # local d=1 00:04:49.617 14:09:04 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:49.617 14:09:04 -- scripts/common.sh@354 -- # echo 1 00:04:49.617 14:09:04 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:49.617 14:09:04 -- scripts/common.sh@365 -- # decimal 2 00:04:49.617 14:09:04 -- scripts/common.sh@352 -- # local d=2 00:04:49.617 14:09:04 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:49.617 14:09:04 -- scripts/common.sh@354 -- # echo 2 00:04:49.617 14:09:04 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:49.617 14:09:04 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:49.617 14:09:04 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:49.617 14:09:04 -- scripts/common.sh@367 -- # return 0 00:04:49.617 14:09:04 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:49.617 14:09:04 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:49.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.617 --rc genhtml_branch_coverage=1 00:04:49.617 --rc genhtml_function_coverage=1 00:04:49.617 --rc genhtml_legend=1 00:04:49.617 --rc geninfo_all_blocks=1 00:04:49.617 --rc geninfo_unexecuted_blocks=1 00:04:49.617 00:04:49.617 ' 00:04:49.617 14:09:04 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:49.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.617 --rc genhtml_branch_coverage=1 00:04:49.617 --rc genhtml_function_coverage=1 00:04:49.617 --rc genhtml_legend=1 00:04:49.617 --rc geninfo_all_blocks=1 00:04:49.617 --rc geninfo_unexecuted_blocks=1 00:04:49.617 00:04:49.617 ' 00:04:49.617 14:09:04 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:49.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.617 --rc genhtml_branch_coverage=1 00:04:49.617 --rc genhtml_function_coverage=1 00:04:49.617 --rc genhtml_legend=1 00:04:49.617 --rc geninfo_all_blocks=1 00:04:49.617 --rc geninfo_unexecuted_blocks=1 00:04:49.617 00:04:49.617 ' 00:04:49.617 14:09:04 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:49.617 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.617 --rc genhtml_branch_coverage=1 00:04:49.617 --rc genhtml_function_coverage=1 00:04:49.617 --rc genhtml_legend=1 00:04:49.617 --rc geninfo_all_blocks=1 00:04:49.617 --rc geninfo_unexecuted_blocks=1 00:04:49.617 00:04:49.617 ' 00:04:49.617 14:09:04 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:04:49.617 14:09:04 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:04:49.617 14:09:04 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:04:49.617 14:09:04 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:04:49.617 14:09:04 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:04:49.617 14:09:04 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:04:49.617 14:09:04 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:04:49.617 14:09:04 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:49.617 14:09:04 -- common/autotest_common.sh@10 -- # set +x 00:04:49.617 14:09:04 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:04:49.617 14:09:04 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=197438 00:04:49.617 14:09:04 -- spdkcli/tcp.sh@27 -- # waitforlisten 197438 00:04:49.617 14:09:04 -- common/autotest_common.sh@829 -- # '[' -z 197438 ']' 00:04:49.617 14:09:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:49.617 14:09:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:49.617 14:09:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:49.617 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:49.617 14:09:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:49.617 14:09:04 -- common/autotest_common.sh@10 -- # set +x 00:04:49.617 [2024-12-16 14:09:04.139110] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:49.617 [2024-12-16 14:09:04.139156] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid197438 ] 00:04:49.617 EAL: No free 2048 kB hugepages reported on node 1 00:04:49.875 [2024-12-16 14:09:04.194382] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:04:49.875 [2024-12-16 14:09:04.263960] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:49.875 [2024-12-16 14:09:04.264125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:49.875 [2024-12-16 14:09:04.264127] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:50.442 14:09:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:50.442 14:09:04 -- common/autotest_common.sh@862 -- # return 0 00:04:50.442 14:09:04 -- spdkcli/tcp.sh@31 -- # socat_pid=197669 00:04:50.442 14:09:04 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:04:50.442 14:09:04 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:04:50.699 [ 00:04:50.699 "bdev_malloc_delete", 00:04:50.699 "bdev_malloc_create", 00:04:50.699 "bdev_null_resize", 00:04:50.699 "bdev_null_delete", 00:04:50.699 "bdev_null_create", 00:04:50.699 "bdev_nvme_cuse_unregister", 00:04:50.699 "bdev_nvme_cuse_register", 00:04:50.699 "bdev_opal_new_user", 00:04:50.699 "bdev_opal_set_lock_state", 00:04:50.699 "bdev_opal_delete", 00:04:50.699 "bdev_opal_get_info", 00:04:50.699 "bdev_opal_create", 00:04:50.699 "bdev_nvme_opal_revert", 00:04:50.699 "bdev_nvme_opal_init", 00:04:50.699 "bdev_nvme_send_cmd", 00:04:50.699 "bdev_nvme_get_path_iostat", 00:04:50.699 "bdev_nvme_get_mdns_discovery_info", 00:04:50.699 "bdev_nvme_stop_mdns_discovery", 00:04:50.700 "bdev_nvme_start_mdns_discovery", 00:04:50.700 "bdev_nvme_set_multipath_policy", 00:04:50.700 "bdev_nvme_set_preferred_path", 00:04:50.700 "bdev_nvme_get_io_paths", 00:04:50.700 "bdev_nvme_remove_error_injection", 00:04:50.700 "bdev_nvme_add_error_injection", 00:04:50.700 "bdev_nvme_get_discovery_info", 00:04:50.700 "bdev_nvme_stop_discovery", 00:04:50.700 "bdev_nvme_start_discovery", 00:04:50.700 "bdev_nvme_get_controller_health_info", 00:04:50.700 "bdev_nvme_disable_controller", 00:04:50.700 "bdev_nvme_enable_controller", 00:04:50.700 "bdev_nvme_reset_controller", 00:04:50.700 "bdev_nvme_get_transport_statistics", 00:04:50.700 "bdev_nvme_apply_firmware", 00:04:50.700 "bdev_nvme_detach_controller", 00:04:50.700 "bdev_nvme_get_controllers", 00:04:50.700 "bdev_nvme_attach_controller", 00:04:50.700 "bdev_nvme_set_hotplug", 00:04:50.700 "bdev_nvme_set_options", 00:04:50.700 "bdev_passthru_delete", 00:04:50.700 "bdev_passthru_create", 00:04:50.700 "bdev_lvol_grow_lvstore", 00:04:50.700 "bdev_lvol_get_lvols", 00:04:50.700 "bdev_lvol_get_lvstores", 00:04:50.700 "bdev_lvol_delete", 00:04:50.700 "bdev_lvol_set_read_only", 00:04:50.700 "bdev_lvol_resize", 00:04:50.700 "bdev_lvol_decouple_parent", 00:04:50.700 "bdev_lvol_inflate", 00:04:50.700 "bdev_lvol_rename", 00:04:50.700 "bdev_lvol_clone_bdev", 00:04:50.700 "bdev_lvol_clone", 00:04:50.700 "bdev_lvol_snapshot", 00:04:50.700 "bdev_lvol_create", 00:04:50.700 "bdev_lvol_delete_lvstore", 00:04:50.700 "bdev_lvol_rename_lvstore", 00:04:50.700 "bdev_lvol_create_lvstore", 00:04:50.700 "bdev_raid_set_options", 00:04:50.700 "bdev_raid_remove_base_bdev", 00:04:50.700 "bdev_raid_add_base_bdev", 00:04:50.700 "bdev_raid_delete", 00:04:50.700 "bdev_raid_create", 00:04:50.700 "bdev_raid_get_bdevs", 00:04:50.700 "bdev_error_inject_error", 00:04:50.700 "bdev_error_delete", 00:04:50.700 "bdev_error_create", 00:04:50.700 "bdev_split_delete", 00:04:50.700 "bdev_split_create", 00:04:50.700 "bdev_delay_delete", 00:04:50.700 "bdev_delay_create", 00:04:50.700 "bdev_delay_update_latency", 00:04:50.700 "bdev_zone_block_delete", 00:04:50.700 "bdev_zone_block_create", 00:04:50.700 "blobfs_create", 00:04:50.700 "blobfs_detect", 00:04:50.700 "blobfs_set_cache_size", 00:04:50.700 "bdev_aio_delete", 00:04:50.700 "bdev_aio_rescan", 00:04:50.700 "bdev_aio_create", 00:04:50.700 "bdev_ftl_set_property", 00:04:50.700 "bdev_ftl_get_properties", 00:04:50.700 "bdev_ftl_get_stats", 00:04:50.700 "bdev_ftl_unmap", 00:04:50.700 "bdev_ftl_unload", 00:04:50.700 "bdev_ftl_delete", 00:04:50.700 "bdev_ftl_load", 00:04:50.700 "bdev_ftl_create", 00:04:50.700 "bdev_virtio_attach_controller", 00:04:50.700 "bdev_virtio_scsi_get_devices", 00:04:50.700 "bdev_virtio_detach_controller", 00:04:50.700 "bdev_virtio_blk_set_hotplug", 00:04:50.700 "bdev_iscsi_delete", 00:04:50.700 "bdev_iscsi_create", 00:04:50.700 "bdev_iscsi_set_options", 00:04:50.700 "accel_error_inject_error", 00:04:50.700 "ioat_scan_accel_module", 00:04:50.700 "dsa_scan_accel_module", 00:04:50.700 "iaa_scan_accel_module", 00:04:50.700 "iscsi_set_options", 00:04:50.700 "iscsi_get_auth_groups", 00:04:50.700 "iscsi_auth_group_remove_secret", 00:04:50.700 "iscsi_auth_group_add_secret", 00:04:50.700 "iscsi_delete_auth_group", 00:04:50.700 "iscsi_create_auth_group", 00:04:50.700 "iscsi_set_discovery_auth", 00:04:50.700 "iscsi_get_options", 00:04:50.700 "iscsi_target_node_request_logout", 00:04:50.700 "iscsi_target_node_set_redirect", 00:04:50.700 "iscsi_target_node_set_auth", 00:04:50.700 "iscsi_target_node_add_lun", 00:04:50.700 "iscsi_get_connections", 00:04:50.700 "iscsi_portal_group_set_auth", 00:04:50.700 "iscsi_start_portal_group", 00:04:50.700 "iscsi_delete_portal_group", 00:04:50.700 "iscsi_create_portal_group", 00:04:50.700 "iscsi_get_portal_groups", 00:04:50.700 "iscsi_delete_target_node", 00:04:50.700 "iscsi_target_node_remove_pg_ig_maps", 00:04:50.700 "iscsi_target_node_add_pg_ig_maps", 00:04:50.700 "iscsi_create_target_node", 00:04:50.700 "iscsi_get_target_nodes", 00:04:50.700 "iscsi_delete_initiator_group", 00:04:50.700 "iscsi_initiator_group_remove_initiators", 00:04:50.700 "iscsi_initiator_group_add_initiators", 00:04:50.700 "iscsi_create_initiator_group", 00:04:50.700 "iscsi_get_initiator_groups", 00:04:50.700 "nvmf_set_crdt", 00:04:50.700 "nvmf_set_config", 00:04:50.700 "nvmf_set_max_subsystems", 00:04:50.700 "nvmf_subsystem_get_listeners", 00:04:50.700 "nvmf_subsystem_get_qpairs", 00:04:50.700 "nvmf_subsystem_get_controllers", 00:04:50.700 "nvmf_get_stats", 00:04:50.700 "nvmf_get_transports", 00:04:50.700 "nvmf_create_transport", 00:04:50.700 "nvmf_get_targets", 00:04:50.700 "nvmf_delete_target", 00:04:50.700 "nvmf_create_target", 00:04:50.700 "nvmf_subsystem_allow_any_host", 00:04:50.700 "nvmf_subsystem_remove_host", 00:04:50.700 "nvmf_subsystem_add_host", 00:04:50.700 "nvmf_subsystem_remove_ns", 00:04:50.700 "nvmf_subsystem_add_ns", 00:04:50.700 "nvmf_subsystem_listener_set_ana_state", 00:04:50.700 "nvmf_discovery_get_referrals", 00:04:50.700 "nvmf_discovery_remove_referral", 00:04:50.700 "nvmf_discovery_add_referral", 00:04:50.700 "nvmf_subsystem_remove_listener", 00:04:50.700 "nvmf_subsystem_add_listener", 00:04:50.700 "nvmf_delete_subsystem", 00:04:50.700 "nvmf_create_subsystem", 00:04:50.700 "nvmf_get_subsystems", 00:04:50.700 "env_dpdk_get_mem_stats", 00:04:50.700 "nbd_get_disks", 00:04:50.700 "nbd_stop_disk", 00:04:50.700 "nbd_start_disk", 00:04:50.700 "ublk_recover_disk", 00:04:50.700 "ublk_get_disks", 00:04:50.700 "ublk_stop_disk", 00:04:50.700 "ublk_start_disk", 00:04:50.700 "ublk_destroy_target", 00:04:50.700 "ublk_create_target", 00:04:50.700 "virtio_blk_create_transport", 00:04:50.700 "virtio_blk_get_transports", 00:04:50.700 "vhost_controller_set_coalescing", 00:04:50.700 "vhost_get_controllers", 00:04:50.700 "vhost_delete_controller", 00:04:50.700 "vhost_create_blk_controller", 00:04:50.700 "vhost_scsi_controller_remove_target", 00:04:50.700 "vhost_scsi_controller_add_target", 00:04:50.700 "vhost_start_scsi_controller", 00:04:50.700 "vhost_create_scsi_controller", 00:04:50.700 "thread_set_cpumask", 00:04:50.700 "framework_get_scheduler", 00:04:50.700 "framework_set_scheduler", 00:04:50.700 "framework_get_reactors", 00:04:50.700 "thread_get_io_channels", 00:04:50.700 "thread_get_pollers", 00:04:50.700 "thread_get_stats", 00:04:50.700 "framework_monitor_context_switch", 00:04:50.700 "spdk_kill_instance", 00:04:50.700 "log_enable_timestamps", 00:04:50.700 "log_get_flags", 00:04:50.700 "log_clear_flag", 00:04:50.700 "log_set_flag", 00:04:50.700 "log_get_level", 00:04:50.700 "log_set_level", 00:04:50.700 "log_get_print_level", 00:04:50.700 "log_set_print_level", 00:04:50.700 "framework_enable_cpumask_locks", 00:04:50.700 "framework_disable_cpumask_locks", 00:04:50.700 "framework_wait_init", 00:04:50.700 "framework_start_init", 00:04:50.700 "scsi_get_devices", 00:04:50.700 "bdev_get_histogram", 00:04:50.700 "bdev_enable_histogram", 00:04:50.700 "bdev_set_qos_limit", 00:04:50.700 "bdev_set_qd_sampling_period", 00:04:50.700 "bdev_get_bdevs", 00:04:50.700 "bdev_reset_iostat", 00:04:50.700 "bdev_get_iostat", 00:04:50.700 "bdev_examine", 00:04:50.700 "bdev_wait_for_examine", 00:04:50.700 "bdev_set_options", 00:04:50.700 "notify_get_notifications", 00:04:50.700 "notify_get_types", 00:04:50.700 "accel_get_stats", 00:04:50.700 "accel_set_options", 00:04:50.700 "accel_set_driver", 00:04:50.700 "accel_crypto_key_destroy", 00:04:50.700 "accel_crypto_keys_get", 00:04:50.700 "accel_crypto_key_create", 00:04:50.700 "accel_assign_opc", 00:04:50.700 "accel_get_module_info", 00:04:50.700 "accel_get_opc_assignments", 00:04:50.700 "vmd_rescan", 00:04:50.700 "vmd_remove_device", 00:04:50.700 "vmd_enable", 00:04:50.700 "sock_set_default_impl", 00:04:50.700 "sock_impl_set_options", 00:04:50.700 "sock_impl_get_options", 00:04:50.700 "iobuf_get_stats", 00:04:50.700 "iobuf_set_options", 00:04:50.700 "framework_get_pci_devices", 00:04:50.700 "framework_get_config", 00:04:50.700 "framework_get_subsystems", 00:04:50.700 "trace_get_info", 00:04:50.700 "trace_get_tpoint_group_mask", 00:04:50.700 "trace_disable_tpoint_group", 00:04:50.700 "trace_enable_tpoint_group", 00:04:50.700 "trace_clear_tpoint_mask", 00:04:50.700 "trace_set_tpoint_mask", 00:04:50.700 "spdk_get_version", 00:04:50.700 "rpc_get_methods" 00:04:50.700 ] 00:04:50.700 14:09:05 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:04:50.700 14:09:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:04:50.700 14:09:05 -- common/autotest_common.sh@10 -- # set +x 00:04:50.700 14:09:05 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:04:50.700 14:09:05 -- spdkcli/tcp.sh@38 -- # killprocess 197438 00:04:50.700 14:09:05 -- common/autotest_common.sh@936 -- # '[' -z 197438 ']' 00:04:50.700 14:09:05 -- common/autotest_common.sh@940 -- # kill -0 197438 00:04:50.700 14:09:05 -- common/autotest_common.sh@941 -- # uname 00:04:50.700 14:09:05 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:50.700 14:09:05 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 197438 00:04:50.700 14:09:05 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:50.700 14:09:05 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:50.700 14:09:05 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 197438' 00:04:50.700 killing process with pid 197438 00:04:50.700 14:09:05 -- common/autotest_common.sh@955 -- # kill 197438 00:04:50.700 14:09:05 -- common/autotest_common.sh@960 -- # wait 197438 00:04:51.268 00:04:51.268 real 0m1.624s 00:04:51.268 user 0m2.960s 00:04:51.268 sys 0m0.446s 00:04:51.268 14:09:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:51.268 14:09:05 -- common/autotest_common.sh@10 -- # set +x 00:04:51.268 ************************************ 00:04:51.268 END TEST spdkcli_tcp 00:04:51.268 ************************************ 00:04:51.268 14:09:05 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:51.268 14:09:05 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:51.268 14:09:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:51.268 14:09:05 -- common/autotest_common.sh@10 -- # set +x 00:04:51.268 ************************************ 00:04:51.268 START TEST dpdk_mem_utility 00:04:51.268 ************************************ 00:04:51.268 14:09:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:04:51.268 * Looking for test storage... 00:04:51.268 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:04:51.268 14:09:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:51.268 14:09:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:51.268 14:09:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:51.268 14:09:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:51.268 14:09:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:51.268 14:09:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:51.268 14:09:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:51.268 14:09:05 -- scripts/common.sh@335 -- # IFS=.-: 00:04:51.268 14:09:05 -- scripts/common.sh@335 -- # read -ra ver1 00:04:51.268 14:09:05 -- scripts/common.sh@336 -- # IFS=.-: 00:04:51.268 14:09:05 -- scripts/common.sh@336 -- # read -ra ver2 00:04:51.268 14:09:05 -- scripts/common.sh@337 -- # local 'op=<' 00:04:51.268 14:09:05 -- scripts/common.sh@339 -- # ver1_l=2 00:04:51.268 14:09:05 -- scripts/common.sh@340 -- # ver2_l=1 00:04:51.268 14:09:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:51.268 14:09:05 -- scripts/common.sh@343 -- # case "$op" in 00:04:51.268 14:09:05 -- scripts/common.sh@344 -- # : 1 00:04:51.268 14:09:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:51.268 14:09:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:51.268 14:09:05 -- scripts/common.sh@364 -- # decimal 1 00:04:51.268 14:09:05 -- scripts/common.sh@352 -- # local d=1 00:04:51.268 14:09:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:51.268 14:09:05 -- scripts/common.sh@354 -- # echo 1 00:04:51.268 14:09:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:51.268 14:09:05 -- scripts/common.sh@365 -- # decimal 2 00:04:51.268 14:09:05 -- scripts/common.sh@352 -- # local d=2 00:04:51.268 14:09:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:51.268 14:09:05 -- scripts/common.sh@354 -- # echo 2 00:04:51.268 14:09:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:51.268 14:09:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:51.268 14:09:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:51.268 14:09:05 -- scripts/common.sh@367 -- # return 0 00:04:51.268 14:09:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:51.268 14:09:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:51.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.268 --rc genhtml_branch_coverage=1 00:04:51.268 --rc genhtml_function_coverage=1 00:04:51.268 --rc genhtml_legend=1 00:04:51.268 --rc geninfo_all_blocks=1 00:04:51.268 --rc geninfo_unexecuted_blocks=1 00:04:51.268 00:04:51.268 ' 00:04:51.268 14:09:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:51.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.268 --rc genhtml_branch_coverage=1 00:04:51.268 --rc genhtml_function_coverage=1 00:04:51.268 --rc genhtml_legend=1 00:04:51.268 --rc geninfo_all_blocks=1 00:04:51.268 --rc geninfo_unexecuted_blocks=1 00:04:51.268 00:04:51.268 ' 00:04:51.268 14:09:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:51.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.268 --rc genhtml_branch_coverage=1 00:04:51.268 --rc genhtml_function_coverage=1 00:04:51.268 --rc genhtml_legend=1 00:04:51.268 --rc geninfo_all_blocks=1 00:04:51.268 --rc geninfo_unexecuted_blocks=1 00:04:51.268 00:04:51.268 ' 00:04:51.268 14:09:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:51.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:51.268 --rc genhtml_branch_coverage=1 00:04:51.268 --rc genhtml_function_coverage=1 00:04:51.268 --rc genhtml_legend=1 00:04:51.268 --rc geninfo_all_blocks=1 00:04:51.268 --rc geninfo_unexecuted_blocks=1 00:04:51.268 00:04:51.268 ' 00:04:51.268 14:09:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:51.268 14:09:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=197746 00:04:51.268 14:09:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 197746 00:04:51.268 14:09:05 -- common/autotest_common.sh@829 -- # '[' -z 197746 ']' 00:04:51.268 14:09:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:51.268 14:09:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:51.268 14:09:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:51.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:51.268 14:09:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:51.268 14:09:05 -- common/autotest_common.sh@10 -- # set +x 00:04:51.268 14:09:05 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:04:51.268 [2024-12-16 14:09:05.785292] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:51.268 [2024-12-16 14:09:05.785341] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid197746 ] 00:04:51.268 EAL: No free 2048 kB hugepages reported on node 1 00:04:51.527 [2024-12-16 14:09:05.842057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:51.527 [2024-12-16 14:09:05.918305] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:04:51.527 [2024-12-16 14:09:05.918415] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:52.093 14:09:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:52.093 14:09:06 -- common/autotest_common.sh@862 -- # return 0 00:04:52.093 14:09:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:04:52.093 14:09:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:04:52.093 14:09:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:52.094 14:09:06 -- common/autotest_common.sh@10 -- # set +x 00:04:52.094 { 00:04:52.094 "filename": "/tmp/spdk_mem_dump.txt" 00:04:52.094 } 00:04:52.094 14:09:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:52.094 14:09:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:04:52.094 DPDK memory size 814.000000 MiB in 1 heap(s) 00:04:52.094 1 heaps totaling size 814.000000 MiB 00:04:52.094 size: 814.000000 MiB heap id: 0 00:04:52.094 end heaps---------- 00:04:52.094 8 mempools totaling size 598.116089 MiB 00:04:52.094 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:04:52.094 size: 158.602051 MiB name: PDU_data_out_Pool 00:04:52.094 size: 84.521057 MiB name: bdev_io_197746 00:04:52.094 size: 51.011292 MiB name: evtpool_197746 00:04:52.094 size: 50.003479 MiB name: msgpool_197746 00:04:52.094 size: 21.763794 MiB name: PDU_Pool 00:04:52.094 size: 19.513306 MiB name: SCSI_TASK_Pool 00:04:52.094 size: 0.026123 MiB name: Session_Pool 00:04:52.094 end mempools------- 00:04:52.094 6 memzones totaling size 4.142822 MiB 00:04:52.094 size: 1.000366 MiB name: RG_ring_0_197746 00:04:52.094 size: 1.000366 MiB name: RG_ring_1_197746 00:04:52.094 size: 1.000366 MiB name: RG_ring_4_197746 00:04:52.094 size: 1.000366 MiB name: RG_ring_5_197746 00:04:52.094 size: 0.125366 MiB name: RG_ring_2_197746 00:04:52.094 size: 0.015991 MiB name: RG_ring_3_197746 00:04:52.094 end memzones------- 00:04:52.094 14:09:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:04:52.353 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:04:52.353 list of free elements. size: 12.519348 MiB 00:04:52.353 element at address: 0x200000400000 with size: 1.999512 MiB 00:04:52.353 element at address: 0x200018e00000 with size: 0.999878 MiB 00:04:52.353 element at address: 0x200019000000 with size: 0.999878 MiB 00:04:52.353 element at address: 0x200003e00000 with size: 0.996277 MiB 00:04:52.353 element at address: 0x200031c00000 with size: 0.994446 MiB 00:04:52.353 element at address: 0x200013800000 with size: 0.978699 MiB 00:04:52.353 element at address: 0x200007000000 with size: 0.959839 MiB 00:04:52.353 element at address: 0x200019200000 with size: 0.936584 MiB 00:04:52.353 element at address: 0x200000200000 with size: 0.841614 MiB 00:04:52.353 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:04:52.353 element at address: 0x20000b200000 with size: 0.490723 MiB 00:04:52.353 element at address: 0x200000800000 with size: 0.487793 MiB 00:04:52.353 element at address: 0x200019400000 with size: 0.485657 MiB 00:04:52.353 element at address: 0x200027e00000 with size: 0.410034 MiB 00:04:52.353 element at address: 0x200003a00000 with size: 0.355530 MiB 00:04:52.353 list of standard malloc elements. size: 199.218079 MiB 00:04:52.353 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:04:52.353 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:04:52.353 element at address: 0x200018efff80 with size: 1.000122 MiB 00:04:52.353 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:04:52.353 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:04:52.353 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:04:52.353 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:04:52.353 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:04:52.353 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:04:52.353 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:04:52.353 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:04:52.353 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200003adb300 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200003adb500 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200003affa80 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200003affb40 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:04:52.353 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:04:52.353 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:04:52.353 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:04:52.353 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:04:52.353 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:04:52.353 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200027e69040 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:04:52.353 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:04:52.353 list of memzone associated elements. size: 602.262573 MiB 00:04:52.353 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:04:52.353 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:04:52.353 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:04:52.354 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:04:52.354 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:04:52.354 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_197746_0 00:04:52.354 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:04:52.354 associated memzone info: size: 48.002930 MiB name: MP_evtpool_197746_0 00:04:52.354 element at address: 0x200003fff380 with size: 48.003052 MiB 00:04:52.354 associated memzone info: size: 48.002930 MiB name: MP_msgpool_197746_0 00:04:52.354 element at address: 0x2000195be940 with size: 20.255554 MiB 00:04:52.354 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:04:52.354 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:04:52.354 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:04:52.354 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:04:52.354 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_197746 00:04:52.354 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:04:52.354 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_197746 00:04:52.354 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:04:52.354 associated memzone info: size: 1.007996 MiB name: MP_evtpool_197746 00:04:52.354 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:04:52.354 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:04:52.354 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:04:52.354 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:04:52.354 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:04:52.354 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:04:52.354 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:04:52.354 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:04:52.354 element at address: 0x200003eff180 with size: 1.000488 MiB 00:04:52.354 associated memzone info: size: 1.000366 MiB name: RG_ring_0_197746 00:04:52.354 element at address: 0x200003affc00 with size: 1.000488 MiB 00:04:52.354 associated memzone info: size: 1.000366 MiB name: RG_ring_1_197746 00:04:52.354 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:04:52.354 associated memzone info: size: 1.000366 MiB name: RG_ring_4_197746 00:04:52.354 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:04:52.354 associated memzone info: size: 1.000366 MiB name: RG_ring_5_197746 00:04:52.354 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:04:52.354 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_197746 00:04:52.354 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:04:52.354 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:04:52.354 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:04:52.354 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:04:52.354 element at address: 0x20001947c540 with size: 0.250488 MiB 00:04:52.354 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:04:52.354 element at address: 0x200003adf880 with size: 0.125488 MiB 00:04:52.354 associated memzone info: size: 0.125366 MiB name: RG_ring_2_197746 00:04:52.354 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:04:52.354 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:04:52.354 element at address: 0x200027e69100 with size: 0.023743 MiB 00:04:52.354 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:04:52.354 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:04:52.354 associated memzone info: size: 0.015991 MiB name: RG_ring_3_197746 00:04:52.354 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:04:52.354 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:04:52.354 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:04:52.354 associated memzone info: size: 0.000183 MiB name: MP_msgpool_197746 00:04:52.354 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:04:52.354 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_197746 00:04:52.354 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:04:52.354 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:04:52.354 14:09:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:04:52.354 14:09:06 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 197746 00:04:52.354 14:09:06 -- common/autotest_common.sh@936 -- # '[' -z 197746 ']' 00:04:52.354 14:09:06 -- common/autotest_common.sh@940 -- # kill -0 197746 00:04:52.354 14:09:06 -- common/autotest_common.sh@941 -- # uname 00:04:52.354 14:09:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:04:52.354 14:09:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 197746 00:04:52.354 14:09:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:04:52.354 14:09:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:04:52.354 14:09:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 197746' 00:04:52.354 killing process with pid 197746 00:04:52.354 14:09:06 -- common/autotest_common.sh@955 -- # kill 197746 00:04:52.354 14:09:06 -- common/autotest_common.sh@960 -- # wait 197746 00:04:52.613 00:04:52.613 real 0m1.477s 00:04:52.613 user 0m1.556s 00:04:52.613 sys 0m0.391s 00:04:52.613 14:09:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:52.613 14:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:52.613 ************************************ 00:04:52.613 END TEST dpdk_mem_utility 00:04:52.613 ************************************ 00:04:52.613 14:09:07 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:52.613 14:09:07 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:52.613 14:09:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.613 14:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:52.613 ************************************ 00:04:52.613 START TEST event 00:04:52.613 ************************************ 00:04:52.613 14:09:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:04:52.613 * Looking for test storage... 00:04:52.613 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:04:52.613 14:09:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:52.613 14:09:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:52.872 14:09:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:52.872 14:09:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:52.872 14:09:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:52.872 14:09:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:52.872 14:09:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:52.872 14:09:07 -- scripts/common.sh@335 -- # IFS=.-: 00:04:52.872 14:09:07 -- scripts/common.sh@335 -- # read -ra ver1 00:04:52.872 14:09:07 -- scripts/common.sh@336 -- # IFS=.-: 00:04:52.872 14:09:07 -- scripts/common.sh@336 -- # read -ra ver2 00:04:52.872 14:09:07 -- scripts/common.sh@337 -- # local 'op=<' 00:04:52.872 14:09:07 -- scripts/common.sh@339 -- # ver1_l=2 00:04:52.872 14:09:07 -- scripts/common.sh@340 -- # ver2_l=1 00:04:52.872 14:09:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:52.872 14:09:07 -- scripts/common.sh@343 -- # case "$op" in 00:04:52.872 14:09:07 -- scripts/common.sh@344 -- # : 1 00:04:52.872 14:09:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:52.872 14:09:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:52.872 14:09:07 -- scripts/common.sh@364 -- # decimal 1 00:04:52.872 14:09:07 -- scripts/common.sh@352 -- # local d=1 00:04:52.872 14:09:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:52.872 14:09:07 -- scripts/common.sh@354 -- # echo 1 00:04:52.872 14:09:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:52.872 14:09:07 -- scripts/common.sh@365 -- # decimal 2 00:04:52.872 14:09:07 -- scripts/common.sh@352 -- # local d=2 00:04:52.872 14:09:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:52.872 14:09:07 -- scripts/common.sh@354 -- # echo 2 00:04:52.872 14:09:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:52.872 14:09:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:52.872 14:09:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:52.872 14:09:07 -- scripts/common.sh@367 -- # return 0 00:04:52.872 14:09:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:52.872 14:09:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:52.872 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:52.872 --rc genhtml_branch_coverage=1 00:04:52.872 --rc genhtml_function_coverage=1 00:04:52.872 --rc genhtml_legend=1 00:04:52.872 --rc geninfo_all_blocks=1 00:04:52.872 --rc geninfo_unexecuted_blocks=1 00:04:52.872 00:04:52.872 ' 00:04:52.872 14:09:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:52.872 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:52.872 --rc genhtml_branch_coverage=1 00:04:52.872 --rc genhtml_function_coverage=1 00:04:52.872 --rc genhtml_legend=1 00:04:52.872 --rc geninfo_all_blocks=1 00:04:52.872 --rc geninfo_unexecuted_blocks=1 00:04:52.872 00:04:52.872 ' 00:04:52.872 14:09:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:52.872 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:52.872 --rc genhtml_branch_coverage=1 00:04:52.872 --rc genhtml_function_coverage=1 00:04:52.872 --rc genhtml_legend=1 00:04:52.872 --rc geninfo_all_blocks=1 00:04:52.872 --rc geninfo_unexecuted_blocks=1 00:04:52.872 00:04:52.872 ' 00:04:52.872 14:09:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:52.872 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:52.872 --rc genhtml_branch_coverage=1 00:04:52.872 --rc genhtml_function_coverage=1 00:04:52.872 --rc genhtml_legend=1 00:04:52.872 --rc geninfo_all_blocks=1 00:04:52.872 --rc geninfo_unexecuted_blocks=1 00:04:52.872 00:04:52.872 ' 00:04:52.872 14:09:07 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:04:52.872 14:09:07 -- bdev/nbd_common.sh@6 -- # set -e 00:04:52.872 14:09:07 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:52.872 14:09:07 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:04:52.872 14:09:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.872 14:09:07 -- common/autotest_common.sh@10 -- # set +x 00:04:52.872 ************************************ 00:04:52.872 START TEST event_perf 00:04:52.872 ************************************ 00:04:52.872 14:09:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:04:52.872 Running I/O for 1 seconds...[2024-12-16 14:09:07.294265] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:52.872 [2024-12-16 14:09:07.294343] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid198241 ] 00:04:52.872 EAL: No free 2048 kB hugepages reported on node 1 00:04:52.872 [2024-12-16 14:09:07.351675] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:52.872 [2024-12-16 14:09:07.432468] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:52.872 [2024-12-16 14:09:07.432493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:52.872 [2024-12-16 14:09:07.432518] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:52.872 [2024-12-16 14:09:07.432520] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:54.248 Running I/O for 1 seconds... 00:04:54.248 lcore 0: 205644 00:04:54.248 lcore 1: 205643 00:04:54.248 lcore 2: 205642 00:04:54.248 lcore 3: 205643 00:04:54.248 done. 00:04:54.248 00:04:54.248 real 0m1.247s 00:04:54.248 user 0m4.163s 00:04:54.248 sys 0m0.078s 00:04:54.248 14:09:08 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:54.248 14:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:54.248 ************************************ 00:04:54.248 END TEST event_perf 00:04:54.248 ************************************ 00:04:54.248 14:09:08 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:54.248 14:09:08 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:54.248 14:09:08 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:54.248 14:09:08 -- common/autotest_common.sh@10 -- # set +x 00:04:54.248 ************************************ 00:04:54.248 START TEST event_reactor 00:04:54.248 ************************************ 00:04:54.248 14:09:08 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:04:54.248 [2024-12-16 14:09:08.581384] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:54.248 [2024-12-16 14:09:08.581464] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid198672 ] 00:04:54.248 EAL: No free 2048 kB hugepages reported on node 1 00:04:54.248 [2024-12-16 14:09:08.640609] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:54.248 [2024-12-16 14:09:08.708688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:55.624 test_start 00:04:55.624 oneshot 00:04:55.624 tick 100 00:04:55.624 tick 100 00:04:55.624 tick 250 00:04:55.624 tick 100 00:04:55.624 tick 100 00:04:55.624 tick 250 00:04:55.624 tick 100 00:04:55.624 tick 500 00:04:55.624 tick 100 00:04:55.624 tick 100 00:04:55.624 tick 250 00:04:55.624 tick 100 00:04:55.624 tick 100 00:04:55.624 test_end 00:04:55.624 00:04:55.624 real 0m1.230s 00:04:55.624 user 0m1.155s 00:04:55.624 sys 0m0.070s 00:04:55.624 14:09:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:55.624 14:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:55.624 ************************************ 00:04:55.624 END TEST event_reactor 00:04:55.624 ************************************ 00:04:55.624 14:09:09 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:55.624 14:09:09 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:04:55.624 14:09:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:55.624 14:09:09 -- common/autotest_common.sh@10 -- # set +x 00:04:55.624 ************************************ 00:04:55.624 START TEST event_reactor_perf 00:04:55.624 ************************************ 00:04:55.624 14:09:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:04:55.624 [2024-12-16 14:09:09.836759] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:55.624 [2024-12-16 14:09:09.836806] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid198918 ] 00:04:55.624 EAL: No free 2048 kB hugepages reported on node 1 00:04:55.624 [2024-12-16 14:09:09.890933] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:04:55.624 [2024-12-16 14:09:09.958094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:56.559 test_start 00:04:56.559 test_end 00:04:56.559 Performance: 493963 events per second 00:04:56.559 00:04:56.559 real 0m1.219s 00:04:56.559 user 0m1.150s 00:04:56.559 sys 0m0.065s 00:04:56.559 14:09:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.559 14:09:11 -- common/autotest_common.sh@10 -- # set +x 00:04:56.559 ************************************ 00:04:56.559 END TEST event_reactor_perf 00:04:56.559 ************************************ 00:04:56.559 14:09:11 -- event/event.sh@49 -- # uname -s 00:04:56.559 14:09:11 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:04:56.559 14:09:11 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:56.559 14:09:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.559 14:09:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.559 14:09:11 -- common/autotest_common.sh@10 -- # set +x 00:04:56.559 ************************************ 00:04:56.559 START TEST event_scheduler 00:04:56.559 ************************************ 00:04:56.559 14:09:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:04:56.818 * Looking for test storage... 00:04:56.818 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:04:56.818 14:09:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:56.818 14:09:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:56.818 14:09:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:56.818 14:09:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:56.818 14:09:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:56.818 14:09:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:56.818 14:09:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:56.818 14:09:11 -- scripts/common.sh@335 -- # IFS=.-: 00:04:56.818 14:09:11 -- scripts/common.sh@335 -- # read -ra ver1 00:04:56.818 14:09:11 -- scripts/common.sh@336 -- # IFS=.-: 00:04:56.818 14:09:11 -- scripts/common.sh@336 -- # read -ra ver2 00:04:56.818 14:09:11 -- scripts/common.sh@337 -- # local 'op=<' 00:04:56.818 14:09:11 -- scripts/common.sh@339 -- # ver1_l=2 00:04:56.818 14:09:11 -- scripts/common.sh@340 -- # ver2_l=1 00:04:56.818 14:09:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:56.818 14:09:11 -- scripts/common.sh@343 -- # case "$op" in 00:04:56.818 14:09:11 -- scripts/common.sh@344 -- # : 1 00:04:56.818 14:09:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:56.818 14:09:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:56.818 14:09:11 -- scripts/common.sh@364 -- # decimal 1 00:04:56.818 14:09:11 -- scripts/common.sh@352 -- # local d=1 00:04:56.818 14:09:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:56.818 14:09:11 -- scripts/common.sh@354 -- # echo 1 00:04:56.818 14:09:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:56.818 14:09:11 -- scripts/common.sh@365 -- # decimal 2 00:04:56.818 14:09:11 -- scripts/common.sh@352 -- # local d=2 00:04:56.818 14:09:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:56.818 14:09:11 -- scripts/common.sh@354 -- # echo 2 00:04:56.818 14:09:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:56.818 14:09:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:56.818 14:09:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:56.818 14:09:11 -- scripts/common.sh@367 -- # return 0 00:04:56.818 14:09:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:56.818 14:09:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:56.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.818 --rc genhtml_branch_coverage=1 00:04:56.818 --rc genhtml_function_coverage=1 00:04:56.818 --rc genhtml_legend=1 00:04:56.818 --rc geninfo_all_blocks=1 00:04:56.818 --rc geninfo_unexecuted_blocks=1 00:04:56.818 00:04:56.818 ' 00:04:56.818 14:09:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:56.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.818 --rc genhtml_branch_coverage=1 00:04:56.818 --rc genhtml_function_coverage=1 00:04:56.818 --rc genhtml_legend=1 00:04:56.818 --rc geninfo_all_blocks=1 00:04:56.818 --rc geninfo_unexecuted_blocks=1 00:04:56.818 00:04:56.818 ' 00:04:56.818 14:09:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:56.818 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.818 --rc genhtml_branch_coverage=1 00:04:56.818 --rc genhtml_function_coverage=1 00:04:56.818 --rc genhtml_legend=1 00:04:56.818 --rc geninfo_all_blocks=1 00:04:56.818 --rc geninfo_unexecuted_blocks=1 00:04:56.819 00:04:56.819 ' 00:04:56.819 14:09:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:56.819 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:56.819 --rc genhtml_branch_coverage=1 00:04:56.819 --rc genhtml_function_coverage=1 00:04:56.819 --rc genhtml_legend=1 00:04:56.819 --rc geninfo_all_blocks=1 00:04:56.819 --rc geninfo_unexecuted_blocks=1 00:04:56.819 00:04:56.819 ' 00:04:56.819 14:09:11 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:04:56.819 14:09:11 -- scheduler/scheduler.sh@35 -- # scheduler_pid=199204 00:04:56.819 14:09:11 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:04:56.819 14:09:11 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:04:56.819 14:09:11 -- scheduler/scheduler.sh@37 -- # waitforlisten 199204 00:04:56.819 14:09:11 -- common/autotest_common.sh@829 -- # '[' -z 199204 ']' 00:04:56.819 14:09:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:04:56.819 14:09:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:04:56.819 14:09:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:04:56.819 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:04:56.819 14:09:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:04:56.819 14:09:11 -- common/autotest_common.sh@10 -- # set +x 00:04:56.819 [2024-12-16 14:09:11.288372] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:04:56.819 [2024-12-16 14:09:11.288423] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid199204 ] 00:04:56.819 EAL: No free 2048 kB hugepages reported on node 1 00:04:56.819 [2024-12-16 14:09:11.340728] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:04:57.077 [2024-12-16 14:09:11.417922] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:04:57.077 [2024-12-16 14:09:11.417939] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:04:57.077 [2024-12-16 14:09:11.418013] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:04:57.077 [2024-12-16 14:09:11.418016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:04:57.644 14:09:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:04:57.644 14:09:12 -- common/autotest_common.sh@862 -- # return 0 00:04:57.644 14:09:12 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:04:57.644 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.644 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.644 POWER: Env isn't set yet! 00:04:57.644 POWER: Attempting to initialise ACPI cpufreq power management... 00:04:57.644 POWER: Failed to write /sys/devices/system/cpu/cpu%u/cpufreq/scaling_governor 00:04:57.644 POWER: Cannot set governor of lcore 0 to userspace 00:04:57.644 POWER: Attempting to initialise PSTAT power management... 00:04:57.644 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:04:57.644 POWER: Initialized successfully for lcore 0 power management 00:04:57.644 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:04:57.644 POWER: Initialized successfully for lcore 1 power management 00:04:57.644 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:04:57.644 POWER: Initialized successfully for lcore 2 power management 00:04:57.644 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:04:57.644 POWER: Initialized successfully for lcore 3 power management 00:04:57.644 [2024-12-16 14:09:12.141009] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:04:57.644 [2024-12-16 14:09:12.141021] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:04:57.644 [2024-12-16 14:09:12.141028] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:04:57.644 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.644 14:09:12 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:04:57.644 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.644 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.644 [2024-12-16 14:09:12.214205] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:04:57.644 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.644 14:09:12 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:04:57.644 14:09:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:57.644 14:09:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:57.644 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 ************************************ 00:04:57.903 START TEST scheduler_create_thread 00:04:57.903 ************************************ 00:04:57.903 14:09:12 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 2 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 3 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 4 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 5 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 6 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 7 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 8 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 9 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 10 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:57.903 14:09:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:04:57.903 14:09:12 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:04:57.903 14:09:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:57.903 14:09:12 -- common/autotest_common.sh@10 -- # set +x 00:04:58.839 14:09:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:04:58.839 14:09:13 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:04:58.839 14:09:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:04:58.839 14:09:13 -- common/autotest_common.sh@10 -- # set +x 00:05:00.214 14:09:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:00.214 14:09:14 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:05:00.214 14:09:14 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:05:00.214 14:09:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:00.214 14:09:14 -- common/autotest_common.sh@10 -- # set +x 00:05:01.148 14:09:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:01.148 00:05:01.148 real 0m3.384s 00:05:01.148 user 0m0.021s 00:05:01.148 sys 0m0.006s 00:05:01.148 14:09:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:01.148 14:09:15 -- common/autotest_common.sh@10 -- # set +x 00:05:01.148 ************************************ 00:05:01.148 END TEST scheduler_create_thread 00:05:01.148 ************************************ 00:05:01.148 14:09:15 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:05:01.148 14:09:15 -- scheduler/scheduler.sh@46 -- # killprocess 199204 00:05:01.148 14:09:15 -- common/autotest_common.sh@936 -- # '[' -z 199204 ']' 00:05:01.148 14:09:15 -- common/autotest_common.sh@940 -- # kill -0 199204 00:05:01.148 14:09:15 -- common/autotest_common.sh@941 -- # uname 00:05:01.148 14:09:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:01.148 14:09:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 199204 00:05:01.148 14:09:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:01.148 14:09:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:01.148 14:09:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 199204' 00:05:01.148 killing process with pid 199204 00:05:01.148 14:09:15 -- common/autotest_common.sh@955 -- # kill 199204 00:05:01.148 14:09:15 -- common/autotest_common.sh@960 -- # wait 199204 00:05:01.716 [2024-12-16 14:09:15.986192] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:05:01.716 POWER: Power management governor of lcore 0 has been set to 'powersave' successfully 00:05:01.716 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:05:01.716 POWER: Power management governor of lcore 1 has been set to 'powersave' successfully 00:05:01.716 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:05:01.716 POWER: Power management governor of lcore 2 has been set to 'powersave' successfully 00:05:01.716 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:05:01.716 POWER: Power management governor of lcore 3 has been set to 'powersave' successfully 00:05:01.716 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:05:01.716 00:05:01.716 real 0m5.147s 00:05:01.716 user 0m10.591s 00:05:01.716 sys 0m0.338s 00:05:01.716 14:09:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:01.716 14:09:16 -- common/autotest_common.sh@10 -- # set +x 00:05:01.716 ************************************ 00:05:01.716 END TEST event_scheduler 00:05:01.716 ************************************ 00:05:01.716 14:09:16 -- event/event.sh@51 -- # modprobe -n nbd 00:05:01.716 14:09:16 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:05:01.716 14:09:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:01.716 14:09:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:01.716 14:09:16 -- common/autotest_common.sh@10 -- # set +x 00:05:01.716 ************************************ 00:05:01.716 START TEST app_repeat 00:05:01.716 ************************************ 00:05:01.716 14:09:16 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:05:01.716 14:09:16 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:01.716 14:09:16 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:01.716 14:09:16 -- event/event.sh@13 -- # local nbd_list 00:05:01.716 14:09:16 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:01.716 14:09:16 -- event/event.sh@14 -- # local bdev_list 00:05:01.716 14:09:16 -- event/event.sh@15 -- # local repeat_times=4 00:05:01.716 14:09:16 -- event/event.sh@17 -- # modprobe nbd 00:05:01.976 14:09:16 -- event/event.sh@19 -- # repeat_pid=200159 00:05:01.976 14:09:16 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:05:01.976 14:09:16 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:05:01.976 14:09:16 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 200159' 00:05:01.976 Process app_repeat pid: 200159 00:05:01.976 14:09:16 -- event/event.sh@23 -- # for i in {0..2} 00:05:01.976 14:09:16 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:05:01.976 spdk_app_start Round 0 00:05:01.976 14:09:16 -- event/event.sh@25 -- # waitforlisten 200159 /var/tmp/spdk-nbd.sock 00:05:01.976 14:09:16 -- common/autotest_common.sh@829 -- # '[' -z 200159 ']' 00:05:01.976 14:09:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:01.976 14:09:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:01.976 14:09:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:01.976 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:01.976 14:09:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:01.976 14:09:16 -- common/autotest_common.sh@10 -- # set +x 00:05:01.976 [2024-12-16 14:09:16.318474] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:01.976 [2024-12-16 14:09:16.318531] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid200159 ] 00:05:01.976 EAL: No free 2048 kB hugepages reported on node 1 00:05:01.976 [2024-12-16 14:09:16.372719] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:01.976 [2024-12-16 14:09:16.440747] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:01.976 [2024-12-16 14:09:16.440751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:02.911 14:09:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:02.911 14:09:17 -- common/autotest_common.sh@862 -- # return 0 00:05:02.911 14:09:17 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:02.911 Malloc0 00:05:02.911 14:09:17 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:03.170 Malloc1 00:05:03.170 14:09:17 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@12 -- # local i 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:03.170 /dev/nbd0 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:03.170 14:09:17 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:03.170 14:09:17 -- common/autotest_common.sh@867 -- # local i 00:05:03.170 14:09:17 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:03.170 14:09:17 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:03.170 14:09:17 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:03.170 14:09:17 -- common/autotest_common.sh@871 -- # break 00:05:03.170 14:09:17 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:03.170 14:09:17 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:03.170 14:09:17 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:03.170 1+0 records in 00:05:03.170 1+0 records out 00:05:03.170 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000215525 s, 19.0 MB/s 00:05:03.170 14:09:17 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:03.170 14:09:17 -- common/autotest_common.sh@884 -- # size=4096 00:05:03.170 14:09:17 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:03.170 14:09:17 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:03.170 14:09:17 -- common/autotest_common.sh@887 -- # return 0 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:03.170 14:09:17 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:03.429 /dev/nbd1 00:05:03.429 14:09:17 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:03.429 14:09:17 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:03.429 14:09:17 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:03.429 14:09:17 -- common/autotest_common.sh@867 -- # local i 00:05:03.429 14:09:17 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:03.429 14:09:17 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:03.429 14:09:17 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:03.429 14:09:17 -- common/autotest_common.sh@871 -- # break 00:05:03.429 14:09:17 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:03.429 14:09:17 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:03.429 14:09:17 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:03.429 1+0 records in 00:05:03.429 1+0 records out 00:05:03.429 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000196626 s, 20.8 MB/s 00:05:03.429 14:09:17 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:03.429 14:09:17 -- common/autotest_common.sh@884 -- # size=4096 00:05:03.429 14:09:17 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:03.429 14:09:17 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:03.429 14:09:17 -- common/autotest_common.sh@887 -- # return 0 00:05:03.429 14:09:17 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:03.429 14:09:17 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:03.429 14:09:17 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:03.429 14:09:17 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.429 14:09:17 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:03.688 { 00:05:03.688 "nbd_device": "/dev/nbd0", 00:05:03.688 "bdev_name": "Malloc0" 00:05:03.688 }, 00:05:03.688 { 00:05:03.688 "nbd_device": "/dev/nbd1", 00:05:03.688 "bdev_name": "Malloc1" 00:05:03.688 } 00:05:03.688 ]' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:03.688 { 00:05:03.688 "nbd_device": "/dev/nbd0", 00:05:03.688 "bdev_name": "Malloc0" 00:05:03.688 }, 00:05:03.688 { 00:05:03.688 "nbd_device": "/dev/nbd1", 00:05:03.688 "bdev_name": "Malloc1" 00:05:03.688 } 00:05:03.688 ]' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:03.688 /dev/nbd1' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:03.688 /dev/nbd1' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@65 -- # count=2 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@95 -- # count=2 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:03.688 256+0 records in 00:05:03.688 256+0 records out 00:05:03.688 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106661 s, 98.3 MB/s 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:03.688 256+0 records in 00:05:03.688 256+0 records out 00:05:03.688 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0146738 s, 71.5 MB/s 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:03.688 256+0 records in 00:05:03.688 256+0 records out 00:05:03.688 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0147704 s, 71.0 MB/s 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@51 -- # local i 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:03.688 14:09:18 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@41 -- # break 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@45 -- # return 0 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:03.947 14:09:18 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@41 -- # break 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@45 -- # return 0 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:04.205 14:09:18 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@65 -- # true 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@65 -- # count=0 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@104 -- # count=0 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:04.462 14:09:18 -- bdev/nbd_common.sh@109 -- # return 0 00:05:04.462 14:09:18 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:04.462 14:09:18 -- event/event.sh@35 -- # sleep 3 00:05:04.721 [2024-12-16 14:09:19.189705] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:04.721 [2024-12-16 14:09:19.252385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:04.721 [2024-12-16 14:09:19.252388] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:04.721 [2024-12-16 14:09:19.293534] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:04.721 [2024-12-16 14:09:19.293568] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:08.005 14:09:21 -- event/event.sh@23 -- # for i in {0..2} 00:05:08.006 14:09:21 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:05:08.006 spdk_app_start Round 1 00:05:08.006 14:09:21 -- event/event.sh@25 -- # waitforlisten 200159 /var/tmp/spdk-nbd.sock 00:05:08.006 14:09:21 -- common/autotest_common.sh@829 -- # '[' -z 200159 ']' 00:05:08.006 14:09:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:08.006 14:09:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:08.006 14:09:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:08.006 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:08.006 14:09:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:08.006 14:09:21 -- common/autotest_common.sh@10 -- # set +x 00:05:08.006 14:09:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:08.006 14:09:22 -- common/autotest_common.sh@862 -- # return 0 00:05:08.006 14:09:22 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:08.006 Malloc0 00:05:08.006 14:09:22 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:08.006 Malloc1 00:05:08.006 14:09:22 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@12 -- # local i 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.006 14:09:22 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:08.264 /dev/nbd0 00:05:08.264 14:09:22 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:08.264 14:09:22 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:08.264 14:09:22 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:08.264 14:09:22 -- common/autotest_common.sh@867 -- # local i 00:05:08.264 14:09:22 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:08.264 14:09:22 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:08.264 14:09:22 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:08.264 14:09:22 -- common/autotest_common.sh@871 -- # break 00:05:08.264 14:09:22 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:08.264 14:09:22 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:08.264 14:09:22 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:08.264 1+0 records in 00:05:08.264 1+0 records out 00:05:08.264 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000201499 s, 20.3 MB/s 00:05:08.264 14:09:22 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.264 14:09:22 -- common/autotest_common.sh@884 -- # size=4096 00:05:08.264 14:09:22 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.264 14:09:22 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:08.264 14:09:22 -- common/autotest_common.sh@887 -- # return 0 00:05:08.264 14:09:22 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:08.264 14:09:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.264 14:09:22 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:08.523 /dev/nbd1 00:05:08.523 14:09:22 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:08.523 14:09:22 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:08.523 14:09:22 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:08.523 14:09:22 -- common/autotest_common.sh@867 -- # local i 00:05:08.523 14:09:22 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:08.523 14:09:22 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:08.523 14:09:22 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:08.523 14:09:22 -- common/autotest_common.sh@871 -- # break 00:05:08.523 14:09:22 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:08.523 14:09:22 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:08.523 14:09:22 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:08.523 1+0 records in 00:05:08.523 1+0 records out 00:05:08.523 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000124888 s, 32.8 MB/s 00:05:08.523 14:09:22 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.523 14:09:22 -- common/autotest_common.sh@884 -- # size=4096 00:05:08.523 14:09:22 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:08.523 14:09:22 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:08.523 14:09:22 -- common/autotest_common.sh@887 -- # return 0 00:05:08.523 14:09:22 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:08.523 14:09:22 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:08.523 14:09:22 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:08.523 14:09:22 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.523 14:09:22 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:08.781 { 00:05:08.781 "nbd_device": "/dev/nbd0", 00:05:08.781 "bdev_name": "Malloc0" 00:05:08.781 }, 00:05:08.781 { 00:05:08.781 "nbd_device": "/dev/nbd1", 00:05:08.781 "bdev_name": "Malloc1" 00:05:08.781 } 00:05:08.781 ]' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:08.781 { 00:05:08.781 "nbd_device": "/dev/nbd0", 00:05:08.781 "bdev_name": "Malloc0" 00:05:08.781 }, 00:05:08.781 { 00:05:08.781 "nbd_device": "/dev/nbd1", 00:05:08.781 "bdev_name": "Malloc1" 00:05:08.781 } 00:05:08.781 ]' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:08.781 /dev/nbd1' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:08.781 /dev/nbd1' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@65 -- # count=2 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@95 -- # count=2 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:08.781 256+0 records in 00:05:08.781 256+0 records out 00:05:08.781 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0106632 s, 98.3 MB/s 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:08.781 256+0 records in 00:05:08.781 256+0 records out 00:05:08.781 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0138143 s, 75.9 MB/s 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:08.781 256+0 records in 00:05:08.781 256+0 records out 00:05:08.781 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0148578 s, 70.6 MB/s 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@51 -- # local i 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:08.781 14:09:23 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@41 -- # break 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@45 -- # return 0 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:09.040 14:09:23 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@41 -- # break 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@45 -- # return 0 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:09.298 14:09:23 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@65 -- # true 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@65 -- # count=0 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@104 -- # count=0 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:09.556 14:09:23 -- bdev/nbd_common.sh@109 -- # return 0 00:05:09.556 14:09:23 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:09.556 14:09:24 -- event/event.sh@35 -- # sleep 3 00:05:09.815 [2024-12-16 14:09:24.303803] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:09.815 [2024-12-16 14:09:24.366284] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:09.815 [2024-12-16 14:09:24.366287] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:10.073 [2024-12-16 14:09:24.407331] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:10.073 [2024-12-16 14:09:24.407369] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:12.609 14:09:27 -- event/event.sh@23 -- # for i in {0..2} 00:05:12.609 14:09:27 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:05:12.609 spdk_app_start Round 2 00:05:12.609 14:09:27 -- event/event.sh@25 -- # waitforlisten 200159 /var/tmp/spdk-nbd.sock 00:05:12.609 14:09:27 -- common/autotest_common.sh@829 -- # '[' -z 200159 ']' 00:05:12.609 14:09:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:12.609 14:09:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:12.609 14:09:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:12.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:12.609 14:09:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:12.609 14:09:27 -- common/autotest_common.sh@10 -- # set +x 00:05:12.866 14:09:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:12.866 14:09:27 -- common/autotest_common.sh@862 -- # return 0 00:05:12.866 14:09:27 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:13.124 Malloc0 00:05:13.124 14:09:27 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:05:13.124 Malloc1 00:05:13.124 14:09:27 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@12 -- # local i 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:13.124 14:09:27 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:05:13.382 /dev/nbd0 00:05:13.382 14:09:27 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:05:13.383 14:09:27 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:05:13.383 14:09:27 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:05:13.383 14:09:27 -- common/autotest_common.sh@867 -- # local i 00:05:13.383 14:09:27 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:13.383 14:09:27 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:13.383 14:09:27 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:05:13.383 14:09:27 -- common/autotest_common.sh@871 -- # break 00:05:13.383 14:09:27 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:13.383 14:09:27 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:13.383 14:09:27 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:13.383 1+0 records in 00:05:13.383 1+0 records out 00:05:13.383 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000210562 s, 19.5 MB/s 00:05:13.383 14:09:27 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:13.383 14:09:27 -- common/autotest_common.sh@884 -- # size=4096 00:05:13.383 14:09:27 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:13.383 14:09:27 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:13.383 14:09:27 -- common/autotest_common.sh@887 -- # return 0 00:05:13.383 14:09:27 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:13.383 14:09:27 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:13.383 14:09:27 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:05:13.641 /dev/nbd1 00:05:13.641 14:09:28 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:05:13.641 14:09:28 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:05:13.641 14:09:28 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:05:13.641 14:09:28 -- common/autotest_common.sh@867 -- # local i 00:05:13.641 14:09:28 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:05:13.641 14:09:28 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:05:13.641 14:09:28 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:05:13.641 14:09:28 -- common/autotest_common.sh@871 -- # break 00:05:13.641 14:09:28 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:05:13.641 14:09:28 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:05:13.641 14:09:28 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:05:13.641 1+0 records in 00:05:13.641 1+0 records out 00:05:13.641 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000217092 s, 18.9 MB/s 00:05:13.641 14:09:28 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:13.641 14:09:28 -- common/autotest_common.sh@884 -- # size=4096 00:05:13.641 14:09:28 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:05:13.641 14:09:28 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:05:13.641 14:09:28 -- common/autotest_common.sh@887 -- # return 0 00:05:13.641 14:09:28 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:05:13.641 14:09:28 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:05:13.641 14:09:28 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:13.641 14:09:28 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:13.641 14:09:28 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:13.900 14:09:28 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:05:13.900 { 00:05:13.900 "nbd_device": "/dev/nbd0", 00:05:13.900 "bdev_name": "Malloc0" 00:05:13.900 }, 00:05:13.900 { 00:05:13.900 "nbd_device": "/dev/nbd1", 00:05:13.900 "bdev_name": "Malloc1" 00:05:13.900 } 00:05:13.900 ]' 00:05:13.900 14:09:28 -- bdev/nbd_common.sh@64 -- # echo '[ 00:05:13.900 { 00:05:13.900 "nbd_device": "/dev/nbd0", 00:05:13.900 "bdev_name": "Malloc0" 00:05:13.900 }, 00:05:13.900 { 00:05:13.900 "nbd_device": "/dev/nbd1", 00:05:13.900 "bdev_name": "Malloc1" 00:05:13.900 } 00:05:13.900 ]' 00:05:13.900 14:09:28 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:13.900 14:09:28 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:05:13.900 /dev/nbd1' 00:05:13.900 14:09:28 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:13.900 14:09:28 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:05:13.900 /dev/nbd1' 00:05:13.900 14:09:28 -- bdev/nbd_common.sh@65 -- # count=2 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@66 -- # echo 2 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@95 -- # count=2 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@71 -- # local operation=write 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:05:13.901 256+0 records in 00:05:13.901 256+0 records out 00:05:13.901 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0102497 s, 102 MB/s 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:05:13.901 256+0 records in 00:05:13.901 256+0 records out 00:05:13.901 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0140659 s, 74.5 MB/s 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:05:13.901 256+0 records in 00:05:13.901 256+0 records out 00:05:13.901 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0149209 s, 70.3 MB/s 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@51 -- # local i 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:13.901 14:09:28 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@41 -- # break 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@45 -- # return 0 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:05:14.159 14:09:28 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@41 -- # break 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@45 -- # return 0 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@65 -- # echo '' 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@65 -- # true 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@65 -- # count=0 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@66 -- # echo 0 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@104 -- # count=0 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:05:14.418 14:09:28 -- bdev/nbd_common.sh@109 -- # return 0 00:05:14.418 14:09:28 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:05:14.678 14:09:29 -- event/event.sh@35 -- # sleep 3 00:05:14.937 [2024-12-16 14:09:29.386651] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:14.937 [2024-12-16 14:09:29.453132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:14.937 [2024-12-16 14:09:29.453135] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:14.937 [2024-12-16 14:09:29.494207] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:05:14.937 [2024-12-16 14:09:29.494247] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:05:18.223 14:09:32 -- event/event.sh@38 -- # waitforlisten 200159 /var/tmp/spdk-nbd.sock 00:05:18.223 14:09:32 -- common/autotest_common.sh@829 -- # '[' -z 200159 ']' 00:05:18.223 14:09:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:05:18.223 14:09:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.223 14:09:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:05:18.223 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:05:18.223 14:09:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.223 14:09:32 -- common/autotest_common.sh@10 -- # set +x 00:05:18.223 14:09:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:18.223 14:09:32 -- common/autotest_common.sh@862 -- # return 0 00:05:18.223 14:09:32 -- event/event.sh@39 -- # killprocess 200159 00:05:18.223 14:09:32 -- common/autotest_common.sh@936 -- # '[' -z 200159 ']' 00:05:18.223 14:09:32 -- common/autotest_common.sh@940 -- # kill -0 200159 00:05:18.223 14:09:32 -- common/autotest_common.sh@941 -- # uname 00:05:18.223 14:09:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:18.223 14:09:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 200159 00:05:18.223 14:09:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:18.223 14:09:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:18.223 14:09:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 200159' 00:05:18.223 killing process with pid 200159 00:05:18.223 14:09:32 -- common/autotest_common.sh@955 -- # kill 200159 00:05:18.223 14:09:32 -- common/autotest_common.sh@960 -- # wait 200159 00:05:18.223 spdk_app_start is called in Round 0. 00:05:18.223 Shutdown signal received, stop current app iteration 00:05:18.223 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:18.223 spdk_app_start is called in Round 1. 00:05:18.223 Shutdown signal received, stop current app iteration 00:05:18.223 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:18.223 spdk_app_start is called in Round 2. 00:05:18.223 Shutdown signal received, stop current app iteration 00:05:18.223 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:05:18.223 spdk_app_start is called in Round 3. 00:05:18.223 Shutdown signal received, stop current app iteration 00:05:18.223 14:09:32 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:05:18.223 14:09:32 -- event/event.sh@42 -- # return 0 00:05:18.223 00:05:18.223 real 0m16.313s 00:05:18.223 user 0m35.292s 00:05:18.223 sys 0m2.418s 00:05:18.223 14:09:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:18.223 14:09:32 -- common/autotest_common.sh@10 -- # set +x 00:05:18.223 ************************************ 00:05:18.223 END TEST app_repeat 00:05:18.223 ************************************ 00:05:18.223 14:09:32 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:05:18.223 14:09:32 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:18.223 14:09:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.223 14:09:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.223 14:09:32 -- common/autotest_common.sh@10 -- # set +x 00:05:18.223 ************************************ 00:05:18.223 START TEST cpu_locks 00:05:18.223 ************************************ 00:05:18.223 14:09:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:05:18.223 * Looking for test storage... 00:05:18.223 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:18.223 14:09:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:18.223 14:09:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:18.223 14:09:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:18.223 14:09:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:18.223 14:09:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:18.223 14:09:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:18.223 14:09:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:18.223 14:09:32 -- scripts/common.sh@335 -- # IFS=.-: 00:05:18.223 14:09:32 -- scripts/common.sh@335 -- # read -ra ver1 00:05:18.223 14:09:32 -- scripts/common.sh@336 -- # IFS=.-: 00:05:18.223 14:09:32 -- scripts/common.sh@336 -- # read -ra ver2 00:05:18.223 14:09:32 -- scripts/common.sh@337 -- # local 'op=<' 00:05:18.223 14:09:32 -- scripts/common.sh@339 -- # ver1_l=2 00:05:18.223 14:09:32 -- scripts/common.sh@340 -- # ver2_l=1 00:05:18.223 14:09:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:18.223 14:09:32 -- scripts/common.sh@343 -- # case "$op" in 00:05:18.223 14:09:32 -- scripts/common.sh@344 -- # : 1 00:05:18.223 14:09:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:18.223 14:09:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:18.223 14:09:32 -- scripts/common.sh@364 -- # decimal 1 00:05:18.223 14:09:32 -- scripts/common.sh@352 -- # local d=1 00:05:18.223 14:09:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:18.223 14:09:32 -- scripts/common.sh@354 -- # echo 1 00:05:18.223 14:09:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:18.223 14:09:32 -- scripts/common.sh@365 -- # decimal 2 00:05:18.223 14:09:32 -- scripts/common.sh@352 -- # local d=2 00:05:18.223 14:09:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:18.223 14:09:32 -- scripts/common.sh@354 -- # echo 2 00:05:18.223 14:09:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:18.223 14:09:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:18.482 14:09:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:18.482 14:09:32 -- scripts/common.sh@367 -- # return 0 00:05:18.482 14:09:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:18.482 14:09:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:18.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.482 --rc genhtml_branch_coverage=1 00:05:18.482 --rc genhtml_function_coverage=1 00:05:18.482 --rc genhtml_legend=1 00:05:18.482 --rc geninfo_all_blocks=1 00:05:18.482 --rc geninfo_unexecuted_blocks=1 00:05:18.482 00:05:18.482 ' 00:05:18.482 14:09:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:18.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.482 --rc genhtml_branch_coverage=1 00:05:18.482 --rc genhtml_function_coverage=1 00:05:18.482 --rc genhtml_legend=1 00:05:18.482 --rc geninfo_all_blocks=1 00:05:18.482 --rc geninfo_unexecuted_blocks=1 00:05:18.482 00:05:18.482 ' 00:05:18.482 14:09:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:18.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.482 --rc genhtml_branch_coverage=1 00:05:18.482 --rc genhtml_function_coverage=1 00:05:18.482 --rc genhtml_legend=1 00:05:18.482 --rc geninfo_all_blocks=1 00:05:18.482 --rc geninfo_unexecuted_blocks=1 00:05:18.482 00:05:18.482 ' 00:05:18.482 14:09:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:18.482 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:18.482 --rc genhtml_branch_coverage=1 00:05:18.482 --rc genhtml_function_coverage=1 00:05:18.482 --rc genhtml_legend=1 00:05:18.482 --rc geninfo_all_blocks=1 00:05:18.482 --rc geninfo_unexecuted_blocks=1 00:05:18.482 00:05:18.482 ' 00:05:18.482 14:09:32 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:05:18.482 14:09:32 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:05:18.482 14:09:32 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:05:18.482 14:09:32 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:05:18.482 14:09:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:18.482 14:09:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:18.482 14:09:32 -- common/autotest_common.sh@10 -- # set +x 00:05:18.482 ************************************ 00:05:18.482 START TEST default_locks 00:05:18.482 ************************************ 00:05:18.482 14:09:32 -- common/autotest_common.sh@1114 -- # default_locks 00:05:18.482 14:09:32 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=203129 00:05:18.482 14:09:32 -- event/cpu_locks.sh@47 -- # waitforlisten 203129 00:05:18.482 14:09:32 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:18.482 14:09:32 -- common/autotest_common.sh@829 -- # '[' -z 203129 ']' 00:05:18.482 14:09:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:18.482 14:09:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:18.482 14:09:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:18.482 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:18.482 14:09:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:18.482 14:09:32 -- common/autotest_common.sh@10 -- # set +x 00:05:18.482 [2024-12-16 14:09:32.852519] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:18.482 [2024-12-16 14:09:32.852569] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid203129 ] 00:05:18.482 EAL: No free 2048 kB hugepages reported on node 1 00:05:18.482 [2024-12-16 14:09:32.900382] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:18.482 [2024-12-16 14:09:32.974192] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:18.482 [2024-12-16 14:09:32.974310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:19.418 14:09:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.418 14:09:33 -- common/autotest_common.sh@862 -- # return 0 00:05:19.418 14:09:33 -- event/cpu_locks.sh@49 -- # locks_exist 203129 00:05:19.418 14:09:33 -- event/cpu_locks.sh@22 -- # lslocks -p 203129 00:05:19.418 14:09:33 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:19.676 lslocks: write error 00:05:19.676 14:09:34 -- event/cpu_locks.sh@50 -- # killprocess 203129 00:05:19.676 14:09:34 -- common/autotest_common.sh@936 -- # '[' -z 203129 ']' 00:05:19.676 14:09:34 -- common/autotest_common.sh@940 -- # kill -0 203129 00:05:19.676 14:09:34 -- common/autotest_common.sh@941 -- # uname 00:05:19.676 14:09:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:19.676 14:09:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 203129 00:05:19.676 14:09:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:19.676 14:09:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:19.676 14:09:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 203129' 00:05:19.676 killing process with pid 203129 00:05:19.676 14:09:34 -- common/autotest_common.sh@955 -- # kill 203129 00:05:19.676 14:09:34 -- common/autotest_common.sh@960 -- # wait 203129 00:05:19.935 14:09:34 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 203129 00:05:19.935 14:09:34 -- common/autotest_common.sh@650 -- # local es=0 00:05:19.935 14:09:34 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 203129 00:05:19.935 14:09:34 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:19.935 14:09:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:19.935 14:09:34 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:19.935 14:09:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:19.935 14:09:34 -- common/autotest_common.sh@653 -- # waitforlisten 203129 00:05:19.935 14:09:34 -- common/autotest_common.sh@829 -- # '[' -z 203129 ']' 00:05:19.935 14:09:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.935 14:09:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.935 14:09:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.935 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.935 14:09:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.935 14:09:34 -- common/autotest_common.sh@10 -- # set +x 00:05:19.935 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (203129) - No such process 00:05:19.935 ERROR: process (pid: 203129) is no longer running 00:05:19.935 14:09:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:19.935 14:09:34 -- common/autotest_common.sh@862 -- # return 1 00:05:19.935 14:09:34 -- common/autotest_common.sh@653 -- # es=1 00:05:19.935 14:09:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:19.935 14:09:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:19.935 14:09:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:19.935 14:09:34 -- event/cpu_locks.sh@54 -- # no_locks 00:05:19.935 14:09:34 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:19.935 14:09:34 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:19.935 14:09:34 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:19.935 00:05:19.935 real 0m1.634s 00:05:19.935 user 0m1.711s 00:05:19.936 sys 0m0.531s 00:05:19.936 14:09:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:19.936 14:09:34 -- common/autotest_common.sh@10 -- # set +x 00:05:19.936 ************************************ 00:05:19.936 END TEST default_locks 00:05:19.936 ************************************ 00:05:19.936 14:09:34 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:05:19.936 14:09:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:19.936 14:09:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:19.936 14:09:34 -- common/autotest_common.sh@10 -- # set +x 00:05:19.936 ************************************ 00:05:19.936 START TEST default_locks_via_rpc 00:05:19.936 ************************************ 00:05:19.936 14:09:34 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:05:19.936 14:09:34 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=203477 00:05:19.936 14:09:34 -- event/cpu_locks.sh@63 -- # waitforlisten 203477 00:05:19.936 14:09:34 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:19.936 14:09:34 -- common/autotest_common.sh@829 -- # '[' -z 203477 ']' 00:05:19.936 14:09:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:19.936 14:09:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:19.936 14:09:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:19.936 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:19.936 14:09:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:19.936 14:09:34 -- common/autotest_common.sh@10 -- # set +x 00:05:20.195 [2024-12-16 14:09:34.527786] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.195 [2024-12-16 14:09:34.527838] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid203477 ] 00:05:20.195 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.195 [2024-12-16 14:09:34.582447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.195 [2024-12-16 14:09:34.650349] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.195 [2024-12-16 14:09:34.650484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.128 14:09:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.128 14:09:35 -- common/autotest_common.sh@862 -- # return 0 00:05:21.128 14:09:35 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:05:21.128 14:09:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:21.128 14:09:35 -- common/autotest_common.sh@10 -- # set +x 00:05:21.128 14:09:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:21.128 14:09:35 -- event/cpu_locks.sh@67 -- # no_locks 00:05:21.128 14:09:35 -- event/cpu_locks.sh@26 -- # lock_files=() 00:05:21.128 14:09:35 -- event/cpu_locks.sh@26 -- # local lock_files 00:05:21.128 14:09:35 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:05:21.128 14:09:35 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:05:21.128 14:09:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:21.128 14:09:35 -- common/autotest_common.sh@10 -- # set +x 00:05:21.128 14:09:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:21.128 14:09:35 -- event/cpu_locks.sh@71 -- # locks_exist 203477 00:05:21.128 14:09:35 -- event/cpu_locks.sh@22 -- # lslocks -p 203477 00:05:21.128 14:09:35 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:21.128 14:09:35 -- event/cpu_locks.sh@73 -- # killprocess 203477 00:05:21.128 14:09:35 -- common/autotest_common.sh@936 -- # '[' -z 203477 ']' 00:05:21.128 14:09:35 -- common/autotest_common.sh@940 -- # kill -0 203477 00:05:21.128 14:09:35 -- common/autotest_common.sh@941 -- # uname 00:05:21.128 14:09:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:21.128 14:09:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 203477 00:05:21.128 14:09:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:21.128 14:09:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:21.128 14:09:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 203477' 00:05:21.128 killing process with pid 203477 00:05:21.128 14:09:35 -- common/autotest_common.sh@955 -- # kill 203477 00:05:21.128 14:09:35 -- common/autotest_common.sh@960 -- # wait 203477 00:05:21.387 00:05:21.387 real 0m1.473s 00:05:21.387 user 0m1.574s 00:05:21.387 sys 0m0.451s 00:05:21.387 14:09:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:21.387 14:09:35 -- common/autotest_common.sh@10 -- # set +x 00:05:21.387 ************************************ 00:05:21.387 END TEST default_locks_via_rpc 00:05:21.387 ************************************ 00:05:21.646 14:09:35 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:05:21.646 14:09:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:21.646 14:09:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:21.646 14:09:35 -- common/autotest_common.sh@10 -- # set +x 00:05:21.646 ************************************ 00:05:21.646 START TEST non_locking_app_on_locked_coremask 00:05:21.646 ************************************ 00:05:21.646 14:09:35 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:05:21.646 14:09:35 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=203826 00:05:21.646 14:09:35 -- event/cpu_locks.sh@81 -- # waitforlisten 203826 /var/tmp/spdk.sock 00:05:21.646 14:09:35 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:21.646 14:09:35 -- common/autotest_common.sh@829 -- # '[' -z 203826 ']' 00:05:21.646 14:09:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:21.646 14:09:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:21.646 14:09:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:21.646 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:21.646 14:09:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:21.646 14:09:35 -- common/autotest_common.sh@10 -- # set +x 00:05:21.646 [2024-12-16 14:09:36.037057] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:21.646 [2024-12-16 14:09:36.037105] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid203826 ] 00:05:21.646 EAL: No free 2048 kB hugepages reported on node 1 00:05:21.646 [2024-12-16 14:09:36.091145] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:21.646 [2024-12-16 14:09:36.166703] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:21.646 [2024-12-16 14:09:36.166819] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:22.582 14:09:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:22.582 14:09:36 -- common/autotest_common.sh@862 -- # return 0 00:05:22.582 14:09:36 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=203871 00:05:22.582 14:09:36 -- event/cpu_locks.sh@85 -- # waitforlisten 203871 /var/tmp/spdk2.sock 00:05:22.582 14:09:36 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:05:22.582 14:09:36 -- common/autotest_common.sh@829 -- # '[' -z 203871 ']' 00:05:22.582 14:09:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:22.582 14:09:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:22.582 14:09:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:22.582 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:22.582 14:09:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:22.582 14:09:36 -- common/autotest_common.sh@10 -- # set +x 00:05:22.582 [2024-12-16 14:09:36.885432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:22.582 [2024-12-16 14:09:36.885482] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid203871 ] 00:05:22.582 EAL: No free 2048 kB hugepages reported on node 1 00:05:22.582 [2024-12-16 14:09:36.957407] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:22.582 [2024-12-16 14:09:36.957433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:22.582 [2024-12-16 14:09:37.102995] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:22.582 [2024-12-16 14:09:37.103114] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:23.148 14:09:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:23.148 14:09:37 -- common/autotest_common.sh@862 -- # return 0 00:05:23.148 14:09:37 -- event/cpu_locks.sh@87 -- # locks_exist 203826 00:05:23.148 14:09:37 -- event/cpu_locks.sh@22 -- # lslocks -p 203826 00:05:23.148 14:09:37 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:23.714 lslocks: write error 00:05:23.714 14:09:38 -- event/cpu_locks.sh@89 -- # killprocess 203826 00:05:23.714 14:09:38 -- common/autotest_common.sh@936 -- # '[' -z 203826 ']' 00:05:23.714 14:09:38 -- common/autotest_common.sh@940 -- # kill -0 203826 00:05:23.714 14:09:38 -- common/autotest_common.sh@941 -- # uname 00:05:23.714 14:09:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:23.714 14:09:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 203826 00:05:23.976 14:09:38 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:23.976 14:09:38 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:23.976 14:09:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 203826' 00:05:23.976 killing process with pid 203826 00:05:23.976 14:09:38 -- common/autotest_common.sh@955 -- # kill 203826 00:05:23.976 14:09:38 -- common/autotest_common.sh@960 -- # wait 203826 00:05:24.688 14:09:38 -- event/cpu_locks.sh@90 -- # killprocess 203871 00:05:24.688 14:09:38 -- common/autotest_common.sh@936 -- # '[' -z 203871 ']' 00:05:24.688 14:09:38 -- common/autotest_common.sh@940 -- # kill -0 203871 00:05:24.688 14:09:38 -- common/autotest_common.sh@941 -- # uname 00:05:24.688 14:09:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:24.688 14:09:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 203871 00:05:24.688 14:09:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:24.688 14:09:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:24.688 14:09:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 203871' 00:05:24.688 killing process with pid 203871 00:05:24.688 14:09:39 -- common/autotest_common.sh@955 -- # kill 203871 00:05:24.689 14:09:39 -- common/autotest_common.sh@960 -- # wait 203871 00:05:24.947 00:05:24.947 real 0m3.362s 00:05:24.947 user 0m3.633s 00:05:24.947 sys 0m0.927s 00:05:24.947 14:09:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:24.947 14:09:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.947 ************************************ 00:05:24.947 END TEST non_locking_app_on_locked_coremask 00:05:24.947 ************************************ 00:05:24.947 14:09:39 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:05:24.947 14:09:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:24.947 14:09:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:24.947 14:09:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.947 ************************************ 00:05:24.947 START TEST locking_app_on_unlocked_coremask 00:05:24.947 ************************************ 00:05:24.947 14:09:39 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:05:24.947 14:09:39 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=204361 00:05:24.947 14:09:39 -- event/cpu_locks.sh@99 -- # waitforlisten 204361 /var/tmp/spdk.sock 00:05:24.947 14:09:39 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:05:24.947 14:09:39 -- common/autotest_common.sh@829 -- # '[' -z 204361 ']' 00:05:24.947 14:09:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:24.947 14:09:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:24.947 14:09:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:24.947 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:24.947 14:09:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:24.947 14:09:39 -- common/autotest_common.sh@10 -- # set +x 00:05:24.947 [2024-12-16 14:09:39.444380] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:24.947 [2024-12-16 14:09:39.444429] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid204361 ] 00:05:24.947 EAL: No free 2048 kB hugepages reported on node 1 00:05:24.947 [2024-12-16 14:09:39.498690] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:24.947 [2024-12-16 14:09:39.498721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:25.206 [2024-12-16 14:09:39.563864] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:25.206 [2024-12-16 14:09:39.564003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:25.773 14:09:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:25.773 14:09:40 -- common/autotest_common.sh@862 -- # return 0 00:05:25.773 14:09:40 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=204589 00:05:25.773 14:09:40 -- event/cpu_locks.sh@103 -- # waitforlisten 204589 /var/tmp/spdk2.sock 00:05:25.773 14:09:40 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:25.773 14:09:40 -- common/autotest_common.sh@829 -- # '[' -z 204589 ']' 00:05:25.773 14:09:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:25.773 14:09:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:25.773 14:09:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:25.773 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:25.773 14:09:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:25.773 14:09:40 -- common/autotest_common.sh@10 -- # set +x 00:05:25.773 [2024-12-16 14:09:40.303303] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:25.773 [2024-12-16 14:09:40.303354] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid204589 ] 00:05:25.773 EAL: No free 2048 kB hugepages reported on node 1 00:05:26.032 [2024-12-16 14:09:40.379611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:26.032 [2024-12-16 14:09:40.517633] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:26.032 [2024-12-16 14:09:40.517750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:26.600 14:09:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:26.600 14:09:41 -- common/autotest_common.sh@862 -- # return 0 00:05:26.600 14:09:41 -- event/cpu_locks.sh@105 -- # locks_exist 204589 00:05:26.600 14:09:41 -- event/cpu_locks.sh@22 -- # lslocks -p 204589 00:05:26.600 14:09:41 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:27.167 lslocks: write error 00:05:27.167 14:09:41 -- event/cpu_locks.sh@107 -- # killprocess 204361 00:05:27.167 14:09:41 -- common/autotest_common.sh@936 -- # '[' -z 204361 ']' 00:05:27.167 14:09:41 -- common/autotest_common.sh@940 -- # kill -0 204361 00:05:27.167 14:09:41 -- common/autotest_common.sh@941 -- # uname 00:05:27.167 14:09:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:27.167 14:09:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 204361 00:05:27.167 14:09:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:27.167 14:09:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:27.167 14:09:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 204361' 00:05:27.167 killing process with pid 204361 00:05:27.167 14:09:41 -- common/autotest_common.sh@955 -- # kill 204361 00:05:27.167 14:09:41 -- common/autotest_common.sh@960 -- # wait 204361 00:05:28.104 14:09:42 -- event/cpu_locks.sh@108 -- # killprocess 204589 00:05:28.104 14:09:42 -- common/autotest_common.sh@936 -- # '[' -z 204589 ']' 00:05:28.104 14:09:42 -- common/autotest_common.sh@940 -- # kill -0 204589 00:05:28.104 14:09:42 -- common/autotest_common.sh@941 -- # uname 00:05:28.104 14:09:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:28.104 14:09:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 204589 00:05:28.104 14:09:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:28.104 14:09:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:28.104 14:09:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 204589' 00:05:28.104 killing process with pid 204589 00:05:28.104 14:09:42 -- common/autotest_common.sh@955 -- # kill 204589 00:05:28.104 14:09:42 -- common/autotest_common.sh@960 -- # wait 204589 00:05:28.363 00:05:28.363 real 0m3.301s 00:05:28.363 user 0m3.564s 00:05:28.363 sys 0m0.898s 00:05:28.363 14:09:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.363 14:09:42 -- common/autotest_common.sh@10 -- # set +x 00:05:28.363 ************************************ 00:05:28.363 END TEST locking_app_on_unlocked_coremask 00:05:28.363 ************************************ 00:05:28.363 14:09:42 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:05:28.363 14:09:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.363 14:09:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.363 14:09:42 -- common/autotest_common.sh@10 -- # set +x 00:05:28.363 ************************************ 00:05:28.363 START TEST locking_app_on_locked_coremask 00:05:28.363 ************************************ 00:05:28.363 14:09:42 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:05:28.363 14:09:42 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=205007 00:05:28.363 14:09:42 -- event/cpu_locks.sh@116 -- # waitforlisten 205007 /var/tmp/spdk.sock 00:05:28.363 14:09:42 -- common/autotest_common.sh@829 -- # '[' -z 205007 ']' 00:05:28.363 14:09:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:28.363 14:09:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:28.363 14:09:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:28.363 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:28.363 14:09:42 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:05:28.363 14:09:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:28.363 14:09:42 -- common/autotest_common.sh@10 -- # set +x 00:05:28.363 [2024-12-16 14:09:42.779334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:28.363 [2024-12-16 14:09:42.779384] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid205007 ] 00:05:28.363 EAL: No free 2048 kB hugepages reported on node 1 00:05:28.363 [2024-12-16 14:09:42.834054] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:28.363 [2024-12-16 14:09:42.911277] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:28.363 [2024-12-16 14:09:42.911390] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:29.300 14:09:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.300 14:09:43 -- common/autotest_common.sh@862 -- # return 0 00:05:29.300 14:09:43 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=205087 00:05:29.300 14:09:43 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 205087 /var/tmp/spdk2.sock 00:05:29.300 14:09:43 -- common/autotest_common.sh@650 -- # local es=0 00:05:29.300 14:09:43 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 205087 /var/tmp/spdk2.sock 00:05:29.300 14:09:43 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:29.300 14:09:43 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:05:29.300 14:09:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.300 14:09:43 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:29.300 14:09:43 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:29.300 14:09:43 -- common/autotest_common.sh@653 -- # waitforlisten 205087 /var/tmp/spdk2.sock 00:05:29.300 14:09:43 -- common/autotest_common.sh@829 -- # '[' -z 205087 ']' 00:05:29.300 14:09:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:29.300 14:09:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:29.300 14:09:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:29.300 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:29.300 14:09:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:29.300 14:09:43 -- common/autotest_common.sh@10 -- # set +x 00:05:29.300 [2024-12-16 14:09:43.628333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:29.300 [2024-12-16 14:09:43.628384] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid205087 ] 00:05:29.300 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.300 [2024-12-16 14:09:43.700390] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 205007 has claimed it. 00:05:29.300 [2024-12-16 14:09:43.700420] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:29.868 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (205087) - No such process 00:05:29.868 ERROR: process (pid: 205087) is no longer running 00:05:29.868 14:09:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:29.868 14:09:44 -- common/autotest_common.sh@862 -- # return 1 00:05:29.868 14:09:44 -- common/autotest_common.sh@653 -- # es=1 00:05:29.868 14:09:44 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:29.868 14:09:44 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:29.868 14:09:44 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:29.868 14:09:44 -- event/cpu_locks.sh@122 -- # locks_exist 205007 00:05:29.868 14:09:44 -- event/cpu_locks.sh@22 -- # lslocks -p 205007 00:05:29.868 14:09:44 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:05:30.436 lslocks: write error 00:05:30.436 14:09:44 -- event/cpu_locks.sh@124 -- # killprocess 205007 00:05:30.436 14:09:44 -- common/autotest_common.sh@936 -- # '[' -z 205007 ']' 00:05:30.436 14:09:44 -- common/autotest_common.sh@940 -- # kill -0 205007 00:05:30.436 14:09:44 -- common/autotest_common.sh@941 -- # uname 00:05:30.436 14:09:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:30.436 14:09:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 205007 00:05:30.436 14:09:44 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:30.436 14:09:44 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:30.436 14:09:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 205007' 00:05:30.436 killing process with pid 205007 00:05:30.436 14:09:44 -- common/autotest_common.sh@955 -- # kill 205007 00:05:30.436 14:09:44 -- common/autotest_common.sh@960 -- # wait 205007 00:05:30.697 00:05:30.697 real 0m2.435s 00:05:30.697 user 0m2.687s 00:05:30.697 sys 0m0.654s 00:05:30.697 14:09:45 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:30.697 14:09:45 -- common/autotest_common.sh@10 -- # set +x 00:05:30.697 ************************************ 00:05:30.697 END TEST locking_app_on_locked_coremask 00:05:30.697 ************************************ 00:05:30.697 14:09:45 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:05:30.697 14:09:45 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:30.697 14:09:45 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:30.697 14:09:45 -- common/autotest_common.sh@10 -- # set +x 00:05:30.697 ************************************ 00:05:30.697 START TEST locking_overlapped_coremask 00:05:30.697 ************************************ 00:05:30.697 14:09:45 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:05:30.697 14:09:45 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=205354 00:05:30.697 14:09:45 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:05:30.697 14:09:45 -- event/cpu_locks.sh@133 -- # waitforlisten 205354 /var/tmp/spdk.sock 00:05:30.697 14:09:45 -- common/autotest_common.sh@829 -- # '[' -z 205354 ']' 00:05:30.697 14:09:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:30.697 14:09:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:30.697 14:09:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:30.697 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:30.697 14:09:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:30.697 14:09:45 -- common/autotest_common.sh@10 -- # set +x 00:05:30.697 [2024-12-16 14:09:45.241637] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:30.697 [2024-12-16 14:09:45.241686] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid205354 ] 00:05:30.697 EAL: No free 2048 kB hugepages reported on node 1 00:05:30.955 [2024-12-16 14:09:45.289738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:30.955 [2024-12-16 14:09:45.365508] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:30.955 [2024-12-16 14:09:45.365666] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:30.955 [2024-12-16 14:09:45.365680] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:30.955 [2024-12-16 14:09:45.365682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:31.523 14:09:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:31.523 14:09:46 -- common/autotest_common.sh@862 -- # return 0 00:05:31.523 14:09:46 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:05:31.523 14:09:46 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=205578 00:05:31.523 14:09:46 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 205578 /var/tmp/spdk2.sock 00:05:31.523 14:09:46 -- common/autotest_common.sh@650 -- # local es=0 00:05:31.523 14:09:46 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 205578 /var/tmp/spdk2.sock 00:05:31.523 14:09:46 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:05:31.523 14:09:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:31.523 14:09:46 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:05:31.523 14:09:46 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:31.523 14:09:46 -- common/autotest_common.sh@653 -- # waitforlisten 205578 /var/tmp/spdk2.sock 00:05:31.523 14:09:46 -- common/autotest_common.sh@829 -- # '[' -z 205578 ']' 00:05:31.523 14:09:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:31.523 14:09:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:31.523 14:09:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:31.523 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:31.523 14:09:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:31.523 14:09:46 -- common/autotest_common.sh@10 -- # set +x 00:05:31.782 [2024-12-16 14:09:46.106288] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:31.782 [2024-12-16 14:09:46.106335] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid205578 ] 00:05:31.782 EAL: No free 2048 kB hugepages reported on node 1 00:05:31.782 [2024-12-16 14:09:46.180588] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 205354 has claimed it. 00:05:31.782 [2024-12-16 14:09:46.180626] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:05:32.350 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (205578) - No such process 00:05:32.350 ERROR: process (pid: 205578) is no longer running 00:05:32.350 14:09:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:32.350 14:09:46 -- common/autotest_common.sh@862 -- # return 1 00:05:32.350 14:09:46 -- common/autotest_common.sh@653 -- # es=1 00:05:32.350 14:09:46 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:32.350 14:09:46 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:32.350 14:09:46 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:32.350 14:09:46 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:05:32.350 14:09:46 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:32.350 14:09:46 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:32.350 14:09:46 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:32.350 14:09:46 -- event/cpu_locks.sh@141 -- # killprocess 205354 00:05:32.350 14:09:46 -- common/autotest_common.sh@936 -- # '[' -z 205354 ']' 00:05:32.350 14:09:46 -- common/autotest_common.sh@940 -- # kill -0 205354 00:05:32.350 14:09:46 -- common/autotest_common.sh@941 -- # uname 00:05:32.350 14:09:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:32.350 14:09:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 205354 00:05:32.350 14:09:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:32.350 14:09:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:32.350 14:09:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 205354' 00:05:32.350 killing process with pid 205354 00:05:32.350 14:09:46 -- common/autotest_common.sh@955 -- # kill 205354 00:05:32.350 14:09:46 -- common/autotest_common.sh@960 -- # wait 205354 00:05:32.609 00:05:32.609 real 0m1.927s 00:05:32.609 user 0m5.491s 00:05:32.609 sys 0m0.383s 00:05:32.609 14:09:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:32.609 14:09:47 -- common/autotest_common.sh@10 -- # set +x 00:05:32.609 ************************************ 00:05:32.609 END TEST locking_overlapped_coremask 00:05:32.609 ************************************ 00:05:32.609 14:09:47 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:05:32.609 14:09:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:32.609 14:09:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:32.609 14:09:47 -- common/autotest_common.sh@10 -- # set +x 00:05:32.609 ************************************ 00:05:32.609 START TEST locking_overlapped_coremask_via_rpc 00:05:32.609 ************************************ 00:05:32.609 14:09:47 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:05:32.609 14:09:47 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=205831 00:05:32.609 14:09:47 -- event/cpu_locks.sh@149 -- # waitforlisten 205831 /var/tmp/spdk.sock 00:05:32.609 14:09:47 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:05:32.609 14:09:47 -- common/autotest_common.sh@829 -- # '[' -z 205831 ']' 00:05:32.609 14:09:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:32.609 14:09:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:32.609 14:09:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:32.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:32.609 14:09:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:32.610 14:09:47 -- common/autotest_common.sh@10 -- # set +x 00:05:32.868 [2024-12-16 14:09:47.220968] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:32.869 [2024-12-16 14:09:47.221017] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid205831 ] 00:05:32.869 EAL: No free 2048 kB hugepages reported on node 1 00:05:32.869 [2024-12-16 14:09:47.273875] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:32.869 [2024-12-16 14:09:47.273905] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:32.869 [2024-12-16 14:09:47.339835] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:32.869 [2024-12-16 14:09:47.340049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:32.869 [2024-12-16 14:09:47.340148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:32.869 [2024-12-16 14:09:47.340150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:33.805 14:09:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:33.805 14:09:48 -- common/autotest_common.sh@862 -- # return 0 00:05:33.805 14:09:48 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=205906 00:05:33.805 14:09:48 -- event/cpu_locks.sh@153 -- # waitforlisten 205906 /var/tmp/spdk2.sock 00:05:33.805 14:09:48 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:05:33.805 14:09:48 -- common/autotest_common.sh@829 -- # '[' -z 205906 ']' 00:05:33.805 14:09:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:33.805 14:09:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:33.805 14:09:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:33.805 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:33.805 14:09:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:33.805 14:09:48 -- common/autotest_common.sh@10 -- # set +x 00:05:33.805 [2024-12-16 14:09:48.076251] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.805 [2024-12-16 14:09:48.076304] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid205906 ] 00:05:33.805 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.805 [2024-12-16 14:09:48.157192] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:05:33.805 [2024-12-16 14:09:48.157223] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:05:33.805 [2024-12-16 14:09:48.297496] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:33.805 [2024-12-16 14:09:48.297661] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:33.805 [2024-12-16 14:09:48.300901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:33.805 [2024-12-16 14:09:48.300903] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:05:34.373 14:09:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.373 14:09:48 -- common/autotest_common.sh@862 -- # return 0 00:05:34.373 14:09:48 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:05:34.373 14:09:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.373 14:09:48 -- common/autotest_common.sh@10 -- # set +x 00:05:34.373 14:09:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.373 14:09:48 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:34.373 14:09:48 -- common/autotest_common.sh@650 -- # local es=0 00:05:34.373 14:09:48 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:34.373 14:09:48 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:05:34.373 14:09:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:34.373 14:09:48 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:05:34.373 14:09:48 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:34.373 14:09:48 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:05:34.373 14:09:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.373 14:09:48 -- common/autotest_common.sh@10 -- # set +x 00:05:34.373 [2024-12-16 14:09:48.916924] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 205831 has claimed it. 00:05:34.373 request: 00:05:34.373 { 00:05:34.373 "method": "framework_enable_cpumask_locks", 00:05:34.373 "req_id": 1 00:05:34.373 } 00:05:34.373 Got JSON-RPC error response 00:05:34.373 response: 00:05:34.373 { 00:05:34.373 "code": -32603, 00:05:34.373 "message": "Failed to claim CPU core: 2" 00:05:34.373 } 00:05:34.373 14:09:48 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:05:34.373 14:09:48 -- common/autotest_common.sh@653 -- # es=1 00:05:34.373 14:09:48 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:34.373 14:09:48 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:34.373 14:09:48 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:34.373 14:09:48 -- event/cpu_locks.sh@158 -- # waitforlisten 205831 /var/tmp/spdk.sock 00:05:34.373 14:09:48 -- common/autotest_common.sh@829 -- # '[' -z 205831 ']' 00:05:34.373 14:09:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:34.373 14:09:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:34.373 14:09:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:34.373 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:34.373 14:09:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:34.373 14:09:48 -- common/autotest_common.sh@10 -- # set +x 00:05:34.631 14:09:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.631 14:09:49 -- common/autotest_common.sh@862 -- # return 0 00:05:34.631 14:09:49 -- event/cpu_locks.sh@159 -- # waitforlisten 205906 /var/tmp/spdk2.sock 00:05:34.631 14:09:49 -- common/autotest_common.sh@829 -- # '[' -z 205906 ']' 00:05:34.632 14:09:49 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:05:34.632 14:09:49 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:34.632 14:09:49 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:05:34.632 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:05:34.632 14:09:49 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:34.632 14:09:49 -- common/autotest_common.sh@10 -- # set +x 00:05:34.891 14:09:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.891 14:09:49 -- common/autotest_common.sh@862 -- # return 0 00:05:34.891 14:09:49 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:05:34.891 14:09:49 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:05:34.891 14:09:49 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:05:34.891 14:09:49 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:05:34.891 00:05:34.891 real 0m2.126s 00:05:34.891 user 0m0.906s 00:05:34.891 sys 0m0.160s 00:05:34.891 14:09:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.891 14:09:49 -- common/autotest_common.sh@10 -- # set +x 00:05:34.891 ************************************ 00:05:34.891 END TEST locking_overlapped_coremask_via_rpc 00:05:34.891 ************************************ 00:05:34.891 14:09:49 -- event/cpu_locks.sh@174 -- # cleanup 00:05:34.891 14:09:49 -- event/cpu_locks.sh@15 -- # [[ -z 205831 ]] 00:05:34.891 14:09:49 -- event/cpu_locks.sh@15 -- # killprocess 205831 00:05:34.891 14:09:49 -- common/autotest_common.sh@936 -- # '[' -z 205831 ']' 00:05:34.891 14:09:49 -- common/autotest_common.sh@940 -- # kill -0 205831 00:05:34.891 14:09:49 -- common/autotest_common.sh@941 -- # uname 00:05:34.891 14:09:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:34.891 14:09:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 205831 00:05:34.891 14:09:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:34.891 14:09:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:34.891 14:09:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 205831' 00:05:34.891 killing process with pid 205831 00:05:34.891 14:09:49 -- common/autotest_common.sh@955 -- # kill 205831 00:05:34.891 14:09:49 -- common/autotest_common.sh@960 -- # wait 205831 00:05:35.459 14:09:49 -- event/cpu_locks.sh@16 -- # [[ -z 205906 ]] 00:05:35.459 14:09:49 -- event/cpu_locks.sh@16 -- # killprocess 205906 00:05:35.459 14:09:49 -- common/autotest_common.sh@936 -- # '[' -z 205906 ']' 00:05:35.459 14:09:49 -- common/autotest_common.sh@940 -- # kill -0 205906 00:05:35.459 14:09:49 -- common/autotest_common.sh@941 -- # uname 00:05:35.459 14:09:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.459 14:09:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 205906 00:05:35.459 14:09:49 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:05:35.459 14:09:49 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:05:35.459 14:09:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 205906' 00:05:35.459 killing process with pid 205906 00:05:35.459 14:09:49 -- common/autotest_common.sh@955 -- # kill 205906 00:05:35.459 14:09:49 -- common/autotest_common.sh@960 -- # wait 205906 00:05:35.718 14:09:50 -- event/cpu_locks.sh@18 -- # rm -f 00:05:35.718 14:09:50 -- event/cpu_locks.sh@1 -- # cleanup 00:05:35.718 14:09:50 -- event/cpu_locks.sh@15 -- # [[ -z 205831 ]] 00:05:35.718 14:09:50 -- event/cpu_locks.sh@15 -- # killprocess 205831 00:05:35.718 14:09:50 -- common/autotest_common.sh@936 -- # '[' -z 205831 ']' 00:05:35.718 14:09:50 -- common/autotest_common.sh@940 -- # kill -0 205831 00:05:35.718 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (205831) - No such process 00:05:35.718 14:09:50 -- common/autotest_common.sh@963 -- # echo 'Process with pid 205831 is not found' 00:05:35.718 Process with pid 205831 is not found 00:05:35.718 14:09:50 -- event/cpu_locks.sh@16 -- # [[ -z 205906 ]] 00:05:35.718 14:09:50 -- event/cpu_locks.sh@16 -- # killprocess 205906 00:05:35.718 14:09:50 -- common/autotest_common.sh@936 -- # '[' -z 205906 ']' 00:05:35.718 14:09:50 -- common/autotest_common.sh@940 -- # kill -0 205906 00:05:35.718 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (205906) - No such process 00:05:35.718 14:09:50 -- common/autotest_common.sh@963 -- # echo 'Process with pid 205906 is not found' 00:05:35.718 Process with pid 205906 is not found 00:05:35.718 14:09:50 -- event/cpu_locks.sh@18 -- # rm -f 00:05:35.718 00:05:35.718 real 0m17.505s 00:05:35.718 user 0m30.488s 00:05:35.718 sys 0m4.822s 00:05:35.718 14:09:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.718 14:09:50 -- common/autotest_common.sh@10 -- # set +x 00:05:35.718 ************************************ 00:05:35.718 END TEST cpu_locks 00:05:35.718 ************************************ 00:05:35.718 00:05:35.718 real 0m43.071s 00:05:35.718 user 1m23.024s 00:05:35.718 sys 0m8.066s 00:05:35.718 14:09:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.718 14:09:50 -- common/autotest_common.sh@10 -- # set +x 00:05:35.718 ************************************ 00:05:35.718 END TEST event 00:05:35.718 ************************************ 00:05:35.718 14:09:50 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:35.718 14:09:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.718 14:09:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.718 14:09:50 -- common/autotest_common.sh@10 -- # set +x 00:05:35.718 ************************************ 00:05:35.718 START TEST thread 00:05:35.718 ************************************ 00:05:35.718 14:09:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:05:35.718 * Looking for test storage... 00:05:35.977 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:05:35.977 14:09:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:35.977 14:09:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:35.977 14:09:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:35.977 14:09:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:35.977 14:09:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:35.977 14:09:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:35.977 14:09:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:35.977 14:09:50 -- scripts/common.sh@335 -- # IFS=.-: 00:05:35.977 14:09:50 -- scripts/common.sh@335 -- # read -ra ver1 00:05:35.977 14:09:50 -- scripts/common.sh@336 -- # IFS=.-: 00:05:35.977 14:09:50 -- scripts/common.sh@336 -- # read -ra ver2 00:05:35.977 14:09:50 -- scripts/common.sh@337 -- # local 'op=<' 00:05:35.977 14:09:50 -- scripts/common.sh@339 -- # ver1_l=2 00:05:35.977 14:09:50 -- scripts/common.sh@340 -- # ver2_l=1 00:05:35.977 14:09:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:35.977 14:09:50 -- scripts/common.sh@343 -- # case "$op" in 00:05:35.977 14:09:50 -- scripts/common.sh@344 -- # : 1 00:05:35.977 14:09:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:35.977 14:09:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:35.977 14:09:50 -- scripts/common.sh@364 -- # decimal 1 00:05:35.977 14:09:50 -- scripts/common.sh@352 -- # local d=1 00:05:35.977 14:09:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:35.977 14:09:50 -- scripts/common.sh@354 -- # echo 1 00:05:35.977 14:09:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:35.977 14:09:50 -- scripts/common.sh@365 -- # decimal 2 00:05:35.977 14:09:50 -- scripts/common.sh@352 -- # local d=2 00:05:35.977 14:09:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:35.977 14:09:50 -- scripts/common.sh@354 -- # echo 2 00:05:35.977 14:09:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:35.977 14:09:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:35.977 14:09:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:35.977 14:09:50 -- scripts/common.sh@367 -- # return 0 00:05:35.977 14:09:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:35.977 14:09:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:35.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:35.977 --rc genhtml_branch_coverage=1 00:05:35.977 --rc genhtml_function_coverage=1 00:05:35.977 --rc genhtml_legend=1 00:05:35.977 --rc geninfo_all_blocks=1 00:05:35.977 --rc geninfo_unexecuted_blocks=1 00:05:35.977 00:05:35.977 ' 00:05:35.977 14:09:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:35.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:35.977 --rc genhtml_branch_coverage=1 00:05:35.977 --rc genhtml_function_coverage=1 00:05:35.977 --rc genhtml_legend=1 00:05:35.977 --rc geninfo_all_blocks=1 00:05:35.977 --rc geninfo_unexecuted_blocks=1 00:05:35.977 00:05:35.977 ' 00:05:35.977 14:09:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:35.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:35.977 --rc genhtml_branch_coverage=1 00:05:35.977 --rc genhtml_function_coverage=1 00:05:35.977 --rc genhtml_legend=1 00:05:35.977 --rc geninfo_all_blocks=1 00:05:35.977 --rc geninfo_unexecuted_blocks=1 00:05:35.977 00:05:35.977 ' 00:05:35.977 14:09:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:35.977 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:35.977 --rc genhtml_branch_coverage=1 00:05:35.977 --rc genhtml_function_coverage=1 00:05:35.977 --rc genhtml_legend=1 00:05:35.977 --rc geninfo_all_blocks=1 00:05:35.977 --rc geninfo_unexecuted_blocks=1 00:05:35.977 00:05:35.977 ' 00:05:35.977 14:09:50 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:35.977 14:09:50 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:35.977 14:09:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.977 14:09:50 -- common/autotest_common.sh@10 -- # set +x 00:05:35.977 ************************************ 00:05:35.977 START TEST thread_poller_perf 00:05:35.977 ************************************ 00:05:35.977 14:09:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:05:35.977 [2024-12-16 14:09:50.402674] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:35.977 [2024-12-16 14:09:50.402738] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid206402 ] 00:05:35.977 EAL: No free 2048 kB hugepages reported on node 1 00:05:35.977 [2024-12-16 14:09:50.452641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:35.977 [2024-12-16 14:09:50.522992] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:35.977 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:05:37.354 [2024-12-16T13:09:51.928Z] ====================================== 00:05:37.354 [2024-12-16T13:09:51.928Z] busy:2107267292 (cyc) 00:05:37.354 [2024-12-16T13:09:51.928Z] total_run_count: 393000 00:05:37.354 [2024-12-16T13:09:51.928Z] tsc_hz: 2100000000 (cyc) 00:05:37.354 [2024-12-16T13:09:51.928Z] ====================================== 00:05:37.354 [2024-12-16T13:09:51.928Z] poller_cost: 5362 (cyc), 2553 (nsec) 00:05:37.354 00:05:37.354 real 0m1.226s 00:05:37.354 user 0m1.160s 00:05:37.354 sys 0m0.062s 00:05:37.354 14:09:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:37.354 14:09:51 -- common/autotest_common.sh@10 -- # set +x 00:05:37.354 ************************************ 00:05:37.354 END TEST thread_poller_perf 00:05:37.354 ************************************ 00:05:37.354 14:09:51 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:37.354 14:09:51 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:05:37.354 14:09:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:37.354 14:09:51 -- common/autotest_common.sh@10 -- # set +x 00:05:37.354 ************************************ 00:05:37.354 START TEST thread_poller_perf 00:05:37.354 ************************************ 00:05:37.354 14:09:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:05:37.354 [2024-12-16 14:09:51.677031] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:37.354 [2024-12-16 14:09:51.677115] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid206644 ] 00:05:37.354 EAL: No free 2048 kB hugepages reported on node 1 00:05:37.354 [2024-12-16 14:09:51.735434] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:37.354 [2024-12-16 14:09:51.802590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.354 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:05:38.730 [2024-12-16T13:09:53.304Z] ====================================== 00:05:38.730 [2024-12-16T13:09:53.304Z] busy:2102032788 (cyc) 00:05:38.730 [2024-12-16T13:09:53.304Z] total_run_count: 5448000 00:05:38.730 [2024-12-16T13:09:53.304Z] tsc_hz: 2100000000 (cyc) 00:05:38.730 [2024-12-16T13:09:53.304Z] ====================================== 00:05:38.730 [2024-12-16T13:09:53.304Z] poller_cost: 385 (cyc), 183 (nsec) 00:05:38.730 00:05:38.730 real 0m1.234s 00:05:38.730 user 0m1.153s 00:05:38.730 sys 0m0.076s 00:05:38.730 14:09:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.730 14:09:52 -- common/autotest_common.sh@10 -- # set +x 00:05:38.730 ************************************ 00:05:38.730 END TEST thread_poller_perf 00:05:38.730 ************************************ 00:05:38.730 14:09:52 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:05:38.730 00:05:38.730 real 0m2.710s 00:05:38.730 user 0m2.441s 00:05:38.730 sys 0m0.287s 00:05:38.730 14:09:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:38.730 14:09:52 -- common/autotest_common.sh@10 -- # set +x 00:05:38.730 ************************************ 00:05:38.730 END TEST thread 00:05:38.730 ************************************ 00:05:38.730 14:09:52 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:38.730 14:09:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:38.730 14:09:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:38.730 14:09:52 -- common/autotest_common.sh@10 -- # set +x 00:05:38.730 ************************************ 00:05:38.730 START TEST accel 00:05:38.730 ************************************ 00:05:38.730 14:09:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:05:38.730 * Looking for test storage... 00:05:38.730 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:05:38.730 14:09:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:38.730 14:09:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:38.730 14:09:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:38.730 14:09:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:38.730 14:09:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:38.730 14:09:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:38.730 14:09:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:38.730 14:09:53 -- scripts/common.sh@335 -- # IFS=.-: 00:05:38.730 14:09:53 -- scripts/common.sh@335 -- # read -ra ver1 00:05:38.730 14:09:53 -- scripts/common.sh@336 -- # IFS=.-: 00:05:38.730 14:09:53 -- scripts/common.sh@336 -- # read -ra ver2 00:05:38.730 14:09:53 -- scripts/common.sh@337 -- # local 'op=<' 00:05:38.730 14:09:53 -- scripts/common.sh@339 -- # ver1_l=2 00:05:38.730 14:09:53 -- scripts/common.sh@340 -- # ver2_l=1 00:05:38.730 14:09:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:38.730 14:09:53 -- scripts/common.sh@343 -- # case "$op" in 00:05:38.730 14:09:53 -- scripts/common.sh@344 -- # : 1 00:05:38.730 14:09:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:38.730 14:09:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:38.730 14:09:53 -- scripts/common.sh@364 -- # decimal 1 00:05:38.730 14:09:53 -- scripts/common.sh@352 -- # local d=1 00:05:38.730 14:09:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:38.730 14:09:53 -- scripts/common.sh@354 -- # echo 1 00:05:38.730 14:09:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:38.730 14:09:53 -- scripts/common.sh@365 -- # decimal 2 00:05:38.730 14:09:53 -- scripts/common.sh@352 -- # local d=2 00:05:38.730 14:09:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:38.730 14:09:53 -- scripts/common.sh@354 -- # echo 2 00:05:38.730 14:09:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:38.730 14:09:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:38.730 14:09:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:38.730 14:09:53 -- scripts/common.sh@367 -- # return 0 00:05:38.730 14:09:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:38.730 14:09:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:38.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.730 --rc genhtml_branch_coverage=1 00:05:38.730 --rc genhtml_function_coverage=1 00:05:38.730 --rc genhtml_legend=1 00:05:38.730 --rc geninfo_all_blocks=1 00:05:38.730 --rc geninfo_unexecuted_blocks=1 00:05:38.730 00:05:38.730 ' 00:05:38.730 14:09:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:38.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.730 --rc genhtml_branch_coverage=1 00:05:38.730 --rc genhtml_function_coverage=1 00:05:38.730 --rc genhtml_legend=1 00:05:38.730 --rc geninfo_all_blocks=1 00:05:38.730 --rc geninfo_unexecuted_blocks=1 00:05:38.730 00:05:38.730 ' 00:05:38.730 14:09:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:38.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.730 --rc genhtml_branch_coverage=1 00:05:38.730 --rc genhtml_function_coverage=1 00:05:38.730 --rc genhtml_legend=1 00:05:38.730 --rc geninfo_all_blocks=1 00:05:38.730 --rc geninfo_unexecuted_blocks=1 00:05:38.730 00:05:38.730 ' 00:05:38.730 14:09:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:38.730 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:38.730 --rc genhtml_branch_coverage=1 00:05:38.730 --rc genhtml_function_coverage=1 00:05:38.730 --rc genhtml_legend=1 00:05:38.730 --rc geninfo_all_blocks=1 00:05:38.730 --rc geninfo_unexecuted_blocks=1 00:05:38.730 00:05:38.730 ' 00:05:38.730 14:09:53 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:05:38.730 14:09:53 -- accel/accel.sh@74 -- # get_expected_opcs 00:05:38.730 14:09:53 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:38.730 14:09:53 -- accel/accel.sh@59 -- # spdk_tgt_pid=206943 00:05:38.730 14:09:53 -- accel/accel.sh@60 -- # waitforlisten 206943 00:05:38.730 14:09:53 -- common/autotest_common.sh@829 -- # '[' -z 206943 ']' 00:05:38.730 14:09:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:38.730 14:09:53 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:05:38.730 14:09:53 -- accel/accel.sh@58 -- # build_accel_config 00:05:38.730 14:09:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:38.730 14:09:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:38.730 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:38.730 14:09:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:38.730 14:09:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:38.730 14:09:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:38.730 14:09:53 -- common/autotest_common.sh@10 -- # set +x 00:05:38.730 14:09:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:38.730 14:09:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:38.730 14:09:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:38.730 14:09:53 -- accel/accel.sh@41 -- # local IFS=, 00:05:38.730 14:09:53 -- accel/accel.sh@42 -- # jq -r . 00:05:38.730 [2024-12-16 14:09:53.168986] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:38.730 [2024-12-16 14:09:53.169036] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid206943 ] 00:05:38.730 EAL: No free 2048 kB hugepages reported on node 1 00:05:38.730 [2024-12-16 14:09:53.224152] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:38.730 [2024-12-16 14:09:53.291611] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:38.730 [2024-12-16 14:09:53.291728] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:39.666 14:09:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:39.666 14:09:53 -- common/autotest_common.sh@862 -- # return 0 00:05:39.666 14:09:53 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:05:39.666 14:09:53 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:05:39.666 14:09:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:39.666 14:09:53 -- common/autotest_common.sh@10 -- # set +x 00:05:39.666 14:09:53 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:05:39.666 14:09:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # IFS== 00:05:39.666 14:09:54 -- accel/accel.sh@64 -- # read -r opc module 00:05:39.666 14:09:54 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:05:39.666 14:09:54 -- accel/accel.sh@67 -- # killprocess 206943 00:05:39.666 14:09:54 -- common/autotest_common.sh@936 -- # '[' -z 206943 ']' 00:05:39.666 14:09:54 -- common/autotest_common.sh@940 -- # kill -0 206943 00:05:39.666 14:09:54 -- common/autotest_common.sh@941 -- # uname 00:05:39.666 14:09:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:39.666 14:09:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 206943 00:05:39.666 14:09:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:39.666 14:09:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:39.666 14:09:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 206943' 00:05:39.666 killing process with pid 206943 00:05:39.666 14:09:54 -- common/autotest_common.sh@955 -- # kill 206943 00:05:39.666 14:09:54 -- common/autotest_common.sh@960 -- # wait 206943 00:05:39.925 14:09:54 -- accel/accel.sh@68 -- # trap - ERR 00:05:39.925 14:09:54 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:05:39.925 14:09:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:05:39.925 14:09:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.925 14:09:54 -- common/autotest_common.sh@10 -- # set +x 00:05:39.925 14:09:54 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:05:39.925 14:09:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:05:39.925 14:09:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.925 14:09:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.925 14:09:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.925 14:09:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.925 14:09:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.925 14:09:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.925 14:09:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.925 14:09:54 -- accel/accel.sh@42 -- # jq -r . 00:05:39.925 14:09:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:39.925 14:09:54 -- common/autotest_common.sh@10 -- # set +x 00:05:39.925 14:09:54 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:05:39.925 14:09:54 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:39.925 14:09:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:39.925 14:09:54 -- common/autotest_common.sh@10 -- # set +x 00:05:39.925 ************************************ 00:05:39.925 START TEST accel_missing_filename 00:05:39.925 ************************************ 00:05:39.925 14:09:54 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:05:39.925 14:09:54 -- common/autotest_common.sh@650 -- # local es=0 00:05:39.925 14:09:54 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:05:39.925 14:09:54 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:39.925 14:09:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:39.925 14:09:54 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:39.925 14:09:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:39.926 14:09:54 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:05:39.926 14:09:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:05:39.926 14:09:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:39.926 14:09:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:39.926 14:09:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:39.926 14:09:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:39.926 14:09:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:39.926 14:09:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:39.926 14:09:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:39.926 14:09:54 -- accel/accel.sh@42 -- # jq -r . 00:05:40.184 [2024-12-16 14:09:54.511154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.184 [2024-12-16 14:09:54.511215] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid207201 ] 00:05:40.184 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.184 [2024-12-16 14:09:54.566932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.184 [2024-12-16 14:09:54.635294] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.184 [2024-12-16 14:09:54.674977] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:40.185 [2024-12-16 14:09:54.733689] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:40.443 A filename is required. 00:05:40.443 14:09:54 -- common/autotest_common.sh@653 -- # es=234 00:05:40.443 14:09:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:40.443 14:09:54 -- common/autotest_common.sh@662 -- # es=106 00:05:40.443 14:09:54 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:40.443 14:09:54 -- common/autotest_common.sh@670 -- # es=1 00:05:40.443 14:09:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:40.443 00:05:40.443 real 0m0.344s 00:05:40.443 user 0m0.267s 00:05:40.443 sys 0m0.116s 00:05:40.443 14:09:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.443 14:09:54 -- common/autotest_common.sh@10 -- # set +x 00:05:40.444 ************************************ 00:05:40.444 END TEST accel_missing_filename 00:05:40.444 ************************************ 00:05:40.444 14:09:54 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:40.444 14:09:54 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:40.444 14:09:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.444 14:09:54 -- common/autotest_common.sh@10 -- # set +x 00:05:40.444 ************************************ 00:05:40.444 START TEST accel_compress_verify 00:05:40.444 ************************************ 00:05:40.444 14:09:54 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:40.444 14:09:54 -- common/autotest_common.sh@650 -- # local es=0 00:05:40.444 14:09:54 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:40.444 14:09:54 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:40.444 14:09:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:40.444 14:09:54 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:40.444 14:09:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:40.444 14:09:54 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:40.444 14:09:54 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.444 14:09:54 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:05:40.444 14:09:54 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.444 14:09:54 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.444 14:09:54 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.444 14:09:54 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.444 14:09:54 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.444 14:09:54 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.444 14:09:54 -- accel/accel.sh@42 -- # jq -r . 00:05:40.444 [2024-12-16 14:09:54.893061] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.444 [2024-12-16 14:09:54.893138] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid207325 ] 00:05:40.444 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.444 [2024-12-16 14:09:54.950407] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:40.703 [2024-12-16 14:09:55.019459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:40.703 [2024-12-16 14:09:55.059966] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:05:40.703 [2024-12-16 14:09:55.119780] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:05:40.703 00:05:40.703 Compression does not support the verify option, aborting. 00:05:40.703 14:09:55 -- common/autotest_common.sh@653 -- # es=161 00:05:40.703 14:09:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:40.703 14:09:55 -- common/autotest_common.sh@662 -- # es=33 00:05:40.703 14:09:55 -- common/autotest_common.sh@663 -- # case "$es" in 00:05:40.703 14:09:55 -- common/autotest_common.sh@670 -- # es=1 00:05:40.703 14:09:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:40.703 00:05:40.703 real 0m0.347s 00:05:40.703 user 0m0.262s 00:05:40.703 sys 0m0.112s 00:05:40.703 14:09:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.703 14:09:55 -- common/autotest_common.sh@10 -- # set +x 00:05:40.703 ************************************ 00:05:40.703 END TEST accel_compress_verify 00:05:40.703 ************************************ 00:05:40.703 14:09:55 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:05:40.703 14:09:55 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:40.703 14:09:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.703 14:09:55 -- common/autotest_common.sh@10 -- # set +x 00:05:40.703 ************************************ 00:05:40.703 START TEST accel_wrong_workload 00:05:40.703 ************************************ 00:05:40.703 14:09:55 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:05:40.703 14:09:55 -- common/autotest_common.sh@650 -- # local es=0 00:05:40.703 14:09:55 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:05:40.703 14:09:55 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:40.703 14:09:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:40.703 14:09:55 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:40.703 14:09:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:40.703 14:09:55 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:05:40.703 14:09:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:05:40.703 14:09:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.703 14:09:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.703 14:09:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.703 14:09:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.703 14:09:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.703 14:09:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.703 14:09:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.703 14:09:55 -- accel/accel.sh@42 -- # jq -r . 00:05:40.961 Unsupported workload type: foobar 00:05:40.961 [2024-12-16 14:09:55.277201] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:05:40.962 accel_perf options: 00:05:40.962 [-h help message] 00:05:40.962 [-q queue depth per core] 00:05:40.962 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:40.962 [-T number of threads per core 00:05:40.962 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:40.962 [-t time in seconds] 00:05:40.962 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:40.962 [ dif_verify, , dif_generate, dif_generate_copy 00:05:40.962 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:40.962 [-l for compress/decompress workloads, name of uncompressed input file 00:05:40.962 [-S for crc32c workload, use this seed value (default 0) 00:05:40.962 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:40.962 [-f for fill workload, use this BYTE value (default 255) 00:05:40.962 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:40.962 [-y verify result if this switch is on] 00:05:40.962 [-a tasks to allocate per core (default: same value as -q)] 00:05:40.962 Can be used to spread operations across a wider range of memory. 00:05:40.962 14:09:55 -- common/autotest_common.sh@653 -- # es=1 00:05:40.962 14:09:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:40.962 14:09:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:40.962 14:09:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:40.962 00:05:40.962 real 0m0.032s 00:05:40.962 user 0m0.019s 00:05:40.962 sys 0m0.013s 00:05:40.962 14:09:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.962 14:09:55 -- common/autotest_common.sh@10 -- # set +x 00:05:40.962 ************************************ 00:05:40.962 END TEST accel_wrong_workload 00:05:40.962 ************************************ 00:05:40.962 Error: writing output failed: Broken pipe 00:05:40.962 14:09:55 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:05:40.962 14:09:55 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:05:40.962 14:09:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.962 14:09:55 -- common/autotest_common.sh@10 -- # set +x 00:05:40.962 ************************************ 00:05:40.962 START TEST accel_negative_buffers 00:05:40.962 ************************************ 00:05:40.962 14:09:55 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:05:40.962 14:09:55 -- common/autotest_common.sh@650 -- # local es=0 00:05:40.962 14:09:55 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:05:40.962 14:09:55 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:05:40.962 14:09:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:40.962 14:09:55 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:05:40.962 14:09:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:05:40.962 14:09:55 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:05:40.962 14:09:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:05:40.962 14:09:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.962 14:09:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.962 14:09:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.962 14:09:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.962 14:09:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.962 14:09:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.962 14:09:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.962 14:09:55 -- accel/accel.sh@42 -- # jq -r . 00:05:40.962 -x option must be non-negative. 00:05:40.962 [2024-12-16 14:09:55.349159] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:05:40.962 accel_perf options: 00:05:40.962 [-h help message] 00:05:40.962 [-q queue depth per core] 00:05:40.962 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:05:40.962 [-T number of threads per core 00:05:40.962 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:05:40.962 [-t time in seconds] 00:05:40.962 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:05:40.962 [ dif_verify, , dif_generate, dif_generate_copy 00:05:40.962 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:05:40.962 [-l for compress/decompress workloads, name of uncompressed input file 00:05:40.962 [-S for crc32c workload, use this seed value (default 0) 00:05:40.962 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:05:40.962 [-f for fill workload, use this BYTE value (default 255) 00:05:40.962 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:05:40.962 [-y verify result if this switch is on] 00:05:40.962 [-a tasks to allocate per core (default: same value as -q)] 00:05:40.962 Can be used to spread operations across a wider range of memory. 00:05:40.962 14:09:55 -- common/autotest_common.sh@653 -- # es=1 00:05:40.962 14:09:55 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:05:40.962 14:09:55 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:05:40.962 14:09:55 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:05:40.962 00:05:40.962 real 0m0.034s 00:05:40.962 user 0m0.020s 00:05:40.962 sys 0m0.014s 00:05:40.962 14:09:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:40.962 14:09:55 -- common/autotest_common.sh@10 -- # set +x 00:05:40.962 ************************************ 00:05:40.962 END TEST accel_negative_buffers 00:05:40.962 ************************************ 00:05:40.962 Error: writing output failed: Broken pipe 00:05:40.962 14:09:55 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:05:40.962 14:09:55 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:40.962 14:09:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:40.962 14:09:55 -- common/autotest_common.sh@10 -- # set +x 00:05:40.962 ************************************ 00:05:40.962 START TEST accel_crc32c 00:05:40.962 ************************************ 00:05:40.962 14:09:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:05:40.962 14:09:55 -- accel/accel.sh@16 -- # local accel_opc 00:05:40.962 14:09:55 -- accel/accel.sh@17 -- # local accel_module 00:05:40.962 14:09:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:40.962 14:09:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:40.962 14:09:55 -- accel/accel.sh@12 -- # build_accel_config 00:05:40.962 14:09:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:40.962 14:09:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:40.962 14:09:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:40.962 14:09:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:40.962 14:09:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:40.962 14:09:55 -- accel/accel.sh@41 -- # local IFS=, 00:05:40.962 14:09:55 -- accel/accel.sh@42 -- # jq -r . 00:05:40.962 [2024-12-16 14:09:55.419228] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:40.962 [2024-12-16 14:09:55.419300] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid207496 ] 00:05:40.962 EAL: No free 2048 kB hugepages reported on node 1 00:05:40.962 [2024-12-16 14:09:55.476886] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:41.221 [2024-12-16 14:09:55.551003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.598 14:09:56 -- accel/accel.sh@18 -- # out=' 00:05:42.598 SPDK Configuration: 00:05:42.598 Core mask: 0x1 00:05:42.598 00:05:42.598 Accel Perf Configuration: 00:05:42.598 Workload Type: crc32c 00:05:42.598 CRC-32C seed: 32 00:05:42.598 Transfer size: 4096 bytes 00:05:42.598 Vector count 1 00:05:42.598 Module: software 00:05:42.598 Queue depth: 32 00:05:42.598 Allocate depth: 32 00:05:42.598 # threads/core: 1 00:05:42.598 Run time: 1 seconds 00:05:42.598 Verify: Yes 00:05:42.598 00:05:42.598 Running for 1 seconds... 00:05:42.598 00:05:42.598 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:42.598 ------------------------------------------------------------------------------------ 00:05:42.598 0,0 590944/s 2308 MiB/s 0 0 00:05:42.598 ==================================================================================== 00:05:42.598 Total 590944/s 2308 MiB/s 0 0' 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.598 14:09:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:05:42.598 14:09:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:05:42.598 14:09:56 -- accel/accel.sh@12 -- # build_accel_config 00:05:42.598 14:09:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:42.598 14:09:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:42.598 14:09:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:42.598 14:09:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:42.598 14:09:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:42.598 14:09:56 -- accel/accel.sh@41 -- # local IFS=, 00:05:42.598 14:09:56 -- accel/accel.sh@42 -- # jq -r . 00:05:42.598 [2024-12-16 14:09:56.772321] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:42.598 [2024-12-16 14:09:56.772399] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid207724 ] 00:05:42.598 EAL: No free 2048 kB hugepages reported on node 1 00:05:42.598 [2024-12-16 14:09:56.828476] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:42.598 [2024-12-16 14:09:56.894976] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:42.598 14:09:56 -- accel/accel.sh@21 -- # val= 00:05:42.598 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.598 14:09:56 -- accel/accel.sh@21 -- # val= 00:05:42.598 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.598 14:09:56 -- accel/accel.sh@21 -- # val=0x1 00:05:42.598 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.598 14:09:56 -- accel/accel.sh@21 -- # val= 00:05:42.598 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.598 14:09:56 -- accel/accel.sh@21 -- # val= 00:05:42.598 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.598 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.598 14:09:56 -- accel/accel.sh@21 -- # val=crc32c 00:05:42.598 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val=32 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val= 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val=software 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@23 -- # accel_module=software 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val=32 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val=32 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val=1 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val=Yes 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val= 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:42.599 14:09:56 -- accel/accel.sh@21 -- # val= 00:05:42.599 14:09:56 -- accel/accel.sh@22 -- # case "$var" in 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # IFS=: 00:05:42.599 14:09:56 -- accel/accel.sh@20 -- # read -r var val 00:05:43.536 14:09:58 -- accel/accel.sh@21 -- # val= 00:05:43.536 14:09:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # IFS=: 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # read -r var val 00:05:43.536 14:09:58 -- accel/accel.sh@21 -- # val= 00:05:43.536 14:09:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # IFS=: 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # read -r var val 00:05:43.536 14:09:58 -- accel/accel.sh@21 -- # val= 00:05:43.536 14:09:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # IFS=: 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # read -r var val 00:05:43.536 14:09:58 -- accel/accel.sh@21 -- # val= 00:05:43.536 14:09:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # IFS=: 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # read -r var val 00:05:43.536 14:09:58 -- accel/accel.sh@21 -- # val= 00:05:43.536 14:09:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # IFS=: 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # read -r var val 00:05:43.536 14:09:58 -- accel/accel.sh@21 -- # val= 00:05:43.536 14:09:58 -- accel/accel.sh@22 -- # case "$var" in 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # IFS=: 00:05:43.536 14:09:58 -- accel/accel.sh@20 -- # read -r var val 00:05:43.536 14:09:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:43.536 14:09:58 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:43.536 14:09:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:43.536 00:05:43.536 real 0m2.704s 00:05:43.536 user 0m2.478s 00:05:43.536 sys 0m0.234s 00:05:43.536 14:09:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:43.536 14:09:58 -- common/autotest_common.sh@10 -- # set +x 00:05:43.536 ************************************ 00:05:43.536 END TEST accel_crc32c 00:05:43.536 ************************************ 00:05:43.795 14:09:58 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:05:43.795 14:09:58 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:43.795 14:09:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:43.795 14:09:58 -- common/autotest_common.sh@10 -- # set +x 00:05:43.795 ************************************ 00:05:43.795 START TEST accel_crc32c_C2 00:05:43.795 ************************************ 00:05:43.795 14:09:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:05:43.795 14:09:58 -- accel/accel.sh@16 -- # local accel_opc 00:05:43.795 14:09:58 -- accel/accel.sh@17 -- # local accel_module 00:05:43.795 14:09:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:43.795 14:09:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:43.795 14:09:58 -- accel/accel.sh@12 -- # build_accel_config 00:05:43.795 14:09:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:43.795 14:09:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:43.795 14:09:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:43.795 14:09:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:43.795 14:09:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:43.795 14:09:58 -- accel/accel.sh@41 -- # local IFS=, 00:05:43.795 14:09:58 -- accel/accel.sh@42 -- # jq -r . 00:05:43.795 [2024-12-16 14:09:58.159394] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:43.795 [2024-12-16 14:09:58.159450] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid207971 ] 00:05:43.795 EAL: No free 2048 kB hugepages reported on node 1 00:05:43.795 [2024-12-16 14:09:58.214203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:43.795 [2024-12-16 14:09:58.282608] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.173 14:09:59 -- accel/accel.sh@18 -- # out=' 00:05:45.173 SPDK Configuration: 00:05:45.173 Core mask: 0x1 00:05:45.173 00:05:45.173 Accel Perf Configuration: 00:05:45.173 Workload Type: crc32c 00:05:45.173 CRC-32C seed: 0 00:05:45.173 Transfer size: 4096 bytes 00:05:45.173 Vector count 2 00:05:45.173 Module: software 00:05:45.173 Queue depth: 32 00:05:45.173 Allocate depth: 32 00:05:45.173 # threads/core: 1 00:05:45.173 Run time: 1 seconds 00:05:45.173 Verify: Yes 00:05:45.173 00:05:45.173 Running for 1 seconds... 00:05:45.173 00:05:45.173 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:45.173 ------------------------------------------------------------------------------------ 00:05:45.173 0,0 461856/s 3608 MiB/s 0 0 00:05:45.173 ==================================================================================== 00:05:45.173 Total 461856/s 1804 MiB/s 0 0' 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:05:45.173 14:09:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:05:45.173 14:09:59 -- accel/accel.sh@12 -- # build_accel_config 00:05:45.173 14:09:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:45.173 14:09:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:45.173 14:09:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:45.173 14:09:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:45.173 14:09:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:45.173 14:09:59 -- accel/accel.sh@41 -- # local IFS=, 00:05:45.173 14:09:59 -- accel/accel.sh@42 -- # jq -r . 00:05:45.173 [2024-12-16 14:09:59.502975] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.173 [2024-12-16 14:09:59.503037] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid208205 ] 00:05:45.173 EAL: No free 2048 kB hugepages reported on node 1 00:05:45.173 [2024-12-16 14:09:59.558650] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:45.173 [2024-12-16 14:09:59.624750] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val= 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val= 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val=0x1 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val= 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val= 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val=crc32c 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val=0 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val= 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val=software 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@23 -- # accel_module=software 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val=32 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val=32 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val=1 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val=Yes 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val= 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:45.173 14:09:59 -- accel/accel.sh@21 -- # val= 00:05:45.173 14:09:59 -- accel/accel.sh@22 -- # case "$var" in 00:05:45.173 14:09:59 -- accel/accel.sh@20 -- # IFS=: 00:05:45.174 14:09:59 -- accel/accel.sh@20 -- # read -r var val 00:05:46.550 14:10:00 -- accel/accel.sh@21 -- # val= 00:05:46.550 14:10:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # IFS=: 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # read -r var val 00:05:46.551 14:10:00 -- accel/accel.sh@21 -- # val= 00:05:46.551 14:10:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # IFS=: 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # read -r var val 00:05:46.551 14:10:00 -- accel/accel.sh@21 -- # val= 00:05:46.551 14:10:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # IFS=: 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # read -r var val 00:05:46.551 14:10:00 -- accel/accel.sh@21 -- # val= 00:05:46.551 14:10:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # IFS=: 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # read -r var val 00:05:46.551 14:10:00 -- accel/accel.sh@21 -- # val= 00:05:46.551 14:10:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # IFS=: 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # read -r var val 00:05:46.551 14:10:00 -- accel/accel.sh@21 -- # val= 00:05:46.551 14:10:00 -- accel/accel.sh@22 -- # case "$var" in 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # IFS=: 00:05:46.551 14:10:00 -- accel/accel.sh@20 -- # read -r var val 00:05:46.551 14:10:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:46.551 14:10:00 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:05:46.551 14:10:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:46.551 00:05:46.551 real 0m2.690s 00:05:46.551 user 0m2.475s 00:05:46.551 sys 0m0.221s 00:05:46.551 14:10:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:46.551 14:10:00 -- common/autotest_common.sh@10 -- # set +x 00:05:46.551 ************************************ 00:05:46.551 END TEST accel_crc32c_C2 00:05:46.551 ************************************ 00:05:46.551 14:10:00 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:05:46.551 14:10:00 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:46.551 14:10:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:46.551 14:10:00 -- common/autotest_common.sh@10 -- # set +x 00:05:46.551 ************************************ 00:05:46.551 START TEST accel_copy 00:05:46.551 ************************************ 00:05:46.551 14:10:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:05:46.551 14:10:00 -- accel/accel.sh@16 -- # local accel_opc 00:05:46.551 14:10:00 -- accel/accel.sh@17 -- # local accel_module 00:05:46.551 14:10:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:05:46.551 14:10:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:46.551 14:10:00 -- accel/accel.sh@12 -- # build_accel_config 00:05:46.551 14:10:00 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:46.551 14:10:00 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:46.551 14:10:00 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:46.551 14:10:00 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:46.551 14:10:00 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:46.551 14:10:00 -- accel/accel.sh@41 -- # local IFS=, 00:05:46.551 14:10:00 -- accel/accel.sh@42 -- # jq -r . 00:05:46.551 [2024-12-16 14:10:00.889944] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:46.551 [2024-12-16 14:10:00.890003] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid208448 ] 00:05:46.551 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.551 [2024-12-16 14:10:00.945097] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.551 [2024-12-16 14:10:01.012488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.926 14:10:02 -- accel/accel.sh@18 -- # out=' 00:05:47.926 SPDK Configuration: 00:05:47.926 Core mask: 0x1 00:05:47.926 00:05:47.926 Accel Perf Configuration: 00:05:47.926 Workload Type: copy 00:05:47.926 Transfer size: 4096 bytes 00:05:47.926 Vector count 1 00:05:47.926 Module: software 00:05:47.926 Queue depth: 32 00:05:47.926 Allocate depth: 32 00:05:47.926 # threads/core: 1 00:05:47.926 Run time: 1 seconds 00:05:47.926 Verify: Yes 00:05:47.926 00:05:47.926 Running for 1 seconds... 00:05:47.926 00:05:47.926 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:47.926 ------------------------------------------------------------------------------------ 00:05:47.926 0,0 435680/s 1701 MiB/s 0 0 00:05:47.926 ==================================================================================== 00:05:47.926 Total 435680/s 1701 MiB/s 0 0' 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:05:47.926 14:10:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:05:47.926 14:10:02 -- accel/accel.sh@12 -- # build_accel_config 00:05:47.926 14:10:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:47.926 14:10:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:47.926 14:10:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:47.926 14:10:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:47.926 14:10:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:47.926 14:10:02 -- accel/accel.sh@41 -- # local IFS=, 00:05:47.926 14:10:02 -- accel/accel.sh@42 -- # jq -r . 00:05:47.926 [2024-12-16 14:10:02.232369] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:47.926 [2024-12-16 14:10:02.232426] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid208682 ] 00:05:47.926 EAL: No free 2048 kB hugepages reported on node 1 00:05:47.926 [2024-12-16 14:10:02.287532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:47.926 [2024-12-16 14:10:02.353752] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val= 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val= 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val=0x1 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val= 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val= 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val=copy 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@24 -- # accel_opc=copy 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val= 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val=software 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@23 -- # accel_module=software 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val=32 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val=32 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val=1 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val=Yes 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val= 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:47.926 14:10:02 -- accel/accel.sh@21 -- # val= 00:05:47.926 14:10:02 -- accel/accel.sh@22 -- # case "$var" in 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # IFS=: 00:05:47.926 14:10:02 -- accel/accel.sh@20 -- # read -r var val 00:05:49.302 14:10:03 -- accel/accel.sh@21 -- # val= 00:05:49.303 14:10:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # IFS=: 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # read -r var val 00:05:49.303 14:10:03 -- accel/accel.sh@21 -- # val= 00:05:49.303 14:10:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # IFS=: 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # read -r var val 00:05:49.303 14:10:03 -- accel/accel.sh@21 -- # val= 00:05:49.303 14:10:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # IFS=: 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # read -r var val 00:05:49.303 14:10:03 -- accel/accel.sh@21 -- # val= 00:05:49.303 14:10:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # IFS=: 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # read -r var val 00:05:49.303 14:10:03 -- accel/accel.sh@21 -- # val= 00:05:49.303 14:10:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # IFS=: 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # read -r var val 00:05:49.303 14:10:03 -- accel/accel.sh@21 -- # val= 00:05:49.303 14:10:03 -- accel/accel.sh@22 -- # case "$var" in 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # IFS=: 00:05:49.303 14:10:03 -- accel/accel.sh@20 -- # read -r var val 00:05:49.303 14:10:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:49.303 14:10:03 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:05:49.303 14:10:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:49.303 00:05:49.303 real 0m2.690s 00:05:49.303 user 0m2.466s 00:05:49.303 sys 0m0.231s 00:05:49.303 14:10:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:49.303 14:10:03 -- common/autotest_common.sh@10 -- # set +x 00:05:49.303 ************************************ 00:05:49.303 END TEST accel_copy 00:05:49.303 ************************************ 00:05:49.303 14:10:03 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:49.303 14:10:03 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:05:49.303 14:10:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:49.303 14:10:03 -- common/autotest_common.sh@10 -- # set +x 00:05:49.303 ************************************ 00:05:49.303 START TEST accel_fill 00:05:49.303 ************************************ 00:05:49.303 14:10:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:49.303 14:10:03 -- accel/accel.sh@16 -- # local accel_opc 00:05:49.303 14:10:03 -- accel/accel.sh@17 -- # local accel_module 00:05:49.303 14:10:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:49.303 14:10:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:49.303 14:10:03 -- accel/accel.sh@12 -- # build_accel_config 00:05:49.303 14:10:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:49.303 14:10:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:49.303 14:10:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:49.303 14:10:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:49.303 14:10:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:49.303 14:10:03 -- accel/accel.sh@41 -- # local IFS=, 00:05:49.303 14:10:03 -- accel/accel.sh@42 -- # jq -r . 00:05:49.303 [2024-12-16 14:10:03.618250] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:49.303 [2024-12-16 14:10:03.618310] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid208923 ] 00:05:49.303 EAL: No free 2048 kB hugepages reported on node 1 00:05:49.303 [2024-12-16 14:10:03.673514] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:49.303 [2024-12-16 14:10:03.741038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.680 14:10:04 -- accel/accel.sh@18 -- # out=' 00:05:50.680 SPDK Configuration: 00:05:50.680 Core mask: 0x1 00:05:50.680 00:05:50.680 Accel Perf Configuration: 00:05:50.680 Workload Type: fill 00:05:50.680 Fill pattern: 0x80 00:05:50.680 Transfer size: 4096 bytes 00:05:50.680 Vector count 1 00:05:50.680 Module: software 00:05:50.680 Queue depth: 64 00:05:50.680 Allocate depth: 64 00:05:50.680 # threads/core: 1 00:05:50.680 Run time: 1 seconds 00:05:50.680 Verify: Yes 00:05:50.680 00:05:50.680 Running for 1 seconds... 00:05:50.680 00:05:50.680 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:50.680 ------------------------------------------------------------------------------------ 00:05:50.680 0,0 668608/s 2611 MiB/s 0 0 00:05:50.680 ==================================================================================== 00:05:50.680 Total 668608/s 2611 MiB/s 0 0' 00:05:50.680 14:10:04 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:04 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:04 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:50.680 14:10:04 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:05:50.680 14:10:04 -- accel/accel.sh@12 -- # build_accel_config 00:05:50.680 14:10:04 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:50.680 14:10:04 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:50.680 14:10:04 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:50.680 14:10:04 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:50.680 14:10:04 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:50.680 14:10:04 -- accel/accel.sh@41 -- # local IFS=, 00:05:50.680 14:10:04 -- accel/accel.sh@42 -- # jq -r . 00:05:50.680 [2024-12-16 14:10:04.963132] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:50.680 [2024-12-16 14:10:04.963191] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid209154 ] 00:05:50.680 EAL: No free 2048 kB hugepages reported on node 1 00:05:50.680 [2024-12-16 14:10:05.018109] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:50.680 [2024-12-16 14:10:05.084372] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val= 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val= 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val=0x1 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val= 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val= 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val=fill 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@24 -- # accel_opc=fill 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val=0x80 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val= 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val=software 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@23 -- # accel_module=software 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val=64 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val=64 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val=1 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val=Yes 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val= 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:50.680 14:10:05 -- accel/accel.sh@21 -- # val= 00:05:50.680 14:10:05 -- accel/accel.sh@22 -- # case "$var" in 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # IFS=: 00:05:50.680 14:10:05 -- accel/accel.sh@20 -- # read -r var val 00:05:52.057 14:10:06 -- accel/accel.sh@21 -- # val= 00:05:52.057 14:10:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # IFS=: 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # read -r var val 00:05:52.057 14:10:06 -- accel/accel.sh@21 -- # val= 00:05:52.057 14:10:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # IFS=: 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # read -r var val 00:05:52.057 14:10:06 -- accel/accel.sh@21 -- # val= 00:05:52.057 14:10:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # IFS=: 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # read -r var val 00:05:52.057 14:10:06 -- accel/accel.sh@21 -- # val= 00:05:52.057 14:10:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # IFS=: 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # read -r var val 00:05:52.057 14:10:06 -- accel/accel.sh@21 -- # val= 00:05:52.057 14:10:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # IFS=: 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # read -r var val 00:05:52.057 14:10:06 -- accel/accel.sh@21 -- # val= 00:05:52.057 14:10:06 -- accel/accel.sh@22 -- # case "$var" in 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # IFS=: 00:05:52.057 14:10:06 -- accel/accel.sh@20 -- # read -r var val 00:05:52.057 14:10:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:52.057 14:10:06 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:05:52.057 14:10:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:52.057 00:05:52.057 real 0m2.694s 00:05:52.057 user 0m2.471s 00:05:52.057 sys 0m0.231s 00:05:52.057 14:10:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.057 14:10:06 -- common/autotest_common.sh@10 -- # set +x 00:05:52.057 ************************************ 00:05:52.057 END TEST accel_fill 00:05:52.057 ************************************ 00:05:52.057 14:10:06 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:05:52.057 14:10:06 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:52.057 14:10:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.057 14:10:06 -- common/autotest_common.sh@10 -- # set +x 00:05:52.057 ************************************ 00:05:52.057 START TEST accel_copy_crc32c 00:05:52.057 ************************************ 00:05:52.057 14:10:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:05:52.057 14:10:06 -- accel/accel.sh@16 -- # local accel_opc 00:05:52.057 14:10:06 -- accel/accel.sh@17 -- # local accel_module 00:05:52.057 14:10:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:52.057 14:10:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:52.057 14:10:06 -- accel/accel.sh@12 -- # build_accel_config 00:05:52.057 14:10:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:52.057 14:10:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:52.057 14:10:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:52.057 14:10:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:52.057 14:10:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:52.057 14:10:06 -- accel/accel.sh@41 -- # local IFS=, 00:05:52.057 14:10:06 -- accel/accel.sh@42 -- # jq -r . 00:05:52.057 [2024-12-16 14:10:06.351135] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.057 [2024-12-16 14:10:06.351201] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid209401 ] 00:05:52.057 EAL: No free 2048 kB hugepages reported on node 1 00:05:52.057 [2024-12-16 14:10:06.407760] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:52.057 [2024-12-16 14:10:06.475034] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.433 14:10:07 -- accel/accel.sh@18 -- # out=' 00:05:53.433 SPDK Configuration: 00:05:53.433 Core mask: 0x1 00:05:53.433 00:05:53.433 Accel Perf Configuration: 00:05:53.433 Workload Type: copy_crc32c 00:05:53.433 CRC-32C seed: 0 00:05:53.433 Vector size: 4096 bytes 00:05:53.433 Transfer size: 4096 bytes 00:05:53.433 Vector count 1 00:05:53.433 Module: software 00:05:53.433 Queue depth: 32 00:05:53.433 Allocate depth: 32 00:05:53.433 # threads/core: 1 00:05:53.433 Run time: 1 seconds 00:05:53.433 Verify: Yes 00:05:53.433 00:05:53.433 Running for 1 seconds... 00:05:53.433 00:05:53.433 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:53.433 ------------------------------------------------------------------------------------ 00:05:53.433 0,0 335744/s 1311 MiB/s 0 0 00:05:53.433 ==================================================================================== 00:05:53.433 Total 335744/s 1311 MiB/s 0 0' 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:05:53.433 14:10:07 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:05:53.433 14:10:07 -- accel/accel.sh@12 -- # build_accel_config 00:05:53.433 14:10:07 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:53.433 14:10:07 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:53.433 14:10:07 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:53.433 14:10:07 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:53.433 14:10:07 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:53.433 14:10:07 -- accel/accel.sh@41 -- # local IFS=, 00:05:53.433 14:10:07 -- accel/accel.sh@42 -- # jq -r . 00:05:53.433 [2024-12-16 14:10:07.695583] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:53.433 [2024-12-16 14:10:07.695649] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid209629 ] 00:05:53.433 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.433 [2024-12-16 14:10:07.751574] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.433 [2024-12-16 14:10:07.817952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val= 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val= 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val=0x1 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val= 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val= 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val=0 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:53.433 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.433 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.433 14:10:07 -- accel/accel.sh@21 -- # val= 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.434 14:10:07 -- accel/accel.sh@21 -- # val=software 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@23 -- # accel_module=software 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.434 14:10:07 -- accel/accel.sh@21 -- # val=32 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.434 14:10:07 -- accel/accel.sh@21 -- # val=32 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.434 14:10:07 -- accel/accel.sh@21 -- # val=1 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.434 14:10:07 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.434 14:10:07 -- accel/accel.sh@21 -- # val=Yes 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.434 14:10:07 -- accel/accel.sh@21 -- # val= 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:53.434 14:10:07 -- accel/accel.sh@21 -- # val= 00:05:53.434 14:10:07 -- accel/accel.sh@22 -- # case "$var" in 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # IFS=: 00:05:53.434 14:10:07 -- accel/accel.sh@20 -- # read -r var val 00:05:54.810 14:10:09 -- accel/accel.sh@21 -- # val= 00:05:54.810 14:10:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.810 14:10:09 -- accel/accel.sh@20 -- # IFS=: 00:05:54.810 14:10:09 -- accel/accel.sh@20 -- # read -r var val 00:05:54.810 14:10:09 -- accel/accel.sh@21 -- # val= 00:05:54.810 14:10:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # IFS=: 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # read -r var val 00:05:54.811 14:10:09 -- accel/accel.sh@21 -- # val= 00:05:54.811 14:10:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # IFS=: 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # read -r var val 00:05:54.811 14:10:09 -- accel/accel.sh@21 -- # val= 00:05:54.811 14:10:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # IFS=: 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # read -r var val 00:05:54.811 14:10:09 -- accel/accel.sh@21 -- # val= 00:05:54.811 14:10:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # IFS=: 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # read -r var val 00:05:54.811 14:10:09 -- accel/accel.sh@21 -- # val= 00:05:54.811 14:10:09 -- accel/accel.sh@22 -- # case "$var" in 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # IFS=: 00:05:54.811 14:10:09 -- accel/accel.sh@20 -- # read -r var val 00:05:54.811 14:10:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:54.811 14:10:09 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:54.811 14:10:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:54.811 00:05:54.811 real 0m2.693s 00:05:54.811 user 0m2.479s 00:05:54.811 sys 0m0.223s 00:05:54.811 14:10:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.811 14:10:09 -- common/autotest_common.sh@10 -- # set +x 00:05:54.811 ************************************ 00:05:54.811 END TEST accel_copy_crc32c 00:05:54.811 ************************************ 00:05:54.811 14:10:09 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:05:54.811 14:10:09 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:05:54.811 14:10:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.811 14:10:09 -- common/autotest_common.sh@10 -- # set +x 00:05:54.811 ************************************ 00:05:54.811 START TEST accel_copy_crc32c_C2 00:05:54.811 ************************************ 00:05:54.811 14:10:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:05:54.811 14:10:09 -- accel/accel.sh@16 -- # local accel_opc 00:05:54.811 14:10:09 -- accel/accel.sh@17 -- # local accel_module 00:05:54.811 14:10:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:54.811 14:10:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:54.811 14:10:09 -- accel/accel.sh@12 -- # build_accel_config 00:05:54.811 14:10:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:54.811 14:10:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:54.811 14:10:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:54.811 14:10:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:54.811 14:10:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:54.811 14:10:09 -- accel/accel.sh@41 -- # local IFS=, 00:05:54.811 14:10:09 -- accel/accel.sh@42 -- # jq -r . 00:05:54.811 [2024-12-16 14:10:09.073356] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.811 [2024-12-16 14:10:09.073413] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid209870 ] 00:05:54.811 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.811 [2024-12-16 14:10:09.120465] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.811 [2024-12-16 14:10:09.189534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.186 14:10:10 -- accel/accel.sh@18 -- # out=' 00:05:56.186 SPDK Configuration: 00:05:56.186 Core mask: 0x1 00:05:56.186 00:05:56.186 Accel Perf Configuration: 00:05:56.186 Workload Type: copy_crc32c 00:05:56.186 CRC-32C seed: 0 00:05:56.186 Vector size: 4096 bytes 00:05:56.186 Transfer size: 8192 bytes 00:05:56.186 Vector count 2 00:05:56.186 Module: software 00:05:56.186 Queue depth: 32 00:05:56.186 Allocate depth: 32 00:05:56.186 # threads/core: 1 00:05:56.186 Run time: 1 seconds 00:05:56.186 Verify: Yes 00:05:56.186 00:05:56.186 Running for 1 seconds... 00:05:56.186 00:05:56.186 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:56.186 ------------------------------------------------------------------------------------ 00:05:56.186 0,0 237856/s 1858 MiB/s 0 0 00:05:56.186 ==================================================================================== 00:05:56.186 Total 237856/s 929 MiB/s 0 0' 00:05:56.186 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.186 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.186 14:10:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:05:56.186 14:10:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:05:56.186 14:10:10 -- accel/accel.sh@12 -- # build_accel_config 00:05:56.186 14:10:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:56.186 14:10:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:56.186 14:10:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:56.186 14:10:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:56.186 14:10:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:56.186 14:10:10 -- accel/accel.sh@41 -- # local IFS=, 00:05:56.186 14:10:10 -- accel/accel.sh@42 -- # jq -r . 00:05:56.186 [2024-12-16 14:10:10.413434] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.186 [2024-12-16 14:10:10.413510] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid210105 ] 00:05:56.186 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.186 [2024-12-16 14:10:10.469775] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:56.186 [2024-12-16 14:10:10.536867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:56.186 14:10:10 -- accel/accel.sh@21 -- # val= 00:05:56.186 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.186 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.186 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.186 14:10:10 -- accel/accel.sh@21 -- # val= 00:05:56.186 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.186 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.186 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.186 14:10:10 -- accel/accel.sh@21 -- # val=0x1 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val= 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val= 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val=copy_crc32c 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val=0 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val='8192 bytes' 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val= 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val=software 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@23 -- # accel_module=software 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val=32 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val=32 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val=1 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val=Yes 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val= 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:56.187 14:10:10 -- accel/accel.sh@21 -- # val= 00:05:56.187 14:10:10 -- accel/accel.sh@22 -- # case "$var" in 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # IFS=: 00:05:56.187 14:10:10 -- accel/accel.sh@20 -- # read -r var val 00:05:57.559 14:10:11 -- accel/accel.sh@21 -- # val= 00:05:57.559 14:10:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # IFS=: 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # read -r var val 00:05:57.559 14:10:11 -- accel/accel.sh@21 -- # val= 00:05:57.559 14:10:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # IFS=: 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # read -r var val 00:05:57.559 14:10:11 -- accel/accel.sh@21 -- # val= 00:05:57.559 14:10:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # IFS=: 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # read -r var val 00:05:57.559 14:10:11 -- accel/accel.sh@21 -- # val= 00:05:57.559 14:10:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # IFS=: 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # read -r var val 00:05:57.559 14:10:11 -- accel/accel.sh@21 -- # val= 00:05:57.559 14:10:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # IFS=: 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # read -r var val 00:05:57.559 14:10:11 -- accel/accel.sh@21 -- # val= 00:05:57.559 14:10:11 -- accel/accel.sh@22 -- # case "$var" in 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # IFS=: 00:05:57.559 14:10:11 -- accel/accel.sh@20 -- # read -r var val 00:05:57.559 14:10:11 -- accel/accel.sh@28 -- # [[ -n software ]] 00:05:57.559 14:10:11 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:05:57.559 14:10:11 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:05:57.559 00:05:57.559 real 0m2.680s 00:05:57.559 user 0m2.472s 00:05:57.559 sys 0m0.216s 00:05:57.559 14:10:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.559 14:10:11 -- common/autotest_common.sh@10 -- # set +x 00:05:57.559 ************************************ 00:05:57.559 END TEST accel_copy_crc32c_C2 00:05:57.559 ************************************ 00:05:57.559 14:10:11 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:05:57.559 14:10:11 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:05:57.559 14:10:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.559 14:10:11 -- common/autotest_common.sh@10 -- # set +x 00:05:57.559 ************************************ 00:05:57.559 START TEST accel_dualcast 00:05:57.559 ************************************ 00:05:57.559 14:10:11 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:05:57.559 14:10:11 -- accel/accel.sh@16 -- # local accel_opc 00:05:57.559 14:10:11 -- accel/accel.sh@17 -- # local accel_module 00:05:57.559 14:10:11 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:05:57.559 14:10:11 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:57.559 14:10:11 -- accel/accel.sh@12 -- # build_accel_config 00:05:57.559 14:10:11 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:57.559 14:10:11 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:57.559 14:10:11 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:57.559 14:10:11 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:57.559 14:10:11 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:57.559 14:10:11 -- accel/accel.sh@41 -- # local IFS=, 00:05:57.559 14:10:11 -- accel/accel.sh@42 -- # jq -r . 00:05:57.559 [2024-12-16 14:10:11.801023] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:57.559 [2024-12-16 14:10:11.801081] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid210352 ] 00:05:57.559 EAL: No free 2048 kB hugepages reported on node 1 00:05:57.559 [2024-12-16 14:10:11.856288] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:57.559 [2024-12-16 14:10:11.923882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.935 14:10:13 -- accel/accel.sh@18 -- # out=' 00:05:58.935 SPDK Configuration: 00:05:58.935 Core mask: 0x1 00:05:58.935 00:05:58.935 Accel Perf Configuration: 00:05:58.935 Workload Type: dualcast 00:05:58.936 Transfer size: 4096 bytes 00:05:58.936 Vector count 1 00:05:58.936 Module: software 00:05:58.936 Queue depth: 32 00:05:58.936 Allocate depth: 32 00:05:58.936 # threads/core: 1 00:05:58.936 Run time: 1 seconds 00:05:58.936 Verify: Yes 00:05:58.936 00:05:58.936 Running for 1 seconds... 00:05:58.936 00:05:58.936 Core,Thread Transfers Bandwidth Failed Miscompares 00:05:58.936 ------------------------------------------------------------------------------------ 00:05:58.936 0,0 515616/s 2014 MiB/s 0 0 00:05:58.936 ==================================================================================== 00:05:58.936 Total 515616/s 2014 MiB/s 0 0' 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:05:58.936 14:10:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:05:58.936 14:10:13 -- accel/accel.sh@12 -- # build_accel_config 00:05:58.936 14:10:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:05:58.936 14:10:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:05:58.936 14:10:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:05:58.936 14:10:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:05:58.936 14:10:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:05:58.936 14:10:13 -- accel/accel.sh@41 -- # local IFS=, 00:05:58.936 14:10:13 -- accel/accel.sh@42 -- # jq -r . 00:05:58.936 [2024-12-16 14:10:13.144448] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.936 [2024-12-16 14:10:13.144526] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid210579 ] 00:05:58.936 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.936 [2024-12-16 14:10:13.200590] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.936 [2024-12-16 14:10:13.267105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val= 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val= 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val=0x1 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val= 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val= 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val=dualcast 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val= 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val=software 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@23 -- # accel_module=software 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val=32 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val=32 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val=1 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val=Yes 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val= 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:05:58.936 14:10:13 -- accel/accel.sh@21 -- # val= 00:05:58.936 14:10:13 -- accel/accel.sh@22 -- # case "$var" in 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # IFS=: 00:05:58.936 14:10:13 -- accel/accel.sh@20 -- # read -r var val 00:06:00.312 14:10:14 -- accel/accel.sh@21 -- # val= 00:06:00.312 14:10:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # IFS=: 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # read -r var val 00:06:00.312 14:10:14 -- accel/accel.sh@21 -- # val= 00:06:00.312 14:10:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # IFS=: 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # read -r var val 00:06:00.312 14:10:14 -- accel/accel.sh@21 -- # val= 00:06:00.312 14:10:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # IFS=: 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # read -r var val 00:06:00.312 14:10:14 -- accel/accel.sh@21 -- # val= 00:06:00.312 14:10:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # IFS=: 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # read -r var val 00:06:00.312 14:10:14 -- accel/accel.sh@21 -- # val= 00:06:00.312 14:10:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # IFS=: 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # read -r var val 00:06:00.312 14:10:14 -- accel/accel.sh@21 -- # val= 00:06:00.312 14:10:14 -- accel/accel.sh@22 -- # case "$var" in 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # IFS=: 00:06:00.312 14:10:14 -- accel/accel.sh@20 -- # read -r var val 00:06:00.312 14:10:14 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:00.312 14:10:14 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:06:00.312 14:10:14 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:00.312 00:06:00.312 real 0m2.692s 00:06:00.312 user 0m2.469s 00:06:00.312 sys 0m0.229s 00:06:00.312 14:10:14 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:00.312 14:10:14 -- common/autotest_common.sh@10 -- # set +x 00:06:00.312 ************************************ 00:06:00.312 END TEST accel_dualcast 00:06:00.312 ************************************ 00:06:00.312 14:10:14 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:06:00.312 14:10:14 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:00.312 14:10:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:00.312 14:10:14 -- common/autotest_common.sh@10 -- # set +x 00:06:00.312 ************************************ 00:06:00.312 START TEST accel_compare 00:06:00.312 ************************************ 00:06:00.312 14:10:14 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:06:00.312 14:10:14 -- accel/accel.sh@16 -- # local accel_opc 00:06:00.312 14:10:14 -- accel/accel.sh@17 -- # local accel_module 00:06:00.312 14:10:14 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:06:00.312 14:10:14 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:00.312 14:10:14 -- accel/accel.sh@12 -- # build_accel_config 00:06:00.312 14:10:14 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:00.312 14:10:14 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:00.312 14:10:14 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:00.312 14:10:14 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:00.312 14:10:14 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:00.312 14:10:14 -- accel/accel.sh@41 -- # local IFS=, 00:06:00.312 14:10:14 -- accel/accel.sh@42 -- # jq -r . 00:06:00.312 [2024-12-16 14:10:14.531734] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:00.312 [2024-12-16 14:10:14.531794] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid210828 ] 00:06:00.312 EAL: No free 2048 kB hugepages reported on node 1 00:06:00.312 [2024-12-16 14:10:14.587648] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:00.312 [2024-12-16 14:10:14.655150] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.688 14:10:15 -- accel/accel.sh@18 -- # out=' 00:06:01.688 SPDK Configuration: 00:06:01.688 Core mask: 0x1 00:06:01.688 00:06:01.688 Accel Perf Configuration: 00:06:01.688 Workload Type: compare 00:06:01.688 Transfer size: 4096 bytes 00:06:01.688 Vector count 1 00:06:01.688 Module: software 00:06:01.688 Queue depth: 32 00:06:01.688 Allocate depth: 32 00:06:01.688 # threads/core: 1 00:06:01.688 Run time: 1 seconds 00:06:01.688 Verify: Yes 00:06:01.688 00:06:01.688 Running for 1 seconds... 00:06:01.688 00:06:01.688 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:01.688 ------------------------------------------------------------------------------------ 00:06:01.688 0,0 622880/s 2433 MiB/s 0 0 00:06:01.688 ==================================================================================== 00:06:01.688 Total 622880/s 2433 MiB/s 0 0' 00:06:01.688 14:10:15 -- accel/accel.sh@20 -- # IFS=: 00:06:01.688 14:10:15 -- accel/accel.sh@20 -- # read -r var val 00:06:01.688 14:10:15 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:06:01.688 14:10:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:06:01.688 14:10:15 -- accel/accel.sh@12 -- # build_accel_config 00:06:01.688 14:10:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:01.688 14:10:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:01.688 14:10:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:01.688 14:10:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:01.688 14:10:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:01.688 14:10:15 -- accel/accel.sh@41 -- # local IFS=, 00:06:01.688 14:10:15 -- accel/accel.sh@42 -- # jq -r . 00:06:01.688 [2024-12-16 14:10:15.876051] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.688 [2024-12-16 14:10:15.876108] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid211057 ] 00:06:01.688 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.688 [2024-12-16 14:10:15.931108] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.688 [2024-12-16 14:10:15.997181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.688 14:10:16 -- accel/accel.sh@21 -- # val= 00:06:01.688 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.688 14:10:16 -- accel/accel.sh@21 -- # val= 00:06:01.688 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.688 14:10:16 -- accel/accel.sh@21 -- # val=0x1 00:06:01.688 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.688 14:10:16 -- accel/accel.sh@21 -- # val= 00:06:01.688 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.688 14:10:16 -- accel/accel.sh@21 -- # val= 00:06:01.688 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.688 14:10:16 -- accel/accel.sh@21 -- # val=compare 00:06:01.688 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.688 14:10:16 -- accel/accel.sh@24 -- # accel_opc=compare 00:06:01.688 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val= 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val=software 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@23 -- # accel_module=software 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val=32 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val=32 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val=1 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val=Yes 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val= 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:01.689 14:10:16 -- accel/accel.sh@21 -- # val= 00:06:01.689 14:10:16 -- accel/accel.sh@22 -- # case "$var" in 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # IFS=: 00:06:01.689 14:10:16 -- accel/accel.sh@20 -- # read -r var val 00:06:02.623 14:10:17 -- accel/accel.sh@21 -- # val= 00:06:02.623 14:10:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.623 14:10:17 -- accel/accel.sh@20 -- # IFS=: 00:06:02.623 14:10:17 -- accel/accel.sh@20 -- # read -r var val 00:06:02.623 14:10:17 -- accel/accel.sh@21 -- # val= 00:06:02.623 14:10:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # IFS=: 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # read -r var val 00:06:02.624 14:10:17 -- accel/accel.sh@21 -- # val= 00:06:02.624 14:10:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # IFS=: 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # read -r var val 00:06:02.624 14:10:17 -- accel/accel.sh@21 -- # val= 00:06:02.624 14:10:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # IFS=: 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # read -r var val 00:06:02.624 14:10:17 -- accel/accel.sh@21 -- # val= 00:06:02.624 14:10:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # IFS=: 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # read -r var val 00:06:02.624 14:10:17 -- accel/accel.sh@21 -- # val= 00:06:02.624 14:10:17 -- accel/accel.sh@22 -- # case "$var" in 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # IFS=: 00:06:02.624 14:10:17 -- accel/accel.sh@20 -- # read -r var val 00:06:02.882 14:10:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:02.882 14:10:17 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:06:02.882 14:10:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:02.882 00:06:02.882 real 0m2.691s 00:06:02.882 user 0m2.464s 00:06:02.882 sys 0m0.234s 00:06:02.882 14:10:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:02.882 14:10:17 -- common/autotest_common.sh@10 -- # set +x 00:06:02.882 ************************************ 00:06:02.882 END TEST accel_compare 00:06:02.882 ************************************ 00:06:02.882 14:10:17 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:06:02.882 14:10:17 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:02.882 14:10:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.882 14:10:17 -- common/autotest_common.sh@10 -- # set +x 00:06:02.882 ************************************ 00:06:02.882 START TEST accel_xor 00:06:02.882 ************************************ 00:06:02.882 14:10:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:06:02.882 14:10:17 -- accel/accel.sh@16 -- # local accel_opc 00:06:02.882 14:10:17 -- accel/accel.sh@17 -- # local accel_module 00:06:02.882 14:10:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:06:02.882 14:10:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:02.882 14:10:17 -- accel/accel.sh@12 -- # build_accel_config 00:06:02.882 14:10:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:02.882 14:10:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:02.882 14:10:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:02.882 14:10:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:02.882 14:10:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:02.882 14:10:17 -- accel/accel.sh@41 -- # local IFS=, 00:06:02.882 14:10:17 -- accel/accel.sh@42 -- # jq -r . 00:06:02.882 [2024-12-16 14:10:17.252313] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.882 [2024-12-16 14:10:17.252361] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid211300 ] 00:06:02.882 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.882 [2024-12-16 14:10:17.305684] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.882 [2024-12-16 14:10:17.373211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.257 14:10:18 -- accel/accel.sh@18 -- # out=' 00:06:04.257 SPDK Configuration: 00:06:04.257 Core mask: 0x1 00:06:04.257 00:06:04.257 Accel Perf Configuration: 00:06:04.257 Workload Type: xor 00:06:04.258 Source buffers: 2 00:06:04.258 Transfer size: 4096 bytes 00:06:04.258 Vector count 1 00:06:04.258 Module: software 00:06:04.258 Queue depth: 32 00:06:04.258 Allocate depth: 32 00:06:04.258 # threads/core: 1 00:06:04.258 Run time: 1 seconds 00:06:04.258 Verify: Yes 00:06:04.258 00:06:04.258 Running for 1 seconds... 00:06:04.258 00:06:04.258 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:04.258 ------------------------------------------------------------------------------------ 00:06:04.258 0,0 500000/s 1953 MiB/s 0 0 00:06:04.258 ==================================================================================== 00:06:04.258 Total 500000/s 1953 MiB/s 0 0' 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:06:04.258 14:10:18 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:06:04.258 14:10:18 -- accel/accel.sh@12 -- # build_accel_config 00:06:04.258 14:10:18 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:04.258 14:10:18 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:04.258 14:10:18 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:04.258 14:10:18 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:04.258 14:10:18 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:04.258 14:10:18 -- accel/accel.sh@41 -- # local IFS=, 00:06:04.258 14:10:18 -- accel/accel.sh@42 -- # jq -r . 00:06:04.258 [2024-12-16 14:10:18.595991] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:04.258 [2024-12-16 14:10:18.596068] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid211532 ] 00:06:04.258 EAL: No free 2048 kB hugepages reported on node 1 00:06:04.258 [2024-12-16 14:10:18.652091] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:04.258 [2024-12-16 14:10:18.718203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val= 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val= 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val=0x1 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val= 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val= 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val=xor 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val=2 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val= 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val=software 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@23 -- # accel_module=software 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val=32 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val=32 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val=1 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val=Yes 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val= 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:04.258 14:10:18 -- accel/accel.sh@21 -- # val= 00:06:04.258 14:10:18 -- accel/accel.sh@22 -- # case "$var" in 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # IFS=: 00:06:04.258 14:10:18 -- accel/accel.sh@20 -- # read -r var val 00:06:05.634 14:10:19 -- accel/accel.sh@21 -- # val= 00:06:05.635 14:10:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # IFS=: 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # read -r var val 00:06:05.635 14:10:19 -- accel/accel.sh@21 -- # val= 00:06:05.635 14:10:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # IFS=: 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # read -r var val 00:06:05.635 14:10:19 -- accel/accel.sh@21 -- # val= 00:06:05.635 14:10:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # IFS=: 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # read -r var val 00:06:05.635 14:10:19 -- accel/accel.sh@21 -- # val= 00:06:05.635 14:10:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # IFS=: 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # read -r var val 00:06:05.635 14:10:19 -- accel/accel.sh@21 -- # val= 00:06:05.635 14:10:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # IFS=: 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # read -r var val 00:06:05.635 14:10:19 -- accel/accel.sh@21 -- # val= 00:06:05.635 14:10:19 -- accel/accel.sh@22 -- # case "$var" in 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # IFS=: 00:06:05.635 14:10:19 -- accel/accel.sh@20 -- # read -r var val 00:06:05.635 14:10:19 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:05.635 14:10:19 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:05.635 14:10:19 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:05.635 00:06:05.635 real 0m2.683s 00:06:05.635 user 0m2.466s 00:06:05.635 sys 0m0.224s 00:06:05.635 14:10:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:05.635 14:10:19 -- common/autotest_common.sh@10 -- # set +x 00:06:05.635 ************************************ 00:06:05.635 END TEST accel_xor 00:06:05.635 ************************************ 00:06:05.635 14:10:19 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:06:05.635 14:10:19 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:05.635 14:10:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:05.635 14:10:19 -- common/autotest_common.sh@10 -- # set +x 00:06:05.635 ************************************ 00:06:05.635 START TEST accel_xor 00:06:05.635 ************************************ 00:06:05.635 14:10:19 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:06:05.635 14:10:19 -- accel/accel.sh@16 -- # local accel_opc 00:06:05.635 14:10:19 -- accel/accel.sh@17 -- # local accel_module 00:06:05.635 14:10:19 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:06:05.635 14:10:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:05.635 14:10:19 -- accel/accel.sh@12 -- # build_accel_config 00:06:05.635 14:10:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:05.635 14:10:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:05.635 14:10:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:05.635 14:10:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:05.635 14:10:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:05.635 14:10:19 -- accel/accel.sh@41 -- # local IFS=, 00:06:05.635 14:10:19 -- accel/accel.sh@42 -- # jq -r . 00:06:05.635 [2024-12-16 14:10:19.984526] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:05.635 [2024-12-16 14:10:19.984586] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid211777 ] 00:06:05.635 EAL: No free 2048 kB hugepages reported on node 1 00:06:05.635 [2024-12-16 14:10:20.042681] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:05.635 [2024-12-16 14:10:20.121526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.012 14:10:21 -- accel/accel.sh@18 -- # out=' 00:06:07.012 SPDK Configuration: 00:06:07.012 Core mask: 0x1 00:06:07.012 00:06:07.012 Accel Perf Configuration: 00:06:07.012 Workload Type: xor 00:06:07.012 Source buffers: 3 00:06:07.012 Transfer size: 4096 bytes 00:06:07.012 Vector count 1 00:06:07.012 Module: software 00:06:07.012 Queue depth: 32 00:06:07.012 Allocate depth: 32 00:06:07.012 # threads/core: 1 00:06:07.012 Run time: 1 seconds 00:06:07.012 Verify: Yes 00:06:07.012 00:06:07.012 Running for 1 seconds... 00:06:07.012 00:06:07.012 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:07.012 ------------------------------------------------------------------------------------ 00:06:07.012 0,0 457088/s 1785 MiB/s 0 0 00:06:07.012 ==================================================================================== 00:06:07.012 Total 457088/s 1785 MiB/s 0 0' 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:06:07.012 14:10:21 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:06:07.012 14:10:21 -- accel/accel.sh@12 -- # build_accel_config 00:06:07.012 14:10:21 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:07.012 14:10:21 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:07.012 14:10:21 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:07.012 14:10:21 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:07.012 14:10:21 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:07.012 14:10:21 -- accel/accel.sh@41 -- # local IFS=, 00:06:07.012 14:10:21 -- accel/accel.sh@42 -- # jq -r . 00:06:07.012 [2024-12-16 14:10:21.345870] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.012 [2024-12-16 14:10:21.345949] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid212004 ] 00:06:07.012 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.012 [2024-12-16 14:10:21.402433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:07.012 [2024-12-16 14:10:21.468425] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val= 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val= 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val=0x1 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val= 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val= 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val=xor 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@24 -- # accel_opc=xor 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val=3 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val= 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val=software 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@23 -- # accel_module=software 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val=32 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val=32 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val=1 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val=Yes 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val= 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:07.012 14:10:21 -- accel/accel.sh@21 -- # val= 00:06:07.012 14:10:21 -- accel/accel.sh@22 -- # case "$var" in 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # IFS=: 00:06:07.012 14:10:21 -- accel/accel.sh@20 -- # read -r var val 00:06:08.388 14:10:22 -- accel/accel.sh@21 -- # val= 00:06:08.388 14:10:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # IFS=: 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # read -r var val 00:06:08.388 14:10:22 -- accel/accel.sh@21 -- # val= 00:06:08.388 14:10:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # IFS=: 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # read -r var val 00:06:08.388 14:10:22 -- accel/accel.sh@21 -- # val= 00:06:08.388 14:10:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # IFS=: 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # read -r var val 00:06:08.388 14:10:22 -- accel/accel.sh@21 -- # val= 00:06:08.388 14:10:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # IFS=: 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # read -r var val 00:06:08.388 14:10:22 -- accel/accel.sh@21 -- # val= 00:06:08.388 14:10:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # IFS=: 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # read -r var val 00:06:08.388 14:10:22 -- accel/accel.sh@21 -- # val= 00:06:08.388 14:10:22 -- accel/accel.sh@22 -- # case "$var" in 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # IFS=: 00:06:08.388 14:10:22 -- accel/accel.sh@20 -- # read -r var val 00:06:08.388 14:10:22 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:08.388 14:10:22 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:06:08.388 14:10:22 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:08.388 00:06:08.389 real 0m2.712s 00:06:08.389 user 0m2.505s 00:06:08.389 sys 0m0.213s 00:06:08.389 14:10:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:08.389 14:10:22 -- common/autotest_common.sh@10 -- # set +x 00:06:08.389 ************************************ 00:06:08.389 END TEST accel_xor 00:06:08.389 ************************************ 00:06:08.389 14:10:22 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:06:08.389 14:10:22 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:08.389 14:10:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:08.389 14:10:22 -- common/autotest_common.sh@10 -- # set +x 00:06:08.389 ************************************ 00:06:08.389 START TEST accel_dif_verify 00:06:08.389 ************************************ 00:06:08.389 14:10:22 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:06:08.389 14:10:22 -- accel/accel.sh@16 -- # local accel_opc 00:06:08.389 14:10:22 -- accel/accel.sh@17 -- # local accel_module 00:06:08.389 14:10:22 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:06:08.389 14:10:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:08.389 14:10:22 -- accel/accel.sh@12 -- # build_accel_config 00:06:08.389 14:10:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:08.389 14:10:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:08.389 14:10:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:08.389 14:10:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:08.389 14:10:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:08.389 14:10:22 -- accel/accel.sh@41 -- # local IFS=, 00:06:08.389 14:10:22 -- accel/accel.sh@42 -- # jq -r . 00:06:08.389 [2024-12-16 14:10:22.733193] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:08.389 [2024-12-16 14:10:22.733251] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid212253 ] 00:06:08.389 EAL: No free 2048 kB hugepages reported on node 1 00:06:08.389 [2024-12-16 14:10:22.788465] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:08.389 [2024-12-16 14:10:22.855841] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.765 14:10:24 -- accel/accel.sh@18 -- # out=' 00:06:09.765 SPDK Configuration: 00:06:09.765 Core mask: 0x1 00:06:09.765 00:06:09.765 Accel Perf Configuration: 00:06:09.765 Workload Type: dif_verify 00:06:09.765 Vector size: 4096 bytes 00:06:09.765 Transfer size: 4096 bytes 00:06:09.765 Block size: 512 bytes 00:06:09.765 Metadata size: 8 bytes 00:06:09.765 Vector count 1 00:06:09.765 Module: software 00:06:09.765 Queue depth: 32 00:06:09.765 Allocate depth: 32 00:06:09.765 # threads/core: 1 00:06:09.765 Run time: 1 seconds 00:06:09.765 Verify: No 00:06:09.765 00:06:09.765 Running for 1 seconds... 00:06:09.765 00:06:09.765 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:09.765 ------------------------------------------------------------------------------------ 00:06:09.765 0,0 132672/s 526 MiB/s 0 0 00:06:09.765 ==================================================================================== 00:06:09.765 Total 132672/s 518 MiB/s 0 0' 00:06:09.765 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.765 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.765 14:10:24 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:06:09.765 14:10:24 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:06:09.765 14:10:24 -- accel/accel.sh@12 -- # build_accel_config 00:06:09.765 14:10:24 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:09.765 14:10:24 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:09.765 14:10:24 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:09.765 14:10:24 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:09.765 14:10:24 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:09.765 14:10:24 -- accel/accel.sh@41 -- # local IFS=, 00:06:09.765 14:10:24 -- accel/accel.sh@42 -- # jq -r . 00:06:09.765 [2024-12-16 14:10:24.077225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:09.765 [2024-12-16 14:10:24.077301] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid212483 ] 00:06:09.765 EAL: No free 2048 kB hugepages reported on node 1 00:06:09.765 [2024-12-16 14:10:24.133544] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:09.765 [2024-12-16 14:10:24.199821] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:09.765 14:10:24 -- accel/accel.sh@21 -- # val= 00:06:09.765 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.765 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.765 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.765 14:10:24 -- accel/accel.sh@21 -- # val= 00:06:09.765 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.765 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.765 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val=0x1 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val= 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val= 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val=dif_verify 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val= 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val=software 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@23 -- # accel_module=software 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val=32 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val=32 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val=1 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val=No 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val= 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:09.766 14:10:24 -- accel/accel.sh@21 -- # val= 00:06:09.766 14:10:24 -- accel/accel.sh@22 -- # case "$var" in 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # IFS=: 00:06:09.766 14:10:24 -- accel/accel.sh@20 -- # read -r var val 00:06:10.845 14:10:25 -- accel/accel.sh@21 -- # val= 00:06:10.845 14:10:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # IFS=: 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # read -r var val 00:06:10.845 14:10:25 -- accel/accel.sh@21 -- # val= 00:06:10.845 14:10:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # IFS=: 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # read -r var val 00:06:10.845 14:10:25 -- accel/accel.sh@21 -- # val= 00:06:10.845 14:10:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # IFS=: 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # read -r var val 00:06:10.845 14:10:25 -- accel/accel.sh@21 -- # val= 00:06:10.845 14:10:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # IFS=: 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # read -r var val 00:06:10.845 14:10:25 -- accel/accel.sh@21 -- # val= 00:06:10.845 14:10:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # IFS=: 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # read -r var val 00:06:10.845 14:10:25 -- accel/accel.sh@21 -- # val= 00:06:10.845 14:10:25 -- accel/accel.sh@22 -- # case "$var" in 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # IFS=: 00:06:10.845 14:10:25 -- accel/accel.sh@20 -- # read -r var val 00:06:10.845 14:10:25 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:10.845 14:10:25 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:06:10.845 14:10:25 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:10.845 00:06:10.845 real 0m2.692s 00:06:10.845 user 0m2.482s 00:06:10.845 sys 0m0.220s 00:06:10.845 14:10:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:10.845 14:10:25 -- common/autotest_common.sh@10 -- # set +x 00:06:10.845 ************************************ 00:06:10.845 END TEST accel_dif_verify 00:06:10.845 ************************************ 00:06:11.106 14:10:25 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:06:11.106 14:10:25 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:11.106 14:10:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:11.106 14:10:25 -- common/autotest_common.sh@10 -- # set +x 00:06:11.106 ************************************ 00:06:11.106 START TEST accel_dif_generate 00:06:11.106 ************************************ 00:06:11.106 14:10:25 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:06:11.106 14:10:25 -- accel/accel.sh@16 -- # local accel_opc 00:06:11.106 14:10:25 -- accel/accel.sh@17 -- # local accel_module 00:06:11.106 14:10:25 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:06:11.106 14:10:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:11.106 14:10:25 -- accel/accel.sh@12 -- # build_accel_config 00:06:11.106 14:10:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:11.106 14:10:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:11.106 14:10:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:11.106 14:10:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:11.106 14:10:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:11.106 14:10:25 -- accel/accel.sh@41 -- # local IFS=, 00:06:11.106 14:10:25 -- accel/accel.sh@42 -- # jq -r . 00:06:11.106 [2024-12-16 14:10:25.464536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:11.106 [2024-12-16 14:10:25.464592] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid212734 ] 00:06:11.106 EAL: No free 2048 kB hugepages reported on node 1 00:06:11.106 [2024-12-16 14:10:25.518876] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:11.106 [2024-12-16 14:10:25.586523] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.482 14:10:26 -- accel/accel.sh@18 -- # out=' 00:06:12.482 SPDK Configuration: 00:06:12.482 Core mask: 0x1 00:06:12.482 00:06:12.482 Accel Perf Configuration: 00:06:12.482 Workload Type: dif_generate 00:06:12.482 Vector size: 4096 bytes 00:06:12.482 Transfer size: 4096 bytes 00:06:12.482 Block size: 512 bytes 00:06:12.482 Metadata size: 8 bytes 00:06:12.482 Vector count 1 00:06:12.482 Module: software 00:06:12.482 Queue depth: 32 00:06:12.482 Allocate depth: 32 00:06:12.482 # threads/core: 1 00:06:12.482 Run time: 1 seconds 00:06:12.482 Verify: No 00:06:12.482 00:06:12.482 Running for 1 seconds... 00:06:12.482 00:06:12.482 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:12.482 ------------------------------------------------------------------------------------ 00:06:12.482 0,0 160224/s 635 MiB/s 0 0 00:06:12.482 ==================================================================================== 00:06:12.482 Total 160224/s 625 MiB/s 0 0' 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:06:12.482 14:10:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:06:12.482 14:10:26 -- accel/accel.sh@12 -- # build_accel_config 00:06:12.482 14:10:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:12.482 14:10:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:12.482 14:10:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:12.482 14:10:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:12.482 14:10:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:12.482 14:10:26 -- accel/accel.sh@41 -- # local IFS=, 00:06:12.482 14:10:26 -- accel/accel.sh@42 -- # jq -r . 00:06:12.482 [2024-12-16 14:10:26.806782] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:12.482 [2024-12-16 14:10:26.806840] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid212968 ] 00:06:12.482 EAL: No free 2048 kB hugepages reported on node 1 00:06:12.482 [2024-12-16 14:10:26.861636] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:12.482 [2024-12-16 14:10:26.927766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val= 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val= 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val=0x1 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val= 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val= 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val=dif_generate 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val='512 bytes' 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val='8 bytes' 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val= 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val=software 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@23 -- # accel_module=software 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val=32 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val=32 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val=1 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val=No 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val= 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:12.482 14:10:26 -- accel/accel.sh@21 -- # val= 00:06:12.482 14:10:26 -- accel/accel.sh@22 -- # case "$var" in 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # IFS=: 00:06:12.482 14:10:26 -- accel/accel.sh@20 -- # read -r var val 00:06:13.858 14:10:28 -- accel/accel.sh@21 -- # val= 00:06:13.858 14:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # IFS=: 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # read -r var val 00:06:13.858 14:10:28 -- accel/accel.sh@21 -- # val= 00:06:13.858 14:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # IFS=: 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # read -r var val 00:06:13.858 14:10:28 -- accel/accel.sh@21 -- # val= 00:06:13.858 14:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # IFS=: 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # read -r var val 00:06:13.858 14:10:28 -- accel/accel.sh@21 -- # val= 00:06:13.858 14:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # IFS=: 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # read -r var val 00:06:13.858 14:10:28 -- accel/accel.sh@21 -- # val= 00:06:13.858 14:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # IFS=: 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # read -r var val 00:06:13.858 14:10:28 -- accel/accel.sh@21 -- # val= 00:06:13.858 14:10:28 -- accel/accel.sh@22 -- # case "$var" in 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # IFS=: 00:06:13.858 14:10:28 -- accel/accel.sh@20 -- # read -r var val 00:06:13.858 14:10:28 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:13.858 14:10:28 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:06:13.858 14:10:28 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:13.858 00:06:13.858 real 0m2.688s 00:06:13.858 user 0m2.479s 00:06:13.858 sys 0m0.219s 00:06:13.858 14:10:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:13.858 14:10:28 -- common/autotest_common.sh@10 -- # set +x 00:06:13.858 ************************************ 00:06:13.858 END TEST accel_dif_generate 00:06:13.858 ************************************ 00:06:13.858 14:10:28 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:06:13.858 14:10:28 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:06:13.858 14:10:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:13.858 14:10:28 -- common/autotest_common.sh@10 -- # set +x 00:06:13.858 ************************************ 00:06:13.858 START TEST accel_dif_generate_copy 00:06:13.858 ************************************ 00:06:13.858 14:10:28 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:06:13.858 14:10:28 -- accel/accel.sh@16 -- # local accel_opc 00:06:13.858 14:10:28 -- accel/accel.sh@17 -- # local accel_module 00:06:13.858 14:10:28 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:06:13.858 14:10:28 -- accel/accel.sh@12 -- # build_accel_config 00:06:13.858 14:10:28 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:13.858 14:10:28 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:13.858 14:10:28 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:13.858 14:10:28 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:13.858 14:10:28 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:13.858 14:10:28 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:13.858 14:10:28 -- accel/accel.sh@41 -- # local IFS=, 00:06:13.858 14:10:28 -- accel/accel.sh@42 -- # jq -r . 00:06:13.858 [2024-12-16 14:10:28.192077] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:13.858 [2024-12-16 14:10:28.192137] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid213209 ] 00:06:13.858 EAL: No free 2048 kB hugepages reported on node 1 00:06:13.858 [2024-12-16 14:10:28.246567] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:13.858 [2024-12-16 14:10:28.313689] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.234 14:10:29 -- accel/accel.sh@18 -- # out=' 00:06:15.234 SPDK Configuration: 00:06:15.234 Core mask: 0x1 00:06:15.234 00:06:15.234 Accel Perf Configuration: 00:06:15.234 Workload Type: dif_generate_copy 00:06:15.234 Vector size: 4096 bytes 00:06:15.234 Transfer size: 4096 bytes 00:06:15.234 Vector count 1 00:06:15.234 Module: software 00:06:15.234 Queue depth: 32 00:06:15.234 Allocate depth: 32 00:06:15.234 # threads/core: 1 00:06:15.234 Run time: 1 seconds 00:06:15.234 Verify: No 00:06:15.234 00:06:15.234 Running for 1 seconds... 00:06:15.234 00:06:15.234 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:15.234 ------------------------------------------------------------------------------------ 00:06:15.234 0,0 123360/s 489 MiB/s 0 0 00:06:15.234 ==================================================================================== 00:06:15.234 Total 123360/s 481 MiB/s 0 0' 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:06:15.234 14:10:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:06:15.234 14:10:29 -- accel/accel.sh@12 -- # build_accel_config 00:06:15.234 14:10:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:15.234 14:10:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:15.234 14:10:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:15.234 14:10:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:15.234 14:10:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:15.234 14:10:29 -- accel/accel.sh@41 -- # local IFS=, 00:06:15.234 14:10:29 -- accel/accel.sh@42 -- # jq -r . 00:06:15.234 [2024-12-16 14:10:29.534003] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:15.234 [2024-12-16 14:10:29.534062] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid213437 ] 00:06:15.234 EAL: No free 2048 kB hugepages reported on node 1 00:06:15.234 [2024-12-16 14:10:29.589461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:15.234 [2024-12-16 14:10:29.656928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val= 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val= 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val=0x1 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val= 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val= 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val= 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val=software 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@23 -- # accel_module=software 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val=32 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val=32 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val=1 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val=No 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val= 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:15.234 14:10:29 -- accel/accel.sh@21 -- # val= 00:06:15.234 14:10:29 -- accel/accel.sh@22 -- # case "$var" in 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # IFS=: 00:06:15.234 14:10:29 -- accel/accel.sh@20 -- # read -r var val 00:06:16.610 14:10:30 -- accel/accel.sh@21 -- # val= 00:06:16.610 14:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # IFS=: 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # read -r var val 00:06:16.610 14:10:30 -- accel/accel.sh@21 -- # val= 00:06:16.610 14:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # IFS=: 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # read -r var val 00:06:16.610 14:10:30 -- accel/accel.sh@21 -- # val= 00:06:16.610 14:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # IFS=: 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # read -r var val 00:06:16.610 14:10:30 -- accel/accel.sh@21 -- # val= 00:06:16.610 14:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # IFS=: 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # read -r var val 00:06:16.610 14:10:30 -- accel/accel.sh@21 -- # val= 00:06:16.610 14:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # IFS=: 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # read -r var val 00:06:16.610 14:10:30 -- accel/accel.sh@21 -- # val= 00:06:16.610 14:10:30 -- accel/accel.sh@22 -- # case "$var" in 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # IFS=: 00:06:16.610 14:10:30 -- accel/accel.sh@20 -- # read -r var val 00:06:16.610 14:10:30 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:16.610 14:10:30 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:06:16.610 14:10:30 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:16.610 00:06:16.610 real 0m2.692s 00:06:16.610 user 0m2.476s 00:06:16.610 sys 0m0.224s 00:06:16.610 14:10:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:16.610 14:10:30 -- common/autotest_common.sh@10 -- # set +x 00:06:16.610 ************************************ 00:06:16.610 END TEST accel_dif_generate_copy 00:06:16.610 ************************************ 00:06:16.610 14:10:30 -- accel/accel.sh@107 -- # [[ y == y ]] 00:06:16.610 14:10:30 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.610 14:10:30 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:16.610 14:10:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:16.610 14:10:30 -- common/autotest_common.sh@10 -- # set +x 00:06:16.610 ************************************ 00:06:16.610 START TEST accel_comp 00:06:16.610 ************************************ 00:06:16.610 14:10:30 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.610 14:10:30 -- accel/accel.sh@16 -- # local accel_opc 00:06:16.610 14:10:30 -- accel/accel.sh@17 -- # local accel_module 00:06:16.610 14:10:30 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.610 14:10:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:16.610 14:10:30 -- accel/accel.sh@12 -- # build_accel_config 00:06:16.610 14:10:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:16.610 14:10:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:16.610 14:10:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:16.610 14:10:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:16.610 14:10:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:16.610 14:10:30 -- accel/accel.sh@41 -- # local IFS=, 00:06:16.610 14:10:30 -- accel/accel.sh@42 -- # jq -r . 00:06:16.610 [2024-12-16 14:10:30.922811] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:16.610 [2024-12-16 14:10:30.922884] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid213687 ] 00:06:16.610 EAL: No free 2048 kB hugepages reported on node 1 00:06:16.610 [2024-12-16 14:10:30.979463] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:16.610 [2024-12-16 14:10:31.046910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.986 14:10:32 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:17.986 00:06:17.986 SPDK Configuration: 00:06:17.986 Core mask: 0x1 00:06:17.986 00:06:17.986 Accel Perf Configuration: 00:06:17.986 Workload Type: compress 00:06:17.986 Transfer size: 4096 bytes 00:06:17.986 Vector count 1 00:06:17.986 Module: software 00:06:17.986 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.986 Queue depth: 32 00:06:17.986 Allocate depth: 32 00:06:17.986 # threads/core: 1 00:06:17.986 Run time: 1 seconds 00:06:17.986 Verify: No 00:06:17.986 00:06:17.986 Running for 1 seconds... 00:06:17.986 00:06:17.986 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:17.986 ------------------------------------------------------------------------------------ 00:06:17.986 0,0 62880/s 262 MiB/s 0 0 00:06:17.986 ==================================================================================== 00:06:17.986 Total 62880/s 245 MiB/s 0 0' 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.986 14:10:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.986 14:10:32 -- accel/accel.sh@12 -- # build_accel_config 00:06:17.986 14:10:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:17.986 14:10:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:17.986 14:10:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:17.986 14:10:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:17.986 14:10:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:17.986 14:10:32 -- accel/accel.sh@41 -- # local IFS=, 00:06:17.986 14:10:32 -- accel/accel.sh@42 -- # jq -r . 00:06:17.986 [2024-12-16 14:10:32.271136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:17.986 [2024-12-16 14:10:32.271213] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid213915 ] 00:06:17.986 EAL: No free 2048 kB hugepages reported on node 1 00:06:17.986 [2024-12-16 14:10:32.327721] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:17.986 [2024-12-16 14:10:32.394044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val= 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val= 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val= 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val=0x1 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val= 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val= 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val=compress 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@24 -- # accel_opc=compress 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val= 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val=software 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@23 -- # accel_module=software 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val=32 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val=32 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val=1 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val=No 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val= 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:17.986 14:10:32 -- accel/accel.sh@21 -- # val= 00:06:17.986 14:10:32 -- accel/accel.sh@22 -- # case "$var" in 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # IFS=: 00:06:17.986 14:10:32 -- accel/accel.sh@20 -- # read -r var val 00:06:19.363 14:10:33 -- accel/accel.sh@21 -- # val= 00:06:19.363 14:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # IFS=: 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # read -r var val 00:06:19.363 14:10:33 -- accel/accel.sh@21 -- # val= 00:06:19.363 14:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # IFS=: 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # read -r var val 00:06:19.363 14:10:33 -- accel/accel.sh@21 -- # val= 00:06:19.363 14:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # IFS=: 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # read -r var val 00:06:19.363 14:10:33 -- accel/accel.sh@21 -- # val= 00:06:19.363 14:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # IFS=: 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # read -r var val 00:06:19.363 14:10:33 -- accel/accel.sh@21 -- # val= 00:06:19.363 14:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # IFS=: 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # read -r var val 00:06:19.363 14:10:33 -- accel/accel.sh@21 -- # val= 00:06:19.363 14:10:33 -- accel/accel.sh@22 -- # case "$var" in 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # IFS=: 00:06:19.363 14:10:33 -- accel/accel.sh@20 -- # read -r var val 00:06:19.363 14:10:33 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:19.363 14:10:33 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:06:19.363 14:10:33 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:19.363 00:06:19.363 real 0m2.700s 00:06:19.363 user 0m2.496s 00:06:19.363 sys 0m0.214s 00:06:19.363 14:10:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:19.363 14:10:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.363 ************************************ 00:06:19.363 END TEST accel_comp 00:06:19.363 ************************************ 00:06:19.363 14:10:33 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.363 14:10:33 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:19.363 14:10:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:19.363 14:10:33 -- common/autotest_common.sh@10 -- # set +x 00:06:19.363 ************************************ 00:06:19.363 START TEST accel_decomp 00:06:19.363 ************************************ 00:06:19.363 14:10:33 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.363 14:10:33 -- accel/accel.sh@16 -- # local accel_opc 00:06:19.363 14:10:33 -- accel/accel.sh@17 -- # local accel_module 00:06:19.363 14:10:33 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.363 14:10:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:19.363 14:10:33 -- accel/accel.sh@12 -- # build_accel_config 00:06:19.363 14:10:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:19.363 14:10:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:19.363 14:10:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:19.363 14:10:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:19.363 14:10:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:19.363 14:10:33 -- accel/accel.sh@41 -- # local IFS=, 00:06:19.363 14:10:33 -- accel/accel.sh@42 -- # jq -r . 00:06:19.363 [2024-12-16 14:10:33.663459] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:19.363 [2024-12-16 14:10:33.663533] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid214156 ] 00:06:19.363 EAL: No free 2048 kB hugepages reported on node 1 00:06:19.363 [2024-12-16 14:10:33.721812] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:19.363 [2024-12-16 14:10:33.789181] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.739 14:10:34 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:20.739 00:06:20.739 SPDK Configuration: 00:06:20.739 Core mask: 0x1 00:06:20.739 00:06:20.739 Accel Perf Configuration: 00:06:20.739 Workload Type: decompress 00:06:20.739 Transfer size: 4096 bytes 00:06:20.739 Vector count 1 00:06:20.739 Module: software 00:06:20.739 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.739 Queue depth: 32 00:06:20.739 Allocate depth: 32 00:06:20.739 # threads/core: 1 00:06:20.739 Run time: 1 seconds 00:06:20.739 Verify: Yes 00:06:20.739 00:06:20.739 Running for 1 seconds... 00:06:20.740 00:06:20.740 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:20.740 ------------------------------------------------------------------------------------ 00:06:20.740 0,0 74560/s 137 MiB/s 0 0 00:06:20.740 ==================================================================================== 00:06:20.740 Total 74560/s 291 MiB/s 0 0' 00:06:20.740 14:10:34 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:34 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:34 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:20.740 14:10:34 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:20.740 14:10:34 -- accel/accel.sh@12 -- # build_accel_config 00:06:20.740 14:10:34 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:20.740 14:10:34 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:20.740 14:10:34 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:20.740 14:10:34 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:20.740 14:10:34 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:20.740 14:10:34 -- accel/accel.sh@41 -- # local IFS=, 00:06:20.740 14:10:34 -- accel/accel.sh@42 -- # jq -r . 00:06:20.740 [2024-12-16 14:10:35.012460] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:20.740 [2024-12-16 14:10:35.012520] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid214392 ] 00:06:20.740 EAL: No free 2048 kB hugepages reported on node 1 00:06:20.740 [2024-12-16 14:10:35.067243] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:20.740 [2024-12-16 14:10:35.133182] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val= 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val= 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val= 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val=0x1 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val= 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val= 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val=decompress 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val= 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val=software 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@23 -- # accel_module=software 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val=32 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val=32 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val=1 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val=Yes 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val= 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:20.740 14:10:35 -- accel/accel.sh@21 -- # val= 00:06:20.740 14:10:35 -- accel/accel.sh@22 -- # case "$var" in 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # IFS=: 00:06:20.740 14:10:35 -- accel/accel.sh@20 -- # read -r var val 00:06:22.116 14:10:36 -- accel/accel.sh@21 -- # val= 00:06:22.116 14:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # IFS=: 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # read -r var val 00:06:22.116 14:10:36 -- accel/accel.sh@21 -- # val= 00:06:22.116 14:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # IFS=: 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # read -r var val 00:06:22.116 14:10:36 -- accel/accel.sh@21 -- # val= 00:06:22.116 14:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # IFS=: 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # read -r var val 00:06:22.116 14:10:36 -- accel/accel.sh@21 -- # val= 00:06:22.116 14:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # IFS=: 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # read -r var val 00:06:22.116 14:10:36 -- accel/accel.sh@21 -- # val= 00:06:22.116 14:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # IFS=: 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # read -r var val 00:06:22.116 14:10:36 -- accel/accel.sh@21 -- # val= 00:06:22.116 14:10:36 -- accel/accel.sh@22 -- # case "$var" in 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # IFS=: 00:06:22.116 14:10:36 -- accel/accel.sh@20 -- # read -r var val 00:06:22.116 14:10:36 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:22.116 14:10:36 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:22.116 14:10:36 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:22.116 00:06:22.116 real 0m2.701s 00:06:22.116 user 0m2.485s 00:06:22.116 sys 0m0.225s 00:06:22.116 14:10:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:22.116 14:10:36 -- common/autotest_common.sh@10 -- # set +x 00:06:22.116 ************************************ 00:06:22.116 END TEST accel_decomp 00:06:22.116 ************************************ 00:06:22.116 14:10:36 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.116 14:10:36 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:22.116 14:10:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:22.116 14:10:36 -- common/autotest_common.sh@10 -- # set +x 00:06:22.116 ************************************ 00:06:22.116 START TEST accel_decmop_full 00:06:22.116 ************************************ 00:06:22.116 14:10:36 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.116 14:10:36 -- accel/accel.sh@16 -- # local accel_opc 00:06:22.116 14:10:36 -- accel/accel.sh@17 -- # local accel_module 00:06:22.116 14:10:36 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.116 14:10:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:22.116 14:10:36 -- accel/accel.sh@12 -- # build_accel_config 00:06:22.116 14:10:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:22.116 14:10:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:22.117 14:10:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:22.117 14:10:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:22.117 14:10:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:22.117 14:10:36 -- accel/accel.sh@41 -- # local IFS=, 00:06:22.117 14:10:36 -- accel/accel.sh@42 -- # jq -r . 00:06:22.117 [2024-12-16 14:10:36.402143] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:22.117 [2024-12-16 14:10:36.402196] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid214635 ] 00:06:22.117 EAL: No free 2048 kB hugepages reported on node 1 00:06:22.117 [2024-12-16 14:10:36.460398] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:22.117 [2024-12-16 14:10:36.532639] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.494 14:10:37 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:23.494 00:06:23.494 SPDK Configuration: 00:06:23.494 Core mask: 0x1 00:06:23.494 00:06:23.494 Accel Perf Configuration: 00:06:23.494 Workload Type: decompress 00:06:23.494 Transfer size: 111250 bytes 00:06:23.494 Vector count 1 00:06:23.494 Module: software 00:06:23.494 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.494 Queue depth: 32 00:06:23.494 Allocate depth: 32 00:06:23.494 # threads/core: 1 00:06:23.494 Run time: 1 seconds 00:06:23.494 Verify: Yes 00:06:23.494 00:06:23.494 Running for 1 seconds... 00:06:23.494 00:06:23.494 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:23.494 ------------------------------------------------------------------------------------ 00:06:23.494 0,0 4736/s 195 MiB/s 0 0 00:06:23.494 ==================================================================================== 00:06:23.494 Total 4736/s 502 MiB/s 0 0' 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:23.494 14:10:37 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:06:23.494 14:10:37 -- accel/accel.sh@12 -- # build_accel_config 00:06:23.494 14:10:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:23.494 14:10:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:23.494 14:10:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:23.494 14:10:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:23.494 14:10:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:23.494 14:10:37 -- accel/accel.sh@41 -- # local IFS=, 00:06:23.494 14:10:37 -- accel/accel.sh@42 -- # jq -r . 00:06:23.494 [2024-12-16 14:10:37.766117] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:23.494 [2024-12-16 14:10:37.766187] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid214867 ] 00:06:23.494 EAL: No free 2048 kB hugepages reported on node 1 00:06:23.494 [2024-12-16 14:10:37.824262] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:23.494 [2024-12-16 14:10:37.890561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val= 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val= 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val= 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val=0x1 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val= 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val= 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val=decompress 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val= 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val=software 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@23 -- # accel_module=software 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val=32 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val=32 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.494 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.494 14:10:37 -- accel/accel.sh@21 -- # val=1 00:06:23.494 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.495 14:10:37 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:23.495 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.495 14:10:37 -- accel/accel.sh@21 -- # val=Yes 00:06:23.495 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.495 14:10:37 -- accel/accel.sh@21 -- # val= 00:06:23.495 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:23.495 14:10:37 -- accel/accel.sh@21 -- # val= 00:06:23.495 14:10:37 -- accel/accel.sh@22 -- # case "$var" in 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # IFS=: 00:06:23.495 14:10:37 -- accel/accel.sh@20 -- # read -r var val 00:06:24.872 14:10:39 -- accel/accel.sh@21 -- # val= 00:06:24.872 14:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # IFS=: 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # read -r var val 00:06:24.872 14:10:39 -- accel/accel.sh@21 -- # val= 00:06:24.872 14:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # IFS=: 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # read -r var val 00:06:24.872 14:10:39 -- accel/accel.sh@21 -- # val= 00:06:24.872 14:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # IFS=: 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # read -r var val 00:06:24.872 14:10:39 -- accel/accel.sh@21 -- # val= 00:06:24.872 14:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # IFS=: 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # read -r var val 00:06:24.872 14:10:39 -- accel/accel.sh@21 -- # val= 00:06:24.872 14:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # IFS=: 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # read -r var val 00:06:24.872 14:10:39 -- accel/accel.sh@21 -- # val= 00:06:24.872 14:10:39 -- accel/accel.sh@22 -- # case "$var" in 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # IFS=: 00:06:24.872 14:10:39 -- accel/accel.sh@20 -- # read -r var val 00:06:24.872 14:10:39 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:24.872 14:10:39 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:24.872 14:10:39 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:24.872 00:06:24.872 real 0m2.729s 00:06:24.872 user 0m2.509s 00:06:24.872 sys 0m0.226s 00:06:24.872 14:10:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:24.872 14:10:39 -- common/autotest_common.sh@10 -- # set +x 00:06:24.872 ************************************ 00:06:24.872 END TEST accel_decmop_full 00:06:24.872 ************************************ 00:06:24.872 14:10:39 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.872 14:10:39 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:24.872 14:10:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:24.872 14:10:39 -- common/autotest_common.sh@10 -- # set +x 00:06:24.872 ************************************ 00:06:24.872 START TEST accel_decomp_mcore 00:06:24.872 ************************************ 00:06:24.872 14:10:39 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.872 14:10:39 -- accel/accel.sh@16 -- # local accel_opc 00:06:24.872 14:10:39 -- accel/accel.sh@17 -- # local accel_module 00:06:24.872 14:10:39 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.872 14:10:39 -- accel/accel.sh@12 -- # build_accel_config 00:06:24.872 14:10:39 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:24.872 14:10:39 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:24.872 14:10:39 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:24.872 14:10:39 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:24.872 14:10:39 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:24.872 14:10:39 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:24.872 14:10:39 -- accel/accel.sh@41 -- # local IFS=, 00:06:24.872 14:10:39 -- accel/accel.sh@42 -- # jq -r . 00:06:24.872 [2024-12-16 14:10:39.167802] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:24.872 [2024-12-16 14:10:39.167872] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid215114 ] 00:06:24.872 EAL: No free 2048 kB hugepages reported on node 1 00:06:24.872 [2024-12-16 14:10:39.224279] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:24.872 [2024-12-16 14:10:39.294686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:24.872 [2024-12-16 14:10:39.294781] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:24.872 [2024-12-16 14:10:39.294881] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:24.872 [2024-12-16 14:10:39.294883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.250 14:10:40 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:26.250 00:06:26.250 SPDK Configuration: 00:06:26.250 Core mask: 0xf 00:06:26.250 00:06:26.250 Accel Perf Configuration: 00:06:26.250 Workload Type: decompress 00:06:26.250 Transfer size: 4096 bytes 00:06:26.250 Vector count 1 00:06:26.250 Module: software 00:06:26.250 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.250 Queue depth: 32 00:06:26.250 Allocate depth: 32 00:06:26.250 # threads/core: 1 00:06:26.250 Run time: 1 seconds 00:06:26.250 Verify: Yes 00:06:26.250 00:06:26.250 Running for 1 seconds... 00:06:26.250 00:06:26.250 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:26.250 ------------------------------------------------------------------------------------ 00:06:26.250 0,0 60576/s 111 MiB/s 0 0 00:06:26.250 3,0 62464/s 115 MiB/s 0 0 00:06:26.250 2,0 62592/s 115 MiB/s 0 0 00:06:26.250 1,0 62720/s 115 MiB/s 0 0 00:06:26.250 ==================================================================================== 00:06:26.250 Total 248352/s 970 MiB/s 0 0' 00:06:26.250 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.250 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.250 14:10:40 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:26.250 14:10:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:26.250 14:10:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:06:26.250 14:10:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:26.250 14:10:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:26.250 14:10:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:26.250 14:10:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:26.250 14:10:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:26.250 14:10:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:26.250 14:10:40 -- accel/accel.sh@42 -- # jq -r . 00:06:26.250 [2024-12-16 14:10:40.524238] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.250 [2024-12-16 14:10:40.524311] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid215347 ] 00:06:26.250 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.250 [2024-12-16 14:10:40.582606] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:26.250 [2024-12-16 14:10:40.652154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:26.250 [2024-12-16 14:10:40.652252] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:26.250 [2024-12-16 14:10:40.652340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:26.250 [2024-12-16 14:10:40.652342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:26.250 14:10:40 -- accel/accel.sh@21 -- # val= 00:06:26.250 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.250 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.250 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.250 14:10:40 -- accel/accel.sh@21 -- # val= 00:06:26.250 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.250 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.250 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.250 14:10:40 -- accel/accel.sh@21 -- # val= 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val=0xf 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val= 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val= 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val=decompress 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val= 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val=software 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@23 -- # accel_module=software 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val=32 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val=32 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val=1 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val=Yes 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val= 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:26.251 14:10:40 -- accel/accel.sh@21 -- # val= 00:06:26.251 14:10:40 -- accel/accel.sh@22 -- # case "$var" in 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # IFS=: 00:06:26.251 14:10:40 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@21 -- # val= 00:06:27.628 14:10:41 -- accel/accel.sh@22 -- # case "$var" in 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # IFS=: 00:06:27.628 14:10:41 -- accel/accel.sh@20 -- # read -r var val 00:06:27.628 14:10:41 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:27.628 14:10:41 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:27.628 14:10:41 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:27.628 00:06:27.628 real 0m2.723s 00:06:27.628 user 0m9.150s 00:06:27.628 sys 0m0.231s 00:06:27.628 14:10:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.628 14:10:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.628 ************************************ 00:06:27.628 END TEST accel_decomp_mcore 00:06:27.628 ************************************ 00:06:27.628 14:10:41 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.628 14:10:41 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:27.628 14:10:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.628 14:10:41 -- common/autotest_common.sh@10 -- # set +x 00:06:27.628 ************************************ 00:06:27.628 START TEST accel_decomp_full_mcore 00:06:27.628 ************************************ 00:06:27.628 14:10:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.629 14:10:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:27.629 14:10:41 -- accel/accel.sh@17 -- # local accel_module 00:06:27.629 14:10:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.629 14:10:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:27.629 14:10:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:27.629 14:10:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:27.629 14:10:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:27.629 14:10:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:27.629 14:10:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:27.629 14:10:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:27.629 14:10:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:27.629 14:10:41 -- accel/accel.sh@42 -- # jq -r . 00:06:27.629 [2024-12-16 14:10:41.931742] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.629 [2024-12-16 14:10:41.931820] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid215593 ] 00:06:27.629 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.629 [2024-12-16 14:10:41.988811] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:27.629 [2024-12-16 14:10:42.059313] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:27.629 [2024-12-16 14:10:42.059410] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:27.629 [2024-12-16 14:10:42.059511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:27.629 [2024-12-16 14:10:42.059515] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.006 14:10:43 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:29.006 00:06:29.006 SPDK Configuration: 00:06:29.006 Core mask: 0xf 00:06:29.006 00:06:29.006 Accel Perf Configuration: 00:06:29.006 Workload Type: decompress 00:06:29.006 Transfer size: 111250 bytes 00:06:29.006 Vector count 1 00:06:29.006 Module: software 00:06:29.006 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.006 Queue depth: 32 00:06:29.006 Allocate depth: 32 00:06:29.006 # threads/core: 1 00:06:29.006 Run time: 1 seconds 00:06:29.006 Verify: Yes 00:06:29.006 00:06:29.006 Running for 1 seconds... 00:06:29.006 00:06:29.006 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:29.006 ------------------------------------------------------------------------------------ 00:06:29.006 0,0 4640/s 191 MiB/s 0 0 00:06:29.006 3,0 4800/s 198 MiB/s 0 0 00:06:29.006 2,0 4768/s 196 MiB/s 0 0 00:06:29.006 1,0 4800/s 198 MiB/s 0 0 00:06:29.006 ==================================================================================== 00:06:29.006 Total 19008/s 2016 MiB/s 0 0' 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.006 14:10:43 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:29.006 14:10:43 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:06:29.006 14:10:43 -- accel/accel.sh@12 -- # build_accel_config 00:06:29.006 14:10:43 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:29.006 14:10:43 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:29.006 14:10:43 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:29.006 14:10:43 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:29.006 14:10:43 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:29.006 14:10:43 -- accel/accel.sh@41 -- # local IFS=, 00:06:29.006 14:10:43 -- accel/accel.sh@42 -- # jq -r . 00:06:29.006 [2024-12-16 14:10:43.303213] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.006 [2024-12-16 14:10:43.303286] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid215828 ] 00:06:29.006 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.006 [2024-12-16 14:10:43.360594] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:29.006 [2024-12-16 14:10:43.429610] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:29.006 [2024-12-16 14:10:43.429707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:29.006 [2024-12-16 14:10:43.429798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:29.006 [2024-12-16 14:10:43.429800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:29.006 14:10:43 -- accel/accel.sh@21 -- # val= 00:06:29.006 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.006 14:10:43 -- accel/accel.sh@21 -- # val= 00:06:29.006 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.006 14:10:43 -- accel/accel.sh@21 -- # val= 00:06:29.006 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.006 14:10:43 -- accel/accel.sh@21 -- # val=0xf 00:06:29.006 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.006 14:10:43 -- accel/accel.sh@21 -- # val= 00:06:29.006 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.006 14:10:43 -- accel/accel.sh@21 -- # val= 00:06:29.006 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.006 14:10:43 -- accel/accel.sh@21 -- # val=decompress 00:06:29.006 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.006 14:10:43 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.006 14:10:43 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:29.006 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.006 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val= 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val=software 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@23 -- # accel_module=software 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val=32 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val=32 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val=1 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val=Yes 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val= 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:29.007 14:10:43 -- accel/accel.sh@21 -- # val= 00:06:29.007 14:10:43 -- accel/accel.sh@22 -- # case "$var" in 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # IFS=: 00:06:29.007 14:10:43 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@21 -- # val= 00:06:30.385 14:10:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # IFS=: 00:06:30.385 14:10:44 -- accel/accel.sh@20 -- # read -r var val 00:06:30.385 14:10:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:30.385 14:10:44 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:30.385 14:10:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:30.385 00:06:30.385 real 0m2.751s 00:06:30.385 user 0m9.261s 00:06:30.385 sys 0m0.229s 00:06:30.385 14:10:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:30.385 14:10:44 -- common/autotest_common.sh@10 -- # set +x 00:06:30.385 ************************************ 00:06:30.385 END TEST accel_decomp_full_mcore 00:06:30.385 ************************************ 00:06:30.385 14:10:44 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.385 14:10:44 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:06:30.385 14:10:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:30.385 14:10:44 -- common/autotest_common.sh@10 -- # set +x 00:06:30.385 ************************************ 00:06:30.385 START TEST accel_decomp_mthread 00:06:30.385 ************************************ 00:06:30.385 14:10:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.385 14:10:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:30.385 14:10:44 -- accel/accel.sh@17 -- # local accel_module 00:06:30.385 14:10:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.385 14:10:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:30.385 14:10:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:30.385 14:10:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:30.385 14:10:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:30.385 14:10:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:30.385 14:10:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:30.385 14:10:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:30.385 14:10:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:30.385 14:10:44 -- accel/accel.sh@42 -- # jq -r . 00:06:30.385 [2024-12-16 14:10:44.721666] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.385 [2024-12-16 14:10:44.721749] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid216077 ] 00:06:30.385 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.385 [2024-12-16 14:10:44.777985] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.385 [2024-12-16 14:10:44.845837] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.762 14:10:46 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:31.762 00:06:31.762 SPDK Configuration: 00:06:31.762 Core mask: 0x1 00:06:31.762 00:06:31.762 Accel Perf Configuration: 00:06:31.762 Workload Type: decompress 00:06:31.762 Transfer size: 4096 bytes 00:06:31.762 Vector count 1 00:06:31.762 Module: software 00:06:31.762 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:31.762 Queue depth: 32 00:06:31.762 Allocate depth: 32 00:06:31.762 # threads/core: 2 00:06:31.762 Run time: 1 seconds 00:06:31.762 Verify: Yes 00:06:31.762 00:06:31.762 Running for 1 seconds... 00:06:31.762 00:06:31.762 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:31.762 ------------------------------------------------------------------------------------ 00:06:31.762 0,1 37504/s 69 MiB/s 0 0 00:06:31.762 0,0 37440/s 69 MiB/s 0 0 00:06:31.762 ==================================================================================== 00:06:31.762 Total 74944/s 292 MiB/s 0 0' 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:31.762 14:10:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:06:31.762 14:10:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:31.762 14:10:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:31.762 14:10:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:31.762 14:10:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:31.762 14:10:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:31.762 14:10:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:31.762 14:10:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:31.762 14:10:46 -- accel/accel.sh@42 -- # jq -r . 00:06:31.762 [2024-12-16 14:10:46.073748] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:31.762 [2024-12-16 14:10:46.073824] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid216303 ] 00:06:31.762 EAL: No free 2048 kB hugepages reported on node 1 00:06:31.762 [2024-12-16 14:10:46.131330] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:31.762 [2024-12-16 14:10:46.197640] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val= 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val= 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val= 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val=0x1 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val= 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val= 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val=decompress 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val= 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val=software 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@23 -- # accel_module=software 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val=32 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val=32 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val=2 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val=Yes 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val= 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:31.762 14:10:46 -- accel/accel.sh@21 -- # val= 00:06:31.762 14:10:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # IFS=: 00:06:31.762 14:10:46 -- accel/accel.sh@20 -- # read -r var val 00:06:33.140 14:10:47 -- accel/accel.sh@21 -- # val= 00:06:33.140 14:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # IFS=: 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # read -r var val 00:06:33.140 14:10:47 -- accel/accel.sh@21 -- # val= 00:06:33.140 14:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # IFS=: 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # read -r var val 00:06:33.140 14:10:47 -- accel/accel.sh@21 -- # val= 00:06:33.140 14:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # IFS=: 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # read -r var val 00:06:33.140 14:10:47 -- accel/accel.sh@21 -- # val= 00:06:33.140 14:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # IFS=: 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # read -r var val 00:06:33.140 14:10:47 -- accel/accel.sh@21 -- # val= 00:06:33.140 14:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # IFS=: 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # read -r var val 00:06:33.140 14:10:47 -- accel/accel.sh@21 -- # val= 00:06:33.140 14:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # IFS=: 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # read -r var val 00:06:33.140 14:10:47 -- accel/accel.sh@21 -- # val= 00:06:33.140 14:10:47 -- accel/accel.sh@22 -- # case "$var" in 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # IFS=: 00:06:33.140 14:10:47 -- accel/accel.sh@20 -- # read -r var val 00:06:33.140 14:10:47 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:33.140 14:10:47 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:33.140 14:10:47 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:33.140 00:06:33.140 real 0m2.711s 00:06:33.140 user 0m2.489s 00:06:33.140 sys 0m0.231s 00:06:33.140 14:10:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.140 14:10:47 -- common/autotest_common.sh@10 -- # set +x 00:06:33.140 ************************************ 00:06:33.140 END TEST accel_decomp_mthread 00:06:33.140 ************************************ 00:06:33.140 14:10:47 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.140 14:10:47 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:33.140 14:10:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.140 14:10:47 -- common/autotest_common.sh@10 -- # set +x 00:06:33.140 ************************************ 00:06:33.140 START TEST accel_deomp_full_mthread 00:06:33.140 ************************************ 00:06:33.140 14:10:47 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.140 14:10:47 -- accel/accel.sh@16 -- # local accel_opc 00:06:33.140 14:10:47 -- accel/accel.sh@17 -- # local accel_module 00:06:33.140 14:10:47 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.140 14:10:47 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:33.140 14:10:47 -- accel/accel.sh@12 -- # build_accel_config 00:06:33.140 14:10:47 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:33.140 14:10:47 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:33.140 14:10:47 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:33.140 14:10:47 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:33.140 14:10:47 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:33.140 14:10:47 -- accel/accel.sh@41 -- # local IFS=, 00:06:33.140 14:10:47 -- accel/accel.sh@42 -- # jq -r . 00:06:33.140 [2024-12-16 14:10:47.470989] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.140 [2024-12-16 14:10:47.471068] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid216552 ] 00:06:33.140 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.140 [2024-12-16 14:10:47.527066] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.140 [2024-12-16 14:10:47.594318] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.516 14:10:48 -- accel/accel.sh@18 -- # out='Preparing input file... 00:06:34.516 00:06:34.516 SPDK Configuration: 00:06:34.516 Core mask: 0x1 00:06:34.516 00:06:34.516 Accel Perf Configuration: 00:06:34.516 Workload Type: decompress 00:06:34.516 Transfer size: 111250 bytes 00:06:34.516 Vector count 1 00:06:34.516 Module: software 00:06:34.516 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:34.517 Queue depth: 32 00:06:34.517 Allocate depth: 32 00:06:34.517 # threads/core: 2 00:06:34.517 Run time: 1 seconds 00:06:34.517 Verify: Yes 00:06:34.517 00:06:34.517 Running for 1 seconds... 00:06:34.517 00:06:34.517 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:34.517 ------------------------------------------------------------------------------------ 00:06:34.517 0,1 2432/s 100 MiB/s 0 0 00:06:34.517 0,0 2400/s 99 MiB/s 0 0 00:06:34.517 ==================================================================================== 00:06:34.517 Total 4832/s 512 MiB/s 0 0' 00:06:34.517 14:10:48 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:48 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:34.517 14:10:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:06:34.517 14:10:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:34.517 14:10:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:34.517 14:10:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:34.517 14:10:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:34.517 14:10:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:34.517 14:10:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:34.517 14:10:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:34.517 14:10:48 -- accel/accel.sh@42 -- # jq -r . 00:06:34.517 [2024-12-16 14:10:48.842898] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.517 [2024-12-16 14:10:48.842972] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid216778 ] 00:06:34.517 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.517 [2024-12-16 14:10:48.901358] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.517 [2024-12-16 14:10:48.968791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val= 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val= 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val= 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val=0x1 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val= 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val= 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val=decompress 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@24 -- # accel_opc=decompress 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val='111250 bytes' 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val= 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val=software 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@23 -- # accel_module=software 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val=32 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val=32 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val=2 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val=Yes 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val= 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:34.517 14:10:49 -- accel/accel.sh@21 -- # val= 00:06:34.517 14:10:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # IFS=: 00:06:34.517 14:10:49 -- accel/accel.sh@20 -- # read -r var val 00:06:35.894 14:10:50 -- accel/accel.sh@21 -- # val= 00:06:35.894 14:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # IFS=: 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # read -r var val 00:06:35.894 14:10:50 -- accel/accel.sh@21 -- # val= 00:06:35.894 14:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # IFS=: 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # read -r var val 00:06:35.894 14:10:50 -- accel/accel.sh@21 -- # val= 00:06:35.894 14:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # IFS=: 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # read -r var val 00:06:35.894 14:10:50 -- accel/accel.sh@21 -- # val= 00:06:35.894 14:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # IFS=: 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # read -r var val 00:06:35.894 14:10:50 -- accel/accel.sh@21 -- # val= 00:06:35.894 14:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # IFS=: 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # read -r var val 00:06:35.894 14:10:50 -- accel/accel.sh@21 -- # val= 00:06:35.894 14:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # IFS=: 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # read -r var val 00:06:35.894 14:10:50 -- accel/accel.sh@21 -- # val= 00:06:35.894 14:10:50 -- accel/accel.sh@22 -- # case "$var" in 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # IFS=: 00:06:35.894 14:10:50 -- accel/accel.sh@20 -- # read -r var val 00:06:35.894 14:10:50 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:35.894 14:10:50 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:06:35.894 14:10:50 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:35.894 00:06:35.894 real 0m2.756s 00:06:35.894 user 0m2.531s 00:06:35.894 sys 0m0.233s 00:06:35.894 14:10:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:35.894 14:10:50 -- common/autotest_common.sh@10 -- # set +x 00:06:35.894 ************************************ 00:06:35.894 END TEST accel_deomp_full_mthread 00:06:35.894 ************************************ 00:06:35.894 14:10:50 -- accel/accel.sh@116 -- # [[ n == y ]] 00:06:35.894 14:10:50 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:35.894 14:10:50 -- accel/accel.sh@129 -- # build_accel_config 00:06:35.894 14:10:50 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:35.894 14:10:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:35.894 14:10:50 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:35.894 14:10:50 -- common/autotest_common.sh@10 -- # set +x 00:06:35.894 14:10:50 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:35.894 14:10:50 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:35.894 14:10:50 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:35.894 14:10:50 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:35.894 14:10:50 -- accel/accel.sh@41 -- # local IFS=, 00:06:35.894 14:10:50 -- accel/accel.sh@42 -- # jq -r . 00:06:35.894 ************************************ 00:06:35.894 START TEST accel_dif_functional_tests 00:06:35.894 ************************************ 00:06:35.894 14:10:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:06:35.894 [2024-12-16 14:10:50.278321] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:35.894 [2024-12-16 14:10:50.278367] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid217035 ] 00:06:35.894 EAL: No free 2048 kB hugepages reported on node 1 00:06:35.894 [2024-12-16 14:10:50.331465] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:35.894 [2024-12-16 14:10:50.402148] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:35.894 [2024-12-16 14:10:50.402242] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:35.894 [2024-12-16 14:10:50.402244] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:36.154 00:06:36.154 00:06:36.154 CUnit - A unit testing framework for C - Version 2.1-3 00:06:36.154 http://cunit.sourceforge.net/ 00:06:36.154 00:06:36.154 00:06:36.154 Suite: accel_dif 00:06:36.154 Test: verify: DIF generated, GUARD check ...passed 00:06:36.154 Test: verify: DIF generated, APPTAG check ...passed 00:06:36.154 Test: verify: DIF generated, REFTAG check ...passed 00:06:36.154 Test: verify: DIF not generated, GUARD check ...[2024-12-16 14:10:50.469139] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:36.154 [2024-12-16 14:10:50.469178] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:06:36.154 passed 00:06:36.154 Test: verify: DIF not generated, APPTAG check ...[2024-12-16 14:10:50.469207] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:36.154 [2024-12-16 14:10:50.469221] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:06:36.154 passed 00:06:36.154 Test: verify: DIF not generated, REFTAG check ...[2024-12-16 14:10:50.469239] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:36.154 [2024-12-16 14:10:50.469252] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:06:36.154 passed 00:06:36.154 Test: verify: APPTAG correct, APPTAG check ...passed 00:06:36.154 Test: verify: APPTAG incorrect, APPTAG check ...[2024-12-16 14:10:50.469292] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:06:36.154 passed 00:06:36.154 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:06:36.154 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:06:36.154 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:06:36.154 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-12-16 14:10:50.469388] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:06:36.154 passed 00:06:36.154 Test: generate copy: DIF generated, GUARD check ...passed 00:06:36.154 Test: generate copy: DIF generated, APTTAG check ...passed 00:06:36.154 Test: generate copy: DIF generated, REFTAG check ...passed 00:06:36.154 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:06:36.154 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:06:36.154 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:06:36.154 Test: generate copy: iovecs-len validate ...[2024-12-16 14:10:50.469547] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:06:36.154 passed 00:06:36.154 Test: generate copy: buffer alignment validate ...passed 00:06:36.154 00:06:36.154 Run Summary: Type Total Ran Passed Failed Inactive 00:06:36.154 suites 1 1 n/a 0 0 00:06:36.154 tests 20 20 20 0 0 00:06:36.154 asserts 204 204 204 0 n/a 00:06:36.154 00:06:36.154 Elapsed time = 0.000 seconds 00:06:36.154 00:06:36.154 real 0m0.423s 00:06:36.154 user 0m0.634s 00:06:36.154 sys 0m0.141s 00:06:36.154 14:10:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.154 14:10:50 -- common/autotest_common.sh@10 -- # set +x 00:06:36.154 ************************************ 00:06:36.154 END TEST accel_dif_functional_tests 00:06:36.154 ************************************ 00:06:36.154 00:06:36.154 real 0m57.733s 00:06:36.154 user 1m6.322s 00:06:36.154 sys 0m6.103s 00:06:36.154 14:10:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.154 14:10:50 -- common/autotest_common.sh@10 -- # set +x 00:06:36.154 ************************************ 00:06:36.154 END TEST accel 00:06:36.154 ************************************ 00:06:36.154 14:10:50 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:36.154 14:10:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.154 14:10:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.154 14:10:50 -- common/autotest_common.sh@10 -- # set +x 00:06:36.414 ************************************ 00:06:36.414 START TEST accel_rpc 00:06:36.414 ************************************ 00:06:36.414 14:10:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:06:36.414 * Looking for test storage... 00:06:36.414 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:36.414 14:10:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:36.414 14:10:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:36.414 14:10:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:36.414 14:10:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:36.414 14:10:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:36.414 14:10:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:36.414 14:10:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:36.414 14:10:50 -- scripts/common.sh@335 -- # IFS=.-: 00:06:36.414 14:10:50 -- scripts/common.sh@335 -- # read -ra ver1 00:06:36.414 14:10:50 -- scripts/common.sh@336 -- # IFS=.-: 00:06:36.414 14:10:50 -- scripts/common.sh@336 -- # read -ra ver2 00:06:36.414 14:10:50 -- scripts/common.sh@337 -- # local 'op=<' 00:06:36.414 14:10:50 -- scripts/common.sh@339 -- # ver1_l=2 00:06:36.414 14:10:50 -- scripts/common.sh@340 -- # ver2_l=1 00:06:36.414 14:10:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:36.414 14:10:50 -- scripts/common.sh@343 -- # case "$op" in 00:06:36.414 14:10:50 -- scripts/common.sh@344 -- # : 1 00:06:36.414 14:10:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:36.414 14:10:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:36.414 14:10:50 -- scripts/common.sh@364 -- # decimal 1 00:06:36.414 14:10:50 -- scripts/common.sh@352 -- # local d=1 00:06:36.414 14:10:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:36.414 14:10:50 -- scripts/common.sh@354 -- # echo 1 00:06:36.414 14:10:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:36.414 14:10:50 -- scripts/common.sh@365 -- # decimal 2 00:06:36.414 14:10:50 -- scripts/common.sh@352 -- # local d=2 00:06:36.414 14:10:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:36.414 14:10:50 -- scripts/common.sh@354 -- # echo 2 00:06:36.414 14:10:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:36.414 14:10:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:36.414 14:10:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:36.414 14:10:50 -- scripts/common.sh@367 -- # return 0 00:06:36.414 14:10:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:36.414 14:10:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:36.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.414 --rc genhtml_branch_coverage=1 00:06:36.414 --rc genhtml_function_coverage=1 00:06:36.414 --rc genhtml_legend=1 00:06:36.414 --rc geninfo_all_blocks=1 00:06:36.414 --rc geninfo_unexecuted_blocks=1 00:06:36.414 00:06:36.414 ' 00:06:36.414 14:10:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:36.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.414 --rc genhtml_branch_coverage=1 00:06:36.414 --rc genhtml_function_coverage=1 00:06:36.414 --rc genhtml_legend=1 00:06:36.414 --rc geninfo_all_blocks=1 00:06:36.414 --rc geninfo_unexecuted_blocks=1 00:06:36.414 00:06:36.414 ' 00:06:36.414 14:10:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:36.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.414 --rc genhtml_branch_coverage=1 00:06:36.414 --rc genhtml_function_coverage=1 00:06:36.414 --rc genhtml_legend=1 00:06:36.414 --rc geninfo_all_blocks=1 00:06:36.414 --rc geninfo_unexecuted_blocks=1 00:06:36.414 00:06:36.414 ' 00:06:36.414 14:10:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:36.414 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:36.414 --rc genhtml_branch_coverage=1 00:06:36.414 --rc genhtml_function_coverage=1 00:06:36.414 --rc genhtml_legend=1 00:06:36.414 --rc geninfo_all_blocks=1 00:06:36.414 --rc geninfo_unexecuted_blocks=1 00:06:36.414 00:06:36.414 ' 00:06:36.414 14:10:50 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:36.414 14:10:50 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=217311 00:06:36.414 14:10:50 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:06:36.414 14:10:50 -- accel/accel_rpc.sh@15 -- # waitforlisten 217311 00:06:36.414 14:10:50 -- common/autotest_common.sh@829 -- # '[' -z 217311 ']' 00:06:36.414 14:10:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.414 14:10:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.414 14:10:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.414 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.414 14:10:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.414 14:10:50 -- common/autotest_common.sh@10 -- # set +x 00:06:36.414 [2024-12-16 14:10:50.932278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:36.414 [2024-12-16 14:10:50.932328] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid217311 ] 00:06:36.414 EAL: No free 2048 kB hugepages reported on node 1 00:06:36.673 [2024-12-16 14:10:50.987532] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:36.673 [2024-12-16 14:10:51.055529] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:36.673 [2024-12-16 14:10:51.055648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:37.241 14:10:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:37.241 14:10:51 -- common/autotest_common.sh@862 -- # return 0 00:06:37.241 14:10:51 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:06:37.241 14:10:51 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:06:37.241 14:10:51 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:06:37.241 14:10:51 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:06:37.241 14:10:51 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:06:37.241 14:10:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:37.241 14:10:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:37.241 14:10:51 -- common/autotest_common.sh@10 -- # set +x 00:06:37.241 ************************************ 00:06:37.241 START TEST accel_assign_opcode 00:06:37.241 ************************************ 00:06:37.241 14:10:51 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:06:37.241 14:10:51 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:06:37.241 14:10:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.241 14:10:51 -- common/autotest_common.sh@10 -- # set +x 00:06:37.241 [2024-12-16 14:10:51.745647] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:06:37.241 14:10:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.241 14:10:51 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:06:37.241 14:10:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.241 14:10:51 -- common/autotest_common.sh@10 -- # set +x 00:06:37.241 [2024-12-16 14:10:51.753659] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:06:37.241 14:10:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.241 14:10:51 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:06:37.241 14:10:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.241 14:10:51 -- common/autotest_common.sh@10 -- # set +x 00:06:37.500 14:10:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.500 14:10:51 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:06:37.500 14:10:51 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:06:37.500 14:10:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:37.500 14:10:51 -- accel/accel_rpc.sh@42 -- # grep software 00:06:37.500 14:10:51 -- common/autotest_common.sh@10 -- # set +x 00:06:37.500 14:10:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:37.500 software 00:06:37.500 00:06:37.500 real 0m0.237s 00:06:37.500 user 0m0.039s 00:06:37.500 sys 0m0.011s 00:06:37.500 14:10:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:37.500 14:10:51 -- common/autotest_common.sh@10 -- # set +x 00:06:37.500 ************************************ 00:06:37.500 END TEST accel_assign_opcode 00:06:37.500 ************************************ 00:06:37.500 14:10:52 -- accel/accel_rpc.sh@55 -- # killprocess 217311 00:06:37.500 14:10:52 -- common/autotest_common.sh@936 -- # '[' -z 217311 ']' 00:06:37.500 14:10:52 -- common/autotest_common.sh@940 -- # kill -0 217311 00:06:37.500 14:10:52 -- common/autotest_common.sh@941 -- # uname 00:06:37.500 14:10:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:37.500 14:10:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 217311 00:06:37.500 14:10:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:37.500 14:10:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:37.500 14:10:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 217311' 00:06:37.500 killing process with pid 217311 00:06:37.500 14:10:52 -- common/autotest_common.sh@955 -- # kill 217311 00:06:37.500 14:10:52 -- common/autotest_common.sh@960 -- # wait 217311 00:06:38.068 00:06:38.068 real 0m1.666s 00:06:38.068 user 0m1.717s 00:06:38.068 sys 0m0.417s 00:06:38.068 14:10:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:38.068 14:10:52 -- common/autotest_common.sh@10 -- # set +x 00:06:38.068 ************************************ 00:06:38.068 END TEST accel_rpc 00:06:38.068 ************************************ 00:06:38.068 14:10:52 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:38.068 14:10:52 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:38.068 14:10:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:38.068 14:10:52 -- common/autotest_common.sh@10 -- # set +x 00:06:38.068 ************************************ 00:06:38.068 START TEST app_cmdline 00:06:38.068 ************************************ 00:06:38.068 14:10:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:06:38.068 * Looking for test storage... 00:06:38.068 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:38.068 14:10:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:38.068 14:10:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:38.068 14:10:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:38.068 14:10:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:38.068 14:10:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:38.068 14:10:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:38.068 14:10:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:38.068 14:10:52 -- scripts/common.sh@335 -- # IFS=.-: 00:06:38.068 14:10:52 -- scripts/common.sh@335 -- # read -ra ver1 00:06:38.068 14:10:52 -- scripts/common.sh@336 -- # IFS=.-: 00:06:38.068 14:10:52 -- scripts/common.sh@336 -- # read -ra ver2 00:06:38.068 14:10:52 -- scripts/common.sh@337 -- # local 'op=<' 00:06:38.068 14:10:52 -- scripts/common.sh@339 -- # ver1_l=2 00:06:38.068 14:10:52 -- scripts/common.sh@340 -- # ver2_l=1 00:06:38.068 14:10:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:38.068 14:10:52 -- scripts/common.sh@343 -- # case "$op" in 00:06:38.068 14:10:52 -- scripts/common.sh@344 -- # : 1 00:06:38.068 14:10:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:38.068 14:10:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:38.068 14:10:52 -- scripts/common.sh@364 -- # decimal 1 00:06:38.068 14:10:52 -- scripts/common.sh@352 -- # local d=1 00:06:38.068 14:10:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:38.068 14:10:52 -- scripts/common.sh@354 -- # echo 1 00:06:38.068 14:10:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:38.068 14:10:52 -- scripts/common.sh@365 -- # decimal 2 00:06:38.068 14:10:52 -- scripts/common.sh@352 -- # local d=2 00:06:38.068 14:10:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:38.068 14:10:52 -- scripts/common.sh@354 -- # echo 2 00:06:38.068 14:10:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:38.068 14:10:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:38.068 14:10:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:38.068 14:10:52 -- scripts/common.sh@367 -- # return 0 00:06:38.068 14:10:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:38.068 14:10:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:38.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.068 --rc genhtml_branch_coverage=1 00:06:38.068 --rc genhtml_function_coverage=1 00:06:38.068 --rc genhtml_legend=1 00:06:38.068 --rc geninfo_all_blocks=1 00:06:38.068 --rc geninfo_unexecuted_blocks=1 00:06:38.068 00:06:38.068 ' 00:06:38.068 14:10:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:38.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.068 --rc genhtml_branch_coverage=1 00:06:38.068 --rc genhtml_function_coverage=1 00:06:38.068 --rc genhtml_legend=1 00:06:38.068 --rc geninfo_all_blocks=1 00:06:38.068 --rc geninfo_unexecuted_blocks=1 00:06:38.068 00:06:38.068 ' 00:06:38.068 14:10:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:38.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.068 --rc genhtml_branch_coverage=1 00:06:38.068 --rc genhtml_function_coverage=1 00:06:38.068 --rc genhtml_legend=1 00:06:38.068 --rc geninfo_all_blocks=1 00:06:38.068 --rc geninfo_unexecuted_blocks=1 00:06:38.068 00:06:38.068 ' 00:06:38.068 14:10:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:38.068 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:38.068 --rc genhtml_branch_coverage=1 00:06:38.068 --rc genhtml_function_coverage=1 00:06:38.068 --rc genhtml_legend=1 00:06:38.068 --rc geninfo_all_blocks=1 00:06:38.068 --rc geninfo_unexecuted_blocks=1 00:06:38.068 00:06:38.068 ' 00:06:38.068 14:10:52 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:06:38.068 14:10:52 -- app/cmdline.sh@17 -- # spdk_tgt_pid=217621 00:06:38.068 14:10:52 -- app/cmdline.sh@18 -- # waitforlisten 217621 00:06:38.068 14:10:52 -- common/autotest_common.sh@829 -- # '[' -z 217621 ']' 00:06:38.068 14:10:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:38.068 14:10:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.068 14:10:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:38.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:38.068 14:10:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.068 14:10:52 -- common/autotest_common.sh@10 -- # set +x 00:06:38.068 14:10:52 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:06:38.068 [2024-12-16 14:10:52.631965] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:38.068 [2024-12-16 14:10:52.632016] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid217621 ] 00:06:38.327 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.327 [2024-12-16 14:10:52.686148] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:38.327 [2024-12-16 14:10:52.761641] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:38.327 [2024-12-16 14:10:52.761761] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.895 14:10:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.895 14:10:53 -- common/autotest_common.sh@862 -- # return 0 00:06:38.895 14:10:53 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:06:39.154 { 00:06:39.154 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:06:39.154 "fields": { 00:06:39.154 "major": 24, 00:06:39.154 "minor": 1, 00:06:39.154 "patch": 1, 00:06:39.154 "suffix": "-pre", 00:06:39.154 "commit": "c13c99a5e" 00:06:39.154 } 00:06:39.154 } 00:06:39.154 14:10:53 -- app/cmdline.sh@22 -- # expected_methods=() 00:06:39.154 14:10:53 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:06:39.154 14:10:53 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:06:39.154 14:10:53 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:06:39.154 14:10:53 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:06:39.154 14:10:53 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:06:39.154 14:10:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:39.154 14:10:53 -- app/cmdline.sh@26 -- # sort 00:06:39.154 14:10:53 -- common/autotest_common.sh@10 -- # set +x 00:06:39.154 14:10:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:39.154 14:10:53 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:06:39.154 14:10:53 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:06:39.154 14:10:53 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:39.154 14:10:53 -- common/autotest_common.sh@650 -- # local es=0 00:06:39.154 14:10:53 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:39.154 14:10:53 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:39.154 14:10:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:39.154 14:10:53 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:39.154 14:10:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:39.154 14:10:53 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:39.154 14:10:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:39.154 14:10:53 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:06:39.154 14:10:53 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:06:39.154 14:10:53 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:06:39.412 request: 00:06:39.412 { 00:06:39.413 "method": "env_dpdk_get_mem_stats", 00:06:39.413 "req_id": 1 00:06:39.413 } 00:06:39.413 Got JSON-RPC error response 00:06:39.413 response: 00:06:39.413 { 00:06:39.413 "code": -32601, 00:06:39.413 "message": "Method not found" 00:06:39.413 } 00:06:39.413 14:10:53 -- common/autotest_common.sh@653 -- # es=1 00:06:39.413 14:10:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:39.413 14:10:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:39.413 14:10:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:39.413 14:10:53 -- app/cmdline.sh@1 -- # killprocess 217621 00:06:39.413 14:10:53 -- common/autotest_common.sh@936 -- # '[' -z 217621 ']' 00:06:39.413 14:10:53 -- common/autotest_common.sh@940 -- # kill -0 217621 00:06:39.413 14:10:53 -- common/autotest_common.sh@941 -- # uname 00:06:39.413 14:10:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.413 14:10:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 217621 00:06:39.413 14:10:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.413 14:10:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.413 14:10:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 217621' 00:06:39.413 killing process with pid 217621 00:06:39.413 14:10:53 -- common/autotest_common.sh@955 -- # kill 217621 00:06:39.413 14:10:53 -- common/autotest_common.sh@960 -- # wait 217621 00:06:39.672 00:06:39.672 real 0m1.768s 00:06:39.672 user 0m2.088s 00:06:39.672 sys 0m0.443s 00:06:39.672 14:10:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.672 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:39.672 ************************************ 00:06:39.672 END TEST app_cmdline 00:06:39.672 ************************************ 00:06:39.672 14:10:54 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:39.672 14:10:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.672 14:10:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.672 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:39.672 ************************************ 00:06:39.672 START TEST version 00:06:39.672 ************************************ 00:06:39.672 14:10:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:06:39.931 * Looking for test storage... 00:06:39.931 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:39.931 14:10:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:39.931 14:10:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:39.931 14:10:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:39.931 14:10:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:39.931 14:10:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:39.931 14:10:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:39.931 14:10:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:39.931 14:10:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:39.931 14:10:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:39.931 14:10:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:39.931 14:10:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:39.931 14:10:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:39.931 14:10:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:39.931 14:10:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:39.931 14:10:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:39.931 14:10:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:39.931 14:10:54 -- scripts/common.sh@344 -- # : 1 00:06:39.931 14:10:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:39.931 14:10:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:39.931 14:10:54 -- scripts/common.sh@364 -- # decimal 1 00:06:39.931 14:10:54 -- scripts/common.sh@352 -- # local d=1 00:06:39.931 14:10:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:39.931 14:10:54 -- scripts/common.sh@354 -- # echo 1 00:06:39.931 14:10:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:39.931 14:10:54 -- scripts/common.sh@365 -- # decimal 2 00:06:39.931 14:10:54 -- scripts/common.sh@352 -- # local d=2 00:06:39.931 14:10:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:39.931 14:10:54 -- scripts/common.sh@354 -- # echo 2 00:06:39.931 14:10:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:39.931 14:10:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:39.931 14:10:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:39.931 14:10:54 -- scripts/common.sh@367 -- # return 0 00:06:39.931 14:10:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:39.931 14:10:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:39.931 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.931 --rc genhtml_branch_coverage=1 00:06:39.931 --rc genhtml_function_coverage=1 00:06:39.931 --rc genhtml_legend=1 00:06:39.931 --rc geninfo_all_blocks=1 00:06:39.931 --rc geninfo_unexecuted_blocks=1 00:06:39.931 00:06:39.931 ' 00:06:39.931 14:10:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:39.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.932 --rc genhtml_branch_coverage=1 00:06:39.932 --rc genhtml_function_coverage=1 00:06:39.932 --rc genhtml_legend=1 00:06:39.932 --rc geninfo_all_blocks=1 00:06:39.932 --rc geninfo_unexecuted_blocks=1 00:06:39.932 00:06:39.932 ' 00:06:39.932 14:10:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:39.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.932 --rc genhtml_branch_coverage=1 00:06:39.932 --rc genhtml_function_coverage=1 00:06:39.932 --rc genhtml_legend=1 00:06:39.932 --rc geninfo_all_blocks=1 00:06:39.932 --rc geninfo_unexecuted_blocks=1 00:06:39.932 00:06:39.932 ' 00:06:39.932 14:10:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:39.932 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:39.932 --rc genhtml_branch_coverage=1 00:06:39.932 --rc genhtml_function_coverage=1 00:06:39.932 --rc genhtml_legend=1 00:06:39.932 --rc geninfo_all_blocks=1 00:06:39.932 --rc geninfo_unexecuted_blocks=1 00:06:39.932 00:06:39.932 ' 00:06:39.932 14:10:54 -- app/version.sh@17 -- # get_header_version major 00:06:39.932 14:10:54 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.932 14:10:54 -- app/version.sh@14 -- # cut -f2 00:06:39.932 14:10:54 -- app/version.sh@14 -- # tr -d '"' 00:06:39.932 14:10:54 -- app/version.sh@17 -- # major=24 00:06:39.932 14:10:54 -- app/version.sh@18 -- # get_header_version minor 00:06:39.932 14:10:54 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.932 14:10:54 -- app/version.sh@14 -- # tr -d '"' 00:06:39.932 14:10:54 -- app/version.sh@14 -- # cut -f2 00:06:39.932 14:10:54 -- app/version.sh@18 -- # minor=1 00:06:39.932 14:10:54 -- app/version.sh@19 -- # get_header_version patch 00:06:39.932 14:10:54 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.932 14:10:54 -- app/version.sh@14 -- # cut -f2 00:06:39.932 14:10:54 -- app/version.sh@14 -- # tr -d '"' 00:06:39.932 14:10:54 -- app/version.sh@19 -- # patch=1 00:06:39.932 14:10:54 -- app/version.sh@20 -- # get_header_version suffix 00:06:39.932 14:10:54 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:06:39.932 14:10:54 -- app/version.sh@14 -- # cut -f2 00:06:39.932 14:10:54 -- app/version.sh@14 -- # tr -d '"' 00:06:39.932 14:10:54 -- app/version.sh@20 -- # suffix=-pre 00:06:39.932 14:10:54 -- app/version.sh@22 -- # version=24.1 00:06:39.932 14:10:54 -- app/version.sh@25 -- # (( patch != 0 )) 00:06:39.932 14:10:54 -- app/version.sh@25 -- # version=24.1.1 00:06:39.932 14:10:54 -- app/version.sh@28 -- # version=24.1.1rc0 00:06:39.932 14:10:54 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:39.932 14:10:54 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:06:39.932 14:10:54 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:06:39.932 14:10:54 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:06:39.932 00:06:39.932 real 0m0.235s 00:06:39.932 user 0m0.161s 00:06:39.932 sys 0m0.114s 00:06:39.932 14:10:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.932 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:39.932 ************************************ 00:06:39.932 END TEST version 00:06:39.932 ************************************ 00:06:40.191 14:10:54 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:06:40.191 14:10:54 -- spdk/autotest.sh@191 -- # uname -s 00:06:40.191 14:10:54 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:06:40.191 14:10:54 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:40.191 14:10:54 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:06:40.191 14:10:54 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:06:40.191 14:10:54 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:06:40.191 14:10:54 -- spdk/autotest.sh@255 -- # timing_exit lib 00:06:40.191 14:10:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:40.191 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:40.191 14:10:54 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:06:40.191 14:10:54 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:06:40.191 14:10:54 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:06:40.191 14:10:54 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:06:40.191 14:10:54 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:06:40.191 14:10:54 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:06:40.191 14:10:54 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:40.191 14:10:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:40.191 14:10:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.191 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:40.191 ************************************ 00:06:40.191 START TEST nvmf_tcp 00:06:40.191 ************************************ 00:06:40.191 14:10:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:06:40.191 * Looking for test storage... 00:06:40.191 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:06:40.191 14:10:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:40.191 14:10:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:40.191 14:10:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:40.191 14:10:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:40.191 14:10:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:40.191 14:10:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:40.191 14:10:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:40.191 14:10:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:40.191 14:10:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:40.191 14:10:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:40.191 14:10:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:40.191 14:10:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:40.191 14:10:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:40.191 14:10:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:40.191 14:10:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:40.191 14:10:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:40.192 14:10:54 -- scripts/common.sh@344 -- # : 1 00:06:40.192 14:10:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:40.192 14:10:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:40.192 14:10:54 -- scripts/common.sh@364 -- # decimal 1 00:06:40.192 14:10:54 -- scripts/common.sh@352 -- # local d=1 00:06:40.192 14:10:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:40.192 14:10:54 -- scripts/common.sh@354 -- # echo 1 00:06:40.192 14:10:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:40.192 14:10:54 -- scripts/common.sh@365 -- # decimal 2 00:06:40.192 14:10:54 -- scripts/common.sh@352 -- # local d=2 00:06:40.192 14:10:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:40.192 14:10:54 -- scripts/common.sh@354 -- # echo 2 00:06:40.192 14:10:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:40.192 14:10:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:40.192 14:10:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:40.192 14:10:54 -- scripts/common.sh@367 -- # return 0 00:06:40.192 14:10:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:40.192 14:10:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:40.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.192 --rc genhtml_branch_coverage=1 00:06:40.192 --rc genhtml_function_coverage=1 00:06:40.192 --rc genhtml_legend=1 00:06:40.192 --rc geninfo_all_blocks=1 00:06:40.192 --rc geninfo_unexecuted_blocks=1 00:06:40.192 00:06:40.192 ' 00:06:40.192 14:10:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:40.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.192 --rc genhtml_branch_coverage=1 00:06:40.192 --rc genhtml_function_coverage=1 00:06:40.192 --rc genhtml_legend=1 00:06:40.192 --rc geninfo_all_blocks=1 00:06:40.192 --rc geninfo_unexecuted_blocks=1 00:06:40.192 00:06:40.192 ' 00:06:40.192 14:10:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:40.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.192 --rc genhtml_branch_coverage=1 00:06:40.192 --rc genhtml_function_coverage=1 00:06:40.192 --rc genhtml_legend=1 00:06:40.192 --rc geninfo_all_blocks=1 00:06:40.192 --rc geninfo_unexecuted_blocks=1 00:06:40.192 00:06:40.192 ' 00:06:40.192 14:10:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:40.192 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.192 --rc genhtml_branch_coverage=1 00:06:40.192 --rc genhtml_function_coverage=1 00:06:40.192 --rc genhtml_legend=1 00:06:40.192 --rc geninfo_all_blocks=1 00:06:40.192 --rc geninfo_unexecuted_blocks=1 00:06:40.192 00:06:40.192 ' 00:06:40.192 14:10:54 -- nvmf/nvmf.sh@10 -- # uname -s 00:06:40.192 14:10:54 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:06:40.192 14:10:54 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:40.192 14:10:54 -- nvmf/common.sh@7 -- # uname -s 00:06:40.192 14:10:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:40.192 14:10:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:40.192 14:10:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:40.192 14:10:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:40.192 14:10:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:40.192 14:10:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:40.192 14:10:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:40.192 14:10:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:40.192 14:10:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:40.192 14:10:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:40.192 14:10:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:06:40.192 14:10:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:06:40.192 14:10:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:40.192 14:10:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:40.192 14:10:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:40.192 14:10:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:40.192 14:10:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:40.192 14:10:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:40.192 14:10:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:40.192 14:10:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.192 14:10:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.192 14:10:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.192 14:10:54 -- paths/export.sh@5 -- # export PATH 00:06:40.192 14:10:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.192 14:10:54 -- nvmf/common.sh@46 -- # : 0 00:06:40.192 14:10:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:40.192 14:10:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:40.192 14:10:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:40.192 14:10:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:40.192 14:10:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:40.192 14:10:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:40.192 14:10:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:40.192 14:10:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:40.192 14:10:54 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:06:40.192 14:10:54 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:06:40.192 14:10:54 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:06:40.192 14:10:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:40.192 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:40.192 14:10:54 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:06:40.192 14:10:54 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:40.192 14:10:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:40.192 14:10:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:40.192 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:40.192 ************************************ 00:06:40.192 START TEST nvmf_example 00:06:40.192 ************************************ 00:06:40.192 14:10:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:06:40.452 * Looking for test storage... 00:06:40.452 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:40.452 14:10:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:40.452 14:10:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:40.452 14:10:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:40.452 14:10:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:40.452 14:10:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:40.452 14:10:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:40.452 14:10:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:40.452 14:10:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:40.452 14:10:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:40.452 14:10:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:40.452 14:10:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:40.452 14:10:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:40.452 14:10:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:40.452 14:10:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:40.452 14:10:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:40.452 14:10:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:40.452 14:10:54 -- scripts/common.sh@344 -- # : 1 00:06:40.452 14:10:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:40.452 14:10:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:40.452 14:10:54 -- scripts/common.sh@364 -- # decimal 1 00:06:40.452 14:10:54 -- scripts/common.sh@352 -- # local d=1 00:06:40.452 14:10:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:40.452 14:10:54 -- scripts/common.sh@354 -- # echo 1 00:06:40.452 14:10:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:40.452 14:10:54 -- scripts/common.sh@365 -- # decimal 2 00:06:40.452 14:10:54 -- scripts/common.sh@352 -- # local d=2 00:06:40.452 14:10:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:40.452 14:10:54 -- scripts/common.sh@354 -- # echo 2 00:06:40.452 14:10:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:40.452 14:10:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:40.452 14:10:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:40.452 14:10:54 -- scripts/common.sh@367 -- # return 0 00:06:40.452 14:10:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:40.452 14:10:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:40.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.452 --rc genhtml_branch_coverage=1 00:06:40.452 --rc genhtml_function_coverage=1 00:06:40.452 --rc genhtml_legend=1 00:06:40.452 --rc geninfo_all_blocks=1 00:06:40.452 --rc geninfo_unexecuted_blocks=1 00:06:40.452 00:06:40.452 ' 00:06:40.452 14:10:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:40.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.452 --rc genhtml_branch_coverage=1 00:06:40.452 --rc genhtml_function_coverage=1 00:06:40.452 --rc genhtml_legend=1 00:06:40.452 --rc geninfo_all_blocks=1 00:06:40.452 --rc geninfo_unexecuted_blocks=1 00:06:40.452 00:06:40.452 ' 00:06:40.452 14:10:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:40.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.452 --rc genhtml_branch_coverage=1 00:06:40.452 --rc genhtml_function_coverage=1 00:06:40.452 --rc genhtml_legend=1 00:06:40.452 --rc geninfo_all_blocks=1 00:06:40.452 --rc geninfo_unexecuted_blocks=1 00:06:40.452 00:06:40.452 ' 00:06:40.452 14:10:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:40.452 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:40.452 --rc genhtml_branch_coverage=1 00:06:40.452 --rc genhtml_function_coverage=1 00:06:40.452 --rc genhtml_legend=1 00:06:40.452 --rc geninfo_all_blocks=1 00:06:40.453 --rc geninfo_unexecuted_blocks=1 00:06:40.453 00:06:40.453 ' 00:06:40.453 14:10:54 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:40.453 14:10:54 -- nvmf/common.sh@7 -- # uname -s 00:06:40.453 14:10:54 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:40.453 14:10:54 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:40.453 14:10:54 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:40.453 14:10:54 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:40.453 14:10:54 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:40.453 14:10:54 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:40.453 14:10:54 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:40.453 14:10:54 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:40.453 14:10:54 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:40.453 14:10:54 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:40.453 14:10:54 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:06:40.453 14:10:54 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:06:40.453 14:10:54 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:40.453 14:10:54 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:40.453 14:10:54 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:40.453 14:10:54 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:40.453 14:10:54 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:40.453 14:10:54 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:40.453 14:10:54 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:40.453 14:10:54 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.453 14:10:54 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.453 14:10:54 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.453 14:10:54 -- paths/export.sh@5 -- # export PATH 00:06:40.453 14:10:54 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:40.453 14:10:54 -- nvmf/common.sh@46 -- # : 0 00:06:40.453 14:10:54 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:40.453 14:10:54 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:40.453 14:10:54 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:40.453 14:10:54 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:40.453 14:10:54 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:40.453 14:10:54 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:40.453 14:10:54 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:40.453 14:10:54 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:40.453 14:10:54 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:06:40.453 14:10:54 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:06:40.453 14:10:54 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:06:40.453 14:10:54 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:06:40.453 14:10:54 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:06:40.453 14:10:54 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:06:40.453 14:10:54 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:06:40.453 14:10:54 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:06:40.453 14:10:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:40.453 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:40.453 14:10:54 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:06:40.453 14:10:54 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:40.453 14:10:54 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:40.453 14:10:54 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:40.453 14:10:54 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:40.453 14:10:54 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:40.453 14:10:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:40.453 14:10:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:40.453 14:10:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:40.453 14:10:54 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:40.453 14:10:54 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:40.453 14:10:54 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:40.453 14:10:54 -- common/autotest_common.sh@10 -- # set +x 00:06:45.729 14:11:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:06:45.729 14:11:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:06:45.729 14:11:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:06:45.729 14:11:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:06:45.729 14:11:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:06:45.729 14:11:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:06:45.729 14:11:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:06:45.729 14:11:00 -- nvmf/common.sh@294 -- # net_devs=() 00:06:45.729 14:11:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:06:45.729 14:11:00 -- nvmf/common.sh@295 -- # e810=() 00:06:45.729 14:11:00 -- nvmf/common.sh@295 -- # local -ga e810 00:06:45.729 14:11:00 -- nvmf/common.sh@296 -- # x722=() 00:06:45.729 14:11:00 -- nvmf/common.sh@296 -- # local -ga x722 00:06:45.729 14:11:00 -- nvmf/common.sh@297 -- # mlx=() 00:06:45.729 14:11:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:06:45.729 14:11:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:06:45.729 14:11:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:06:45.729 14:11:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:06:45.729 14:11:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:06:45.729 14:11:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.729 14:11:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:06:45.729 Found 0000:af:00.0 (0x8086 - 0x159b) 00:06:45.729 14:11:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:06:45.729 14:11:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:06:45.729 Found 0000:af:00.1 (0x8086 - 0x159b) 00:06:45.729 14:11:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:06:45.729 14:11:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.729 14:11:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.729 14:11:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.729 14:11:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.729 14:11:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:06:45.729 Found net devices under 0000:af:00.0: cvl_0_0 00:06:45.729 14:11:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.729 14:11:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:06:45.729 14:11:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:06:45.729 14:11:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:06:45.729 14:11:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:06:45.729 14:11:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:06:45.729 Found net devices under 0000:af:00.1: cvl_0_1 00:06:45.729 14:11:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:06:45.729 14:11:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:06:45.729 14:11:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:06:45.729 14:11:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:06:45.729 14:11:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:06:45.729 14:11:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:06:45.729 14:11:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:06:45.729 14:11:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:06:45.729 14:11:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:06:45.729 14:11:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:06:45.729 14:11:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:06:45.729 14:11:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:06:45.729 14:11:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:06:45.729 14:11:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:06:45.729 14:11:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:06:45.729 14:11:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:06:45.729 14:11:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:06:45.729 14:11:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:06:45.729 14:11:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:06:45.729 14:11:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:06:45.729 14:11:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:06:45.729 14:11:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:06:45.988 14:11:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:06:45.988 14:11:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:06:45.988 14:11:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:06:45.988 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:06:45.988 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.286 ms 00:06:45.988 00:06:45.988 --- 10.0.0.2 ping statistics --- 00:06:45.988 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:45.988 rtt min/avg/max/mdev = 0.286/0.286/0.286/0.000 ms 00:06:45.988 14:11:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:06:45.988 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:06:45.988 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.164 ms 00:06:45.988 00:06:45.988 --- 10.0.0.1 ping statistics --- 00:06:45.988 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:06:45.988 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:06:45.988 14:11:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:06:45.988 14:11:00 -- nvmf/common.sh@410 -- # return 0 00:06:45.988 14:11:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:06:45.988 14:11:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:06:45.988 14:11:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:06:45.988 14:11:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:06:45.988 14:11:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:06:45.988 14:11:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:06:45.988 14:11:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:06:45.988 14:11:00 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:06:45.988 14:11:00 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:06:45.988 14:11:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:06:45.988 14:11:00 -- common/autotest_common.sh@10 -- # set +x 00:06:45.988 14:11:00 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:06:45.988 14:11:00 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:06:45.988 14:11:00 -- target/nvmf_example.sh@34 -- # nvmfpid=221226 00:06:45.988 14:11:00 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:06:45.988 14:11:00 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:06:45.988 14:11:00 -- target/nvmf_example.sh@36 -- # waitforlisten 221226 00:06:45.988 14:11:00 -- common/autotest_common.sh@829 -- # '[' -z 221226 ']' 00:06:45.988 14:11:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:45.988 14:11:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:45.988 14:11:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:45.988 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:45.988 14:11:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:45.988 14:11:00 -- common/autotest_common.sh@10 -- # set +x 00:06:45.988 EAL: No free 2048 kB hugepages reported on node 1 00:06:46.925 14:11:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:46.925 14:11:01 -- common/autotest_common.sh@862 -- # return 0 00:06:46.925 14:11:01 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:06:46.925 14:11:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:46.925 14:11:01 -- common/autotest_common.sh@10 -- # set +x 00:06:46.925 14:11:01 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:06:46.925 14:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.925 14:11:01 -- common/autotest_common.sh@10 -- # set +x 00:06:46.925 14:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.925 14:11:01 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:06:46.925 14:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.925 14:11:01 -- common/autotest_common.sh@10 -- # set +x 00:06:46.925 14:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.925 14:11:01 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:06:46.925 14:11:01 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:06:46.925 14:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.925 14:11:01 -- common/autotest_common.sh@10 -- # set +x 00:06:46.925 14:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.925 14:11:01 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:06:46.925 14:11:01 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:06:46.925 14:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.925 14:11:01 -- common/autotest_common.sh@10 -- # set +x 00:06:46.925 14:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.925 14:11:01 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:06:46.925 14:11:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:46.925 14:11:01 -- common/autotest_common.sh@10 -- # set +x 00:06:46.925 14:11:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:46.925 14:11:01 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:06:46.925 14:11:01 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:06:46.925 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.137 Initializing NVMe Controllers 00:06:59.137 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:06:59.137 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:06:59.137 Initialization complete. Launching workers. 00:06:59.137 ======================================================== 00:06:59.137 Latency(us) 00:06:59.137 Device Information : IOPS MiB/s Average min max 00:06:59.137 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 19331.95 75.52 3310.41 674.86 15444.15 00:06:59.137 ======================================================== 00:06:59.137 Total : 19331.95 75.52 3310.41 674.86 15444.15 00:06:59.137 00:06:59.137 14:11:11 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:06:59.137 14:11:11 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:06:59.138 14:11:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:06:59.138 14:11:11 -- nvmf/common.sh@116 -- # sync 00:06:59.138 14:11:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:06:59.138 14:11:11 -- nvmf/common.sh@119 -- # set +e 00:06:59.138 14:11:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:06:59.138 14:11:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:06:59.138 rmmod nvme_tcp 00:06:59.138 rmmod nvme_fabrics 00:06:59.138 rmmod nvme_keyring 00:06:59.138 14:11:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:06:59.138 14:11:11 -- nvmf/common.sh@123 -- # set -e 00:06:59.138 14:11:11 -- nvmf/common.sh@124 -- # return 0 00:06:59.138 14:11:11 -- nvmf/common.sh@477 -- # '[' -n 221226 ']' 00:06:59.138 14:11:11 -- nvmf/common.sh@478 -- # killprocess 221226 00:06:59.138 14:11:11 -- common/autotest_common.sh@936 -- # '[' -z 221226 ']' 00:06:59.138 14:11:11 -- common/autotest_common.sh@940 -- # kill -0 221226 00:06:59.138 14:11:11 -- common/autotest_common.sh@941 -- # uname 00:06:59.138 14:11:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:59.138 14:11:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 221226 00:06:59.138 14:11:11 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:06:59.138 14:11:11 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:06:59.138 14:11:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 221226' 00:06:59.138 killing process with pid 221226 00:06:59.138 14:11:11 -- common/autotest_common.sh@955 -- # kill 221226 00:06:59.138 14:11:11 -- common/autotest_common.sh@960 -- # wait 221226 00:06:59.138 nvmf threads initialize successfully 00:06:59.138 bdev subsystem init successfully 00:06:59.138 created a nvmf target service 00:06:59.138 create targets's poll groups done 00:06:59.138 all subsystems of target started 00:06:59.138 nvmf target is running 00:06:59.138 all subsystems of target stopped 00:06:59.138 destroy targets's poll groups done 00:06:59.138 destroyed the nvmf target service 00:06:59.138 bdev subsystem finish successfully 00:06:59.138 nvmf threads destroy successfully 00:06:59.138 14:11:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:06:59.138 14:11:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:06:59.138 14:11:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:06:59.138 14:11:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:06:59.138 14:11:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:06:59.138 14:11:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:59.138 14:11:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:59.138 14:11:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:59.397 14:11:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:06:59.397 14:11:13 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:06:59.397 14:11:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:06:59.397 14:11:13 -- common/autotest_common.sh@10 -- # set +x 00:06:59.657 00:06:59.657 real 0m19.230s 00:06:59.657 user 0m45.841s 00:06:59.657 sys 0m5.601s 00:06:59.657 14:11:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.657 14:11:13 -- common/autotest_common.sh@10 -- # set +x 00:06:59.657 ************************************ 00:06:59.657 END TEST nvmf_example 00:06:59.657 ************************************ 00:06:59.657 14:11:14 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:59.657 14:11:14 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:59.657 14:11:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.657 14:11:14 -- common/autotest_common.sh@10 -- # set +x 00:06:59.657 ************************************ 00:06:59.657 START TEST nvmf_filesystem 00:06:59.657 ************************************ 00:06:59.657 14:11:14 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:06:59.657 * Looking for test storage... 00:06:59.657 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.657 14:11:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:59.657 14:11:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:59.657 14:11:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:59.657 14:11:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:59.657 14:11:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:59.657 14:11:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:59.657 14:11:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:59.657 14:11:14 -- scripts/common.sh@335 -- # IFS=.-: 00:06:59.657 14:11:14 -- scripts/common.sh@335 -- # read -ra ver1 00:06:59.657 14:11:14 -- scripts/common.sh@336 -- # IFS=.-: 00:06:59.657 14:11:14 -- scripts/common.sh@336 -- # read -ra ver2 00:06:59.657 14:11:14 -- scripts/common.sh@337 -- # local 'op=<' 00:06:59.657 14:11:14 -- scripts/common.sh@339 -- # ver1_l=2 00:06:59.657 14:11:14 -- scripts/common.sh@340 -- # ver2_l=1 00:06:59.657 14:11:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:59.657 14:11:14 -- scripts/common.sh@343 -- # case "$op" in 00:06:59.657 14:11:14 -- scripts/common.sh@344 -- # : 1 00:06:59.657 14:11:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:59.657 14:11:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:59.657 14:11:14 -- scripts/common.sh@364 -- # decimal 1 00:06:59.657 14:11:14 -- scripts/common.sh@352 -- # local d=1 00:06:59.657 14:11:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:59.658 14:11:14 -- scripts/common.sh@354 -- # echo 1 00:06:59.658 14:11:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:59.658 14:11:14 -- scripts/common.sh@365 -- # decimal 2 00:06:59.658 14:11:14 -- scripts/common.sh@352 -- # local d=2 00:06:59.658 14:11:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:59.658 14:11:14 -- scripts/common.sh@354 -- # echo 2 00:06:59.658 14:11:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:59.658 14:11:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:59.658 14:11:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:59.658 14:11:14 -- scripts/common.sh@367 -- # return 0 00:06:59.658 14:11:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:59.658 14:11:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:59.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.658 --rc genhtml_branch_coverage=1 00:06:59.658 --rc genhtml_function_coverage=1 00:06:59.658 --rc genhtml_legend=1 00:06:59.658 --rc geninfo_all_blocks=1 00:06:59.658 --rc geninfo_unexecuted_blocks=1 00:06:59.658 00:06:59.658 ' 00:06:59.658 14:11:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:59.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.658 --rc genhtml_branch_coverage=1 00:06:59.658 --rc genhtml_function_coverage=1 00:06:59.658 --rc genhtml_legend=1 00:06:59.658 --rc geninfo_all_blocks=1 00:06:59.658 --rc geninfo_unexecuted_blocks=1 00:06:59.658 00:06:59.658 ' 00:06:59.658 14:11:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:59.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.658 --rc genhtml_branch_coverage=1 00:06:59.658 --rc genhtml_function_coverage=1 00:06:59.658 --rc genhtml_legend=1 00:06:59.658 --rc geninfo_all_blocks=1 00:06:59.658 --rc geninfo_unexecuted_blocks=1 00:06:59.658 00:06:59.658 ' 00:06:59.658 14:11:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:59.658 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.658 --rc genhtml_branch_coverage=1 00:06:59.658 --rc genhtml_function_coverage=1 00:06:59.658 --rc genhtml_legend=1 00:06:59.658 --rc geninfo_all_blocks=1 00:06:59.658 --rc geninfo_unexecuted_blocks=1 00:06:59.658 00:06:59.658 ' 00:06:59.658 14:11:14 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:06:59.658 14:11:14 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:06:59.658 14:11:14 -- common/autotest_common.sh@34 -- # set -e 00:06:59.658 14:11:14 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:06:59.658 14:11:14 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:06:59.658 14:11:14 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:06:59.658 14:11:14 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:06:59.658 14:11:14 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:06:59.658 14:11:14 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:06:59.658 14:11:14 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:06:59.658 14:11:14 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:06:59.658 14:11:14 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:06:59.658 14:11:14 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:06:59.658 14:11:14 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:06:59.658 14:11:14 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:06:59.658 14:11:14 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:06:59.658 14:11:14 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:06:59.658 14:11:14 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:06:59.658 14:11:14 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:06:59.658 14:11:14 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:06:59.658 14:11:14 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:06:59.658 14:11:14 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:06:59.658 14:11:14 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:06:59.658 14:11:14 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:06:59.658 14:11:14 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:06:59.658 14:11:14 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:59.658 14:11:14 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:06:59.658 14:11:14 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:06:59.658 14:11:14 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:06:59.658 14:11:14 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:06:59.658 14:11:14 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:06:59.658 14:11:14 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:06:59.658 14:11:14 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:06:59.658 14:11:14 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:06:59.658 14:11:14 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:06:59.658 14:11:14 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:06:59.658 14:11:14 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:06:59.658 14:11:14 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:06:59.658 14:11:14 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:06:59.658 14:11:14 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:06:59.658 14:11:14 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:06:59.658 14:11:14 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:06:59.658 14:11:14 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:59.658 14:11:14 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:06:59.658 14:11:14 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:06:59.658 14:11:14 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:06:59.658 14:11:14 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:06:59.658 14:11:14 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR= 00:06:59.658 14:11:14 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:06:59.658 14:11:14 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:06:59.658 14:11:14 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:06:59.658 14:11:14 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:06:59.658 14:11:14 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:06:59.658 14:11:14 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:06:59.658 14:11:14 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:06:59.658 14:11:14 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:06:59.658 14:11:14 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:06:59.658 14:11:14 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=n 00:06:59.658 14:11:14 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:06:59.658 14:11:14 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:06:59.658 14:11:14 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:06:59.658 14:11:14 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:06:59.658 14:11:14 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:06:59.658 14:11:14 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:06:59.658 14:11:14 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:06:59.658 14:11:14 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:06:59.658 14:11:14 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:06:59.658 14:11:14 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR= 00:06:59.658 14:11:14 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:06:59.658 14:11:14 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:06:59.658 14:11:14 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:06:59.658 14:11:14 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:06:59.658 14:11:14 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:06:59.658 14:11:14 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:06:59.658 14:11:14 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:06:59.658 14:11:14 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:06:59.658 14:11:14 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:06:59.658 14:11:14 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:06:59.658 14:11:14 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:06:59.658 14:11:14 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:06:59.658 14:11:14 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:06:59.658 14:11:14 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:06:59.658 14:11:14 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:06:59.658 14:11:14 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:06:59.658 14:11:14 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:06:59.658 14:11:14 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:06:59.658 14:11:14 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:59.658 14:11:14 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:06:59.658 14:11:14 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:59.658 14:11:14 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:06:59.658 14:11:14 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:59.658 14:11:14 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:59.658 14:11:14 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:06:59.658 14:11:14 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:59.658 14:11:14 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:06:59.658 14:11:14 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:06:59.658 14:11:14 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:06:59.658 14:11:14 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:06:59.658 14:11:14 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:06:59.658 14:11:14 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:06:59.658 14:11:14 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:06:59.658 14:11:14 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:06:59.658 #define SPDK_CONFIG_H 00:06:59.658 #define SPDK_CONFIG_APPS 1 00:06:59.658 #define SPDK_CONFIG_ARCH native 00:06:59.658 #undef SPDK_CONFIG_ASAN 00:06:59.658 #undef SPDK_CONFIG_AVAHI 00:06:59.658 #undef SPDK_CONFIG_CET 00:06:59.658 #define SPDK_CONFIG_COVERAGE 1 00:06:59.658 #define SPDK_CONFIG_CROSS_PREFIX 00:06:59.658 #undef SPDK_CONFIG_CRYPTO 00:06:59.658 #undef SPDK_CONFIG_CRYPTO_MLX5 00:06:59.658 #undef SPDK_CONFIG_CUSTOMOCF 00:06:59.658 #undef SPDK_CONFIG_DAOS 00:06:59.658 #define SPDK_CONFIG_DAOS_DIR 00:06:59.658 #define SPDK_CONFIG_DEBUG 1 00:06:59.658 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:06:59.658 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build 00:06:59.658 #define SPDK_CONFIG_DPDK_INC_DIR 00:06:59.658 #define SPDK_CONFIG_DPDK_LIB_DIR 00:06:59.658 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:06:59.658 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:06:59.659 #define SPDK_CONFIG_EXAMPLES 1 00:06:59.659 #undef SPDK_CONFIG_FC 00:06:59.659 #define SPDK_CONFIG_FC_PATH 00:06:59.659 #define SPDK_CONFIG_FIO_PLUGIN 1 00:06:59.659 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:06:59.659 #undef SPDK_CONFIG_FUSE 00:06:59.659 #undef SPDK_CONFIG_FUZZER 00:06:59.659 #define SPDK_CONFIG_FUZZER_LIB 00:06:59.659 #undef SPDK_CONFIG_GOLANG 00:06:59.659 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:06:59.659 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:06:59.659 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:06:59.659 #undef SPDK_CONFIG_HAVE_LIBBSD 00:06:59.659 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:06:59.659 #define SPDK_CONFIG_IDXD 1 00:06:59.659 #define SPDK_CONFIG_IDXD_KERNEL 1 00:06:59.659 #undef SPDK_CONFIG_IPSEC_MB 00:06:59.659 #define SPDK_CONFIG_IPSEC_MB_DIR 00:06:59.659 #define SPDK_CONFIG_ISAL 1 00:06:59.659 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:06:59.659 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:06:59.659 #define SPDK_CONFIG_LIBDIR 00:06:59.659 #undef SPDK_CONFIG_LTO 00:06:59.659 #define SPDK_CONFIG_MAX_LCORES 00:06:59.659 #define SPDK_CONFIG_NVME_CUSE 1 00:06:59.659 #undef SPDK_CONFIG_OCF 00:06:59.659 #define SPDK_CONFIG_OCF_PATH 00:06:59.659 #define SPDK_CONFIG_OPENSSL_PATH 00:06:59.659 #undef SPDK_CONFIG_PGO_CAPTURE 00:06:59.659 #undef SPDK_CONFIG_PGO_USE 00:06:59.659 #define SPDK_CONFIG_PREFIX /usr/local 00:06:59.659 #undef SPDK_CONFIG_RAID5F 00:06:59.659 #undef SPDK_CONFIG_RBD 00:06:59.659 #define SPDK_CONFIG_RDMA 1 00:06:59.659 #define SPDK_CONFIG_RDMA_PROV verbs 00:06:59.659 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:06:59.659 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:06:59.659 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:06:59.659 #define SPDK_CONFIG_SHARED 1 00:06:59.659 #undef SPDK_CONFIG_SMA 00:06:59.659 #define SPDK_CONFIG_TESTS 1 00:06:59.659 #undef SPDK_CONFIG_TSAN 00:06:59.659 #define SPDK_CONFIG_UBLK 1 00:06:59.659 #define SPDK_CONFIG_UBSAN 1 00:06:59.659 #undef SPDK_CONFIG_UNIT_TESTS 00:06:59.659 #undef SPDK_CONFIG_URING 00:06:59.659 #define SPDK_CONFIG_URING_PATH 00:06:59.659 #undef SPDK_CONFIG_URING_ZNS 00:06:59.659 #undef SPDK_CONFIG_USDT 00:06:59.659 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:06:59.659 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:06:59.659 #undef SPDK_CONFIG_VFIO_USER 00:06:59.659 #define SPDK_CONFIG_VFIO_USER_DIR 00:06:59.659 #define SPDK_CONFIG_VHOST 1 00:06:59.659 #define SPDK_CONFIG_VIRTIO 1 00:06:59.659 #undef SPDK_CONFIG_VTUNE 00:06:59.659 #define SPDK_CONFIG_VTUNE_DIR 00:06:59.659 #define SPDK_CONFIG_WERROR 1 00:06:59.659 #define SPDK_CONFIG_WPDK_DIR 00:06:59.659 #undef SPDK_CONFIG_XNVME 00:06:59.659 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:06:59.659 14:11:14 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:06:59.659 14:11:14 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:59.659 14:11:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:59.659 14:11:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:59.659 14:11:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:59.659 14:11:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.659 14:11:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.659 14:11:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.659 14:11:14 -- paths/export.sh@5 -- # export PATH 00:06:59.659 14:11:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.659 14:11:14 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:59.659 14:11:14 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:06:59.659 14:11:14 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:59.659 14:11:14 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:06:59.659 14:11:14 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:06:59.659 14:11:14 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:06:59.659 14:11:14 -- pm/common@16 -- # TEST_TAG=N/A 00:06:59.659 14:11:14 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:06:59.659 14:11:14 -- common/autotest_common.sh@52 -- # : 1 00:06:59.659 14:11:14 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:06:59.659 14:11:14 -- common/autotest_common.sh@56 -- # : 0 00:06:59.659 14:11:14 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:06:59.920 14:11:14 -- common/autotest_common.sh@58 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:06:59.920 14:11:14 -- common/autotest_common.sh@60 -- # : 1 00:06:59.920 14:11:14 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:06:59.920 14:11:14 -- common/autotest_common.sh@62 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:06:59.920 14:11:14 -- common/autotest_common.sh@64 -- # : 00:06:59.920 14:11:14 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:06:59.920 14:11:14 -- common/autotest_common.sh@66 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:06:59.920 14:11:14 -- common/autotest_common.sh@68 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:06:59.920 14:11:14 -- common/autotest_common.sh@70 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:06:59.920 14:11:14 -- common/autotest_common.sh@72 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:06:59.920 14:11:14 -- common/autotest_common.sh@74 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:06:59.920 14:11:14 -- common/autotest_common.sh@76 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:06:59.920 14:11:14 -- common/autotest_common.sh@78 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:06:59.920 14:11:14 -- common/autotest_common.sh@80 -- # : 1 00:06:59.920 14:11:14 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:06:59.920 14:11:14 -- common/autotest_common.sh@82 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:06:59.920 14:11:14 -- common/autotest_common.sh@84 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:06:59.920 14:11:14 -- common/autotest_common.sh@86 -- # : 1 00:06:59.920 14:11:14 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:06:59.920 14:11:14 -- common/autotest_common.sh@88 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:06:59.920 14:11:14 -- common/autotest_common.sh@90 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:06:59.920 14:11:14 -- common/autotest_common.sh@92 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:06:59.920 14:11:14 -- common/autotest_common.sh@94 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:06:59.920 14:11:14 -- common/autotest_common.sh@96 -- # : tcp 00:06:59.920 14:11:14 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:06:59.920 14:11:14 -- common/autotest_common.sh@98 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:06:59.920 14:11:14 -- common/autotest_common.sh@100 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:06:59.920 14:11:14 -- common/autotest_common.sh@102 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:06:59.920 14:11:14 -- common/autotest_common.sh@104 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:06:59.920 14:11:14 -- common/autotest_common.sh@106 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:06:59.920 14:11:14 -- common/autotest_common.sh@108 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:06:59.920 14:11:14 -- common/autotest_common.sh@110 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:06:59.920 14:11:14 -- common/autotest_common.sh@112 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:06:59.920 14:11:14 -- common/autotest_common.sh@114 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:06:59.920 14:11:14 -- common/autotest_common.sh@116 -- # : 1 00:06:59.920 14:11:14 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:06:59.920 14:11:14 -- common/autotest_common.sh@118 -- # : 00:06:59.920 14:11:14 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:06:59.920 14:11:14 -- common/autotest_common.sh@120 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:06:59.920 14:11:14 -- common/autotest_common.sh@122 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:06:59.920 14:11:14 -- common/autotest_common.sh@124 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:06:59.920 14:11:14 -- common/autotest_common.sh@126 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:06:59.920 14:11:14 -- common/autotest_common.sh@128 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:06:59.920 14:11:14 -- common/autotest_common.sh@130 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:06:59.920 14:11:14 -- common/autotest_common.sh@132 -- # : 00:06:59.920 14:11:14 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:06:59.920 14:11:14 -- common/autotest_common.sh@134 -- # : true 00:06:59.920 14:11:14 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:06:59.920 14:11:14 -- common/autotest_common.sh@136 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:06:59.920 14:11:14 -- common/autotest_common.sh@138 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:06:59.920 14:11:14 -- common/autotest_common.sh@140 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:06:59.920 14:11:14 -- common/autotest_common.sh@142 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:06:59.920 14:11:14 -- common/autotest_common.sh@144 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:06:59.920 14:11:14 -- common/autotest_common.sh@146 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:06:59.920 14:11:14 -- common/autotest_common.sh@148 -- # : e810 00:06:59.920 14:11:14 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:06:59.920 14:11:14 -- common/autotest_common.sh@150 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:06:59.920 14:11:14 -- common/autotest_common.sh@152 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:06:59.920 14:11:14 -- common/autotest_common.sh@154 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:06:59.920 14:11:14 -- common/autotest_common.sh@156 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:06:59.920 14:11:14 -- common/autotest_common.sh@158 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:06:59.920 14:11:14 -- common/autotest_common.sh@160 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:06:59.920 14:11:14 -- common/autotest_common.sh@163 -- # : 00:06:59.920 14:11:14 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:06:59.920 14:11:14 -- common/autotest_common.sh@165 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:06:59.920 14:11:14 -- common/autotest_common.sh@167 -- # : 0 00:06:59.920 14:11:14 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:06:59.920 14:11:14 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:59.920 14:11:14 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:06:59.921 14:11:14 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:59.921 14:11:14 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib 00:06:59.921 14:11:14 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:59.921 14:11:14 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:59.921 14:11:14 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:59.921 14:11:14 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:06:59.921 14:11:14 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:06:59.921 14:11:14 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:06:59.921 14:11:14 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:59.921 14:11:14 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:06:59.921 14:11:14 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:06:59.921 14:11:14 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:06:59.921 14:11:14 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:59.921 14:11:14 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:06:59.921 14:11:14 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:59.921 14:11:14 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:06:59.921 14:11:14 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:06:59.921 14:11:14 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:06:59.921 14:11:14 -- common/autotest_common.sh@196 -- # cat 00:06:59.921 14:11:14 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:06:59.921 14:11:14 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:59.921 14:11:14 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:06:59.921 14:11:14 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:59.921 14:11:14 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:06:59.921 14:11:14 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:06:59.921 14:11:14 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:06:59.921 14:11:14 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:59.921 14:11:14 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:06:59.921 14:11:14 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:59.921 14:11:14 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:06:59.921 14:11:14 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:59.921 14:11:14 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:06:59.921 14:11:14 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:59.921 14:11:14 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:06:59.921 14:11:14 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:59.921 14:11:14 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:06:59.921 14:11:14 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:59.921 14:11:14 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:06:59.921 14:11:14 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:06:59.921 14:11:14 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:06:59.921 14:11:14 -- common/autotest_common.sh@249 -- # _LCOV= 00:06:59.921 14:11:14 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:06:59.921 14:11:14 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:06:59.921 14:11:14 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:06:59.921 14:11:14 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:06:59.921 14:11:14 -- common/autotest_common.sh@255 -- # lcov_opt= 00:06:59.921 14:11:14 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:06:59.921 14:11:14 -- common/autotest_common.sh@259 -- # export valgrind= 00:06:59.921 14:11:14 -- common/autotest_common.sh@259 -- # valgrind= 00:06:59.921 14:11:14 -- common/autotest_common.sh@265 -- # uname -s 00:06:59.921 14:11:14 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:06:59.921 14:11:14 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:06:59.921 14:11:14 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:06:59.921 14:11:14 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:06:59.921 14:11:14 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:59.921 14:11:14 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:06:59.921 14:11:14 -- common/autotest_common.sh@275 -- # MAKE=make 00:06:59.921 14:11:14 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j96 00:06:59.921 14:11:14 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:06:59.921 14:11:14 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:06:59.921 14:11:14 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:06:59.921 14:11:14 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:06:59.921 14:11:14 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:06:59.921 14:11:14 -- common/autotest_common.sh@301 -- # for i in "$@" 00:06:59.921 14:11:14 -- common/autotest_common.sh@302 -- # case "$i" in 00:06:59.921 14:11:14 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:06:59.921 14:11:14 -- common/autotest_common.sh@319 -- # [[ -z 223612 ]] 00:06:59.921 14:11:14 -- common/autotest_common.sh@319 -- # kill -0 223612 00:06:59.921 14:11:14 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:06:59.921 14:11:14 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:06:59.921 14:11:14 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:06:59.921 14:11:14 -- common/autotest_common.sh@332 -- # local mount target_dir 00:06:59.921 14:11:14 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:06:59.921 14:11:14 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:06:59.921 14:11:14 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:06:59.921 14:11:14 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:06:59.921 14:11:14 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.BhgY7L 00:06:59.921 14:11:14 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:06:59.921 14:11:14 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:06:59.921 14:11:14 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:06:59.921 14:11:14 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.BhgY7L/tests/target /tmp/spdk.BhgY7L 00:06:59.921 14:11:14 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:06:59.921 14:11:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.921 14:11:14 -- common/autotest_common.sh@328 -- # df -T 00:06:59.921 14:11:14 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:06:59.921 14:11:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:06:59.921 14:11:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=722997248 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:06:59.921 14:11:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=4561432576 00:06:59.921 14:11:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=89020088320 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=95552405504 00:06:59.921 14:11:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=6532317184 00:06:59.921 14:11:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=47773609984 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=47776202752 00:06:59.921 14:11:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:06:59.921 14:11:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:59.921 14:11:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:59.921 14:11:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=19101110272 00:06:59.922 14:11:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=19110481920 00:06:59.922 14:11:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=9371648 00:06:59.922 14:11:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.922 14:11:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:59.922 14:11:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:59.922 14:11:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=47775911936 00:06:59.922 14:11:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=47776202752 00:06:59.922 14:11:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=290816 00:06:59.922 14:11:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.922 14:11:14 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:06:59.922 14:11:14 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:06:59.922 14:11:14 -- common/autotest_common.sh@363 -- # avails["$mount"]=9555226624 00:06:59.922 14:11:14 -- common/autotest_common.sh@363 -- # sizes["$mount"]=9555238912 00:06:59.922 14:11:14 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:06:59.922 14:11:14 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:06:59.922 14:11:14 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:06:59.922 * Looking for test storage... 00:06:59.922 14:11:14 -- common/autotest_common.sh@369 -- # local target_space new_size 00:06:59.922 14:11:14 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:06:59.922 14:11:14 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.922 14:11:14 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:06:59.922 14:11:14 -- common/autotest_common.sh@373 -- # mount=/ 00:06:59.922 14:11:14 -- common/autotest_common.sh@375 -- # target_space=89020088320 00:06:59.922 14:11:14 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:06:59.922 14:11:14 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:06:59.922 14:11:14 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:06:59.922 14:11:14 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:06:59.922 14:11:14 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:06:59.922 14:11:14 -- common/autotest_common.sh@382 -- # new_size=8746909696 00:06:59.922 14:11:14 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:06:59.922 14:11:14 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.922 14:11:14 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.922 14:11:14 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.922 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:06:59.922 14:11:14 -- common/autotest_common.sh@390 -- # return 0 00:06:59.922 14:11:14 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:06:59.922 14:11:14 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:06:59.922 14:11:14 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:06:59.922 14:11:14 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:06:59.922 14:11:14 -- common/autotest_common.sh@1682 -- # true 00:06:59.922 14:11:14 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:06:59.922 14:11:14 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:06:59.922 14:11:14 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:06:59.922 14:11:14 -- common/autotest_common.sh@27 -- # exec 00:06:59.922 14:11:14 -- common/autotest_common.sh@29 -- # exec 00:06:59.922 14:11:14 -- common/autotest_common.sh@31 -- # xtrace_restore 00:06:59.922 14:11:14 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:06:59.922 14:11:14 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:06:59.922 14:11:14 -- common/autotest_common.sh@18 -- # set -x 00:06:59.922 14:11:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:59.922 14:11:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:59.922 14:11:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:59.922 14:11:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:59.922 14:11:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:59.922 14:11:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:59.922 14:11:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:59.922 14:11:14 -- scripts/common.sh@335 -- # IFS=.-: 00:06:59.922 14:11:14 -- scripts/common.sh@335 -- # read -ra ver1 00:06:59.922 14:11:14 -- scripts/common.sh@336 -- # IFS=.-: 00:06:59.922 14:11:14 -- scripts/common.sh@336 -- # read -ra ver2 00:06:59.922 14:11:14 -- scripts/common.sh@337 -- # local 'op=<' 00:06:59.922 14:11:14 -- scripts/common.sh@339 -- # ver1_l=2 00:06:59.922 14:11:14 -- scripts/common.sh@340 -- # ver2_l=1 00:06:59.922 14:11:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:59.922 14:11:14 -- scripts/common.sh@343 -- # case "$op" in 00:06:59.922 14:11:14 -- scripts/common.sh@344 -- # : 1 00:06:59.922 14:11:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:59.922 14:11:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:59.922 14:11:14 -- scripts/common.sh@364 -- # decimal 1 00:06:59.922 14:11:14 -- scripts/common.sh@352 -- # local d=1 00:06:59.922 14:11:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:59.922 14:11:14 -- scripts/common.sh@354 -- # echo 1 00:06:59.922 14:11:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:59.922 14:11:14 -- scripts/common.sh@365 -- # decimal 2 00:06:59.922 14:11:14 -- scripts/common.sh@352 -- # local d=2 00:06:59.922 14:11:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:59.922 14:11:14 -- scripts/common.sh@354 -- # echo 2 00:06:59.922 14:11:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:59.922 14:11:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:59.922 14:11:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:59.922 14:11:14 -- scripts/common.sh@367 -- # return 0 00:06:59.922 14:11:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:59.922 14:11:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:59.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.922 --rc genhtml_branch_coverage=1 00:06:59.922 --rc genhtml_function_coverage=1 00:06:59.922 --rc genhtml_legend=1 00:06:59.922 --rc geninfo_all_blocks=1 00:06:59.922 --rc geninfo_unexecuted_blocks=1 00:06:59.922 00:06:59.922 ' 00:06:59.922 14:11:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:59.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.922 --rc genhtml_branch_coverage=1 00:06:59.922 --rc genhtml_function_coverage=1 00:06:59.922 --rc genhtml_legend=1 00:06:59.922 --rc geninfo_all_blocks=1 00:06:59.922 --rc geninfo_unexecuted_blocks=1 00:06:59.922 00:06:59.922 ' 00:06:59.922 14:11:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:59.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.922 --rc genhtml_branch_coverage=1 00:06:59.922 --rc genhtml_function_coverage=1 00:06:59.922 --rc genhtml_legend=1 00:06:59.922 --rc geninfo_all_blocks=1 00:06:59.922 --rc geninfo_unexecuted_blocks=1 00:06:59.922 00:06:59.922 ' 00:06:59.922 14:11:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:59.922 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:59.922 --rc genhtml_branch_coverage=1 00:06:59.922 --rc genhtml_function_coverage=1 00:06:59.922 --rc genhtml_legend=1 00:06:59.922 --rc geninfo_all_blocks=1 00:06:59.922 --rc geninfo_unexecuted_blocks=1 00:06:59.922 00:06:59.922 ' 00:06:59.922 14:11:14 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:06:59.922 14:11:14 -- nvmf/common.sh@7 -- # uname -s 00:06:59.922 14:11:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:06:59.922 14:11:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:06:59.922 14:11:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:06:59.922 14:11:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:06:59.922 14:11:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:06:59.922 14:11:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:06:59.922 14:11:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:06:59.922 14:11:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:06:59.922 14:11:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:06:59.922 14:11:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:06:59.922 14:11:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:06:59.922 14:11:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:06:59.922 14:11:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:06:59.922 14:11:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:06:59.922 14:11:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:06:59.922 14:11:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:06:59.922 14:11:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:06:59.922 14:11:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:06:59.922 14:11:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:06:59.922 14:11:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.922 14:11:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.922 14:11:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.922 14:11:14 -- paths/export.sh@5 -- # export PATH 00:06:59.923 14:11:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:06:59.923 14:11:14 -- nvmf/common.sh@46 -- # : 0 00:06:59.923 14:11:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:06:59.923 14:11:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:06:59.923 14:11:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:06:59.923 14:11:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:06:59.923 14:11:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:06:59.923 14:11:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:06:59.923 14:11:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:06:59.923 14:11:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:06:59.923 14:11:14 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:06:59.923 14:11:14 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:06:59.923 14:11:14 -- target/filesystem.sh@15 -- # nvmftestinit 00:06:59.923 14:11:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:06:59.923 14:11:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:06:59.923 14:11:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:06:59.923 14:11:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:06:59.923 14:11:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:06:59.923 14:11:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:06:59.923 14:11:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:06:59.923 14:11:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:06:59.923 14:11:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:06:59.923 14:11:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:06:59.923 14:11:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:06:59.923 14:11:14 -- common/autotest_common.sh@10 -- # set +x 00:07:05.195 14:11:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:05.195 14:11:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:05.195 14:11:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:05.195 14:11:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:05.195 14:11:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:05.195 14:11:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:05.195 14:11:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:05.195 14:11:19 -- nvmf/common.sh@294 -- # net_devs=() 00:07:05.195 14:11:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:05.195 14:11:19 -- nvmf/common.sh@295 -- # e810=() 00:07:05.195 14:11:19 -- nvmf/common.sh@295 -- # local -ga e810 00:07:05.195 14:11:19 -- nvmf/common.sh@296 -- # x722=() 00:07:05.195 14:11:19 -- nvmf/common.sh@296 -- # local -ga x722 00:07:05.196 14:11:19 -- nvmf/common.sh@297 -- # mlx=() 00:07:05.196 14:11:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:05.196 14:11:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:05.196 14:11:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:05.196 14:11:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:05.196 14:11:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:05.196 14:11:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:05.196 14:11:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:07:05.196 Found 0000:af:00.0 (0x8086 - 0x159b) 00:07:05.196 14:11:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:05.196 14:11:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:07:05.196 Found 0000:af:00.1 (0x8086 - 0x159b) 00:07:05.196 14:11:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:05.196 14:11:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:05.196 14:11:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:05.196 14:11:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:05.196 14:11:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:05.196 14:11:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:07:05.196 Found net devices under 0000:af:00.0: cvl_0_0 00:07:05.196 14:11:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:05.196 14:11:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:05.196 14:11:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:05.196 14:11:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:05.196 14:11:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:05.196 14:11:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:07:05.196 Found net devices under 0000:af:00.1: cvl_0_1 00:07:05.196 14:11:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:05.196 14:11:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:05.196 14:11:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:05.196 14:11:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:05.196 14:11:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:05.196 14:11:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:05.196 14:11:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:05.196 14:11:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:05.196 14:11:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:05.196 14:11:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:05.196 14:11:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:05.196 14:11:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:05.196 14:11:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:05.196 14:11:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:05.196 14:11:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:05.196 14:11:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:05.196 14:11:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:05.196 14:11:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:05.196 14:11:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:05.196 14:11:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:05.196 14:11:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:05.196 14:11:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:05.196 14:11:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:05.196 14:11:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:05.196 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:05.196 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.392 ms 00:07:05.196 00:07:05.196 --- 10.0.0.2 ping statistics --- 00:07:05.196 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:05.196 rtt min/avg/max/mdev = 0.392/0.392/0.392/0.000 ms 00:07:05.196 14:11:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:05.196 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:05.196 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.218 ms 00:07:05.196 00:07:05.196 --- 10.0.0.1 ping statistics --- 00:07:05.196 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:05.196 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:07:05.196 14:11:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:05.196 14:11:19 -- nvmf/common.sh@410 -- # return 0 00:07:05.196 14:11:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:05.196 14:11:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:05.196 14:11:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:05.196 14:11:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:05.196 14:11:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:05.196 14:11:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:05.196 14:11:19 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:07:05.196 14:11:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:05.196 14:11:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.196 14:11:19 -- common/autotest_common.sh@10 -- # set +x 00:07:05.196 ************************************ 00:07:05.196 START TEST nvmf_filesystem_no_in_capsule 00:07:05.196 ************************************ 00:07:05.196 14:11:19 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:07:05.196 14:11:19 -- target/filesystem.sh@47 -- # in_capsule=0 00:07:05.196 14:11:19 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:05.196 14:11:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:05.196 14:11:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:05.196 14:11:19 -- common/autotest_common.sh@10 -- # set +x 00:07:05.196 14:11:19 -- nvmf/common.sh@469 -- # nvmfpid=226621 00:07:05.196 14:11:19 -- nvmf/common.sh@470 -- # waitforlisten 226621 00:07:05.196 14:11:19 -- common/autotest_common.sh@829 -- # '[' -z 226621 ']' 00:07:05.196 14:11:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:05.196 14:11:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:05.196 14:11:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:05.196 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:05.196 14:11:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:05.196 14:11:19 -- common/autotest_common.sh@10 -- # set +x 00:07:05.196 14:11:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:05.456 [2024-12-16 14:11:19.792725] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.456 [2024-12-16 14:11:19.792767] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:05.456 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.456 [2024-12-16 14:11:19.849963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:05.456 [2024-12-16 14:11:19.928928] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:05.456 [2024-12-16 14:11:19.929038] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:05.456 [2024-12-16 14:11:19.929046] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:05.456 [2024-12-16 14:11:19.929053] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:05.456 [2024-12-16 14:11:19.929091] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:05.456 [2024-12-16 14:11:19.929106] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:05.456 [2024-12-16 14:11:19.929198] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:05.456 [2024-12-16 14:11:19.929199] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.393 14:11:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:06.393 14:11:20 -- common/autotest_common.sh@862 -- # return 0 00:07:06.393 14:11:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:06.393 14:11:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:06.393 14:11:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.393 14:11:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:06.393 14:11:20 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:06.393 14:11:20 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:07:06.393 14:11:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.393 14:11:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.393 [2024-12-16 14:11:20.654218] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:06.393 14:11:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.393 14:11:20 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:06.393 14:11:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.393 14:11:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.393 Malloc1 00:07:06.393 14:11:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.393 14:11:20 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:06.393 14:11:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.393 14:11:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.393 14:11:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.393 14:11:20 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:06.393 14:11:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.393 14:11:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.393 14:11:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.393 14:11:20 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:06.393 14:11:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.393 14:11:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.393 [2024-12-16 14:11:20.806863] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:06.393 14:11:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.393 14:11:20 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:06.393 14:11:20 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:06.393 14:11:20 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:06.393 14:11:20 -- common/autotest_common.sh@1369 -- # local bs 00:07:06.393 14:11:20 -- common/autotest_common.sh@1370 -- # local nb 00:07:06.393 14:11:20 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:06.393 14:11:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:06.393 14:11:20 -- common/autotest_common.sh@10 -- # set +x 00:07:06.393 14:11:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:06.393 14:11:20 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:06.393 { 00:07:06.393 "name": "Malloc1", 00:07:06.393 "aliases": [ 00:07:06.393 "8810191a-1678-48c3-827e-04de0c1bd64d" 00:07:06.393 ], 00:07:06.393 "product_name": "Malloc disk", 00:07:06.393 "block_size": 512, 00:07:06.393 "num_blocks": 1048576, 00:07:06.393 "uuid": "8810191a-1678-48c3-827e-04de0c1bd64d", 00:07:06.393 "assigned_rate_limits": { 00:07:06.393 "rw_ios_per_sec": 0, 00:07:06.393 "rw_mbytes_per_sec": 0, 00:07:06.393 "r_mbytes_per_sec": 0, 00:07:06.393 "w_mbytes_per_sec": 0 00:07:06.393 }, 00:07:06.393 "claimed": true, 00:07:06.393 "claim_type": "exclusive_write", 00:07:06.393 "zoned": false, 00:07:06.393 "supported_io_types": { 00:07:06.393 "read": true, 00:07:06.393 "write": true, 00:07:06.393 "unmap": true, 00:07:06.393 "write_zeroes": true, 00:07:06.393 "flush": true, 00:07:06.393 "reset": true, 00:07:06.393 "compare": false, 00:07:06.393 "compare_and_write": false, 00:07:06.393 "abort": true, 00:07:06.393 "nvme_admin": false, 00:07:06.393 "nvme_io": false 00:07:06.393 }, 00:07:06.393 "memory_domains": [ 00:07:06.393 { 00:07:06.393 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:06.393 "dma_device_type": 2 00:07:06.393 } 00:07:06.393 ], 00:07:06.393 "driver_specific": {} 00:07:06.393 } 00:07:06.393 ]' 00:07:06.393 14:11:20 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:06.393 14:11:20 -- common/autotest_common.sh@1372 -- # bs=512 00:07:06.393 14:11:20 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:06.393 14:11:20 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:06.393 14:11:20 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:06.393 14:11:20 -- common/autotest_common.sh@1377 -- # echo 512 00:07:06.393 14:11:20 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:06.393 14:11:20 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:07.769 14:11:22 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:07.769 14:11:22 -- common/autotest_common.sh@1187 -- # local i=0 00:07:07.769 14:11:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:07.769 14:11:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:07.769 14:11:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:09.802 14:11:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:09.802 14:11:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:09.802 14:11:24 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:09.802 14:11:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:09.802 14:11:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:09.802 14:11:24 -- common/autotest_common.sh@1197 -- # return 0 00:07:09.802 14:11:24 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:09.802 14:11:24 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:09.803 14:11:24 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:09.803 14:11:24 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:09.803 14:11:24 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:09.803 14:11:24 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:09.803 14:11:24 -- setup/common.sh@80 -- # echo 536870912 00:07:09.803 14:11:24 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:09.803 14:11:24 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:09.803 14:11:24 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:09.803 14:11:24 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:09.803 14:11:24 -- target/filesystem.sh@69 -- # partprobe 00:07:09.803 14:11:24 -- target/filesystem.sh@70 -- # sleep 1 00:07:10.739 14:11:25 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:07:10.739 14:11:25 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:10.739 14:11:25 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:10.739 14:11:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.739 14:11:25 -- common/autotest_common.sh@10 -- # set +x 00:07:10.739 ************************************ 00:07:10.739 START TEST filesystem_ext4 00:07:10.739 ************************************ 00:07:10.739 14:11:25 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:10.739 14:11:25 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:10.739 14:11:25 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:10.739 14:11:25 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:10.739 14:11:25 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:10.739 14:11:25 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:10.739 14:11:25 -- common/autotest_common.sh@914 -- # local i=0 00:07:10.739 14:11:25 -- common/autotest_common.sh@915 -- # local force 00:07:10.739 14:11:25 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:10.739 14:11:25 -- common/autotest_common.sh@918 -- # force=-F 00:07:10.739 14:11:25 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:10.739 mke2fs 1.47.0 (5-Feb-2023) 00:07:10.997 Discarding device blocks: 0/522240 done 00:07:10.997 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:10.997 Filesystem UUID: b8e3d997-a5e3-4433-aff3-705883e252ef 00:07:10.997 Superblock backups stored on blocks: 00:07:10.997 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:10.997 00:07:10.997 Allocating group tables: 0/64 done 00:07:10.997 Writing inode tables: 0/64 done 00:07:10.997 Creating journal (8192 blocks): done 00:07:10.997 Writing superblocks and filesystem accounting information: 0/64 done 00:07:10.997 00:07:10.997 14:11:25 -- common/autotest_common.sh@931 -- # return 0 00:07:10.997 14:11:25 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:16.265 14:11:30 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:16.265 14:11:30 -- target/filesystem.sh@25 -- # sync 00:07:16.265 14:11:30 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:16.265 14:11:30 -- target/filesystem.sh@27 -- # sync 00:07:16.265 14:11:30 -- target/filesystem.sh@29 -- # i=0 00:07:16.265 14:11:30 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:16.524 14:11:30 -- target/filesystem.sh@37 -- # kill -0 226621 00:07:16.524 14:11:30 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:16.524 14:11:30 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:16.524 14:11:30 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:16.524 14:11:30 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:16.524 00:07:16.524 real 0m5.591s 00:07:16.524 user 0m0.028s 00:07:16.524 sys 0m0.070s 00:07:16.524 14:11:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.524 14:11:30 -- common/autotest_common.sh@10 -- # set +x 00:07:16.524 ************************************ 00:07:16.524 END TEST filesystem_ext4 00:07:16.524 ************************************ 00:07:16.524 14:11:30 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:16.524 14:11:30 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:16.524 14:11:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.525 14:11:30 -- common/autotest_common.sh@10 -- # set +x 00:07:16.525 ************************************ 00:07:16.525 START TEST filesystem_btrfs 00:07:16.525 ************************************ 00:07:16.525 14:11:30 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:16.525 14:11:30 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:16.525 14:11:30 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:16.525 14:11:30 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:16.525 14:11:30 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:16.525 14:11:30 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:16.525 14:11:30 -- common/autotest_common.sh@914 -- # local i=0 00:07:16.525 14:11:30 -- common/autotest_common.sh@915 -- # local force 00:07:16.525 14:11:30 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:16.525 14:11:30 -- common/autotest_common.sh@920 -- # force=-f 00:07:16.525 14:11:30 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:16.525 btrfs-progs v6.8.1 00:07:16.525 See https://btrfs.readthedocs.io for more information. 00:07:16.525 00:07:16.525 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:16.525 NOTE: several default settings have changed in version 5.15, please make sure 00:07:16.525 this does not affect your deployments: 00:07:16.525 - DUP for metadata (-m dup) 00:07:16.525 - enabled no-holes (-O no-holes) 00:07:16.525 - enabled free-space-tree (-R free-space-tree) 00:07:16.525 00:07:16.525 Label: (null) 00:07:16.525 UUID: 3e7b0890-2426-45ae-812d-00b905c2e6fe 00:07:16.525 Node size: 16384 00:07:16.525 Sector size: 4096 (CPU page size: 4096) 00:07:16.525 Filesystem size: 510.00MiB 00:07:16.525 Block group profiles: 00:07:16.525 Data: single 8.00MiB 00:07:16.525 Metadata: DUP 32.00MiB 00:07:16.525 System: DUP 8.00MiB 00:07:16.525 SSD detected: yes 00:07:16.525 Zoned device: no 00:07:16.525 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:16.525 Checksum: crc32c 00:07:16.525 Number of devices: 1 00:07:16.525 Devices: 00:07:16.525 ID SIZE PATH 00:07:16.525 1 510.00MiB /dev/nvme0n1p1 00:07:16.525 00:07:16.525 14:11:31 -- common/autotest_common.sh@931 -- # return 0 00:07:16.525 14:11:31 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:17.901 14:11:32 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:17.901 14:11:32 -- target/filesystem.sh@25 -- # sync 00:07:17.901 14:11:32 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:17.901 14:11:32 -- target/filesystem.sh@27 -- # sync 00:07:17.901 14:11:32 -- target/filesystem.sh@29 -- # i=0 00:07:17.901 14:11:32 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:17.901 14:11:32 -- target/filesystem.sh@37 -- # kill -0 226621 00:07:17.901 14:11:32 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:17.901 14:11:32 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:17.901 14:11:32 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:17.901 14:11:32 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:17.901 00:07:17.901 real 0m1.199s 00:07:17.901 user 0m0.026s 00:07:17.901 sys 0m0.112s 00:07:17.901 14:11:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:17.901 14:11:32 -- common/autotest_common.sh@10 -- # set +x 00:07:17.901 ************************************ 00:07:17.901 END TEST filesystem_btrfs 00:07:17.901 ************************************ 00:07:17.901 14:11:32 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:07:17.901 14:11:32 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:17.901 14:11:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:17.901 14:11:32 -- common/autotest_common.sh@10 -- # set +x 00:07:17.901 ************************************ 00:07:17.901 START TEST filesystem_xfs 00:07:17.901 ************************************ 00:07:17.901 14:11:32 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:17.901 14:11:32 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:17.901 14:11:32 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:17.901 14:11:32 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:17.901 14:11:32 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:17.901 14:11:32 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:17.901 14:11:32 -- common/autotest_common.sh@914 -- # local i=0 00:07:17.901 14:11:32 -- common/autotest_common.sh@915 -- # local force 00:07:17.901 14:11:32 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:17.901 14:11:32 -- common/autotest_common.sh@920 -- # force=-f 00:07:17.901 14:11:32 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:18.469 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:18.469 = sectsz=512 attr=2, projid32bit=1 00:07:18.469 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:18.469 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:18.469 data = bsize=4096 blocks=130560, imaxpct=25 00:07:18.469 = sunit=0 swidth=0 blks 00:07:18.469 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:18.469 log =internal log bsize=4096 blocks=16384, version=2 00:07:18.469 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:18.469 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:19.844 Discarding blocks...Done. 00:07:19.844 14:11:33 -- common/autotest_common.sh@931 -- # return 0 00:07:19.844 14:11:33 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:22.376 14:11:36 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:22.376 14:11:36 -- target/filesystem.sh@25 -- # sync 00:07:22.376 14:11:36 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:22.376 14:11:36 -- target/filesystem.sh@27 -- # sync 00:07:22.376 14:11:36 -- target/filesystem.sh@29 -- # i=0 00:07:22.376 14:11:36 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:22.376 14:11:36 -- target/filesystem.sh@37 -- # kill -0 226621 00:07:22.376 14:11:36 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:22.376 14:11:36 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:22.376 14:11:36 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:22.376 14:11:36 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:22.376 00:07:22.376 real 0m4.328s 00:07:22.376 user 0m0.025s 00:07:22.376 sys 0m0.071s 00:07:22.376 14:11:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.376 14:11:36 -- common/autotest_common.sh@10 -- # set +x 00:07:22.376 ************************************ 00:07:22.376 END TEST filesystem_xfs 00:07:22.376 ************************************ 00:07:22.376 14:11:36 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:22.376 14:11:36 -- target/filesystem.sh@93 -- # sync 00:07:22.376 14:11:36 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:22.376 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:22.376 14:11:36 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:22.376 14:11:36 -- common/autotest_common.sh@1208 -- # local i=0 00:07:22.376 14:11:36 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:22.376 14:11:36 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:22.376 14:11:36 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:22.376 14:11:36 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:22.376 14:11:36 -- common/autotest_common.sh@1220 -- # return 0 00:07:22.376 14:11:36 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:22.376 14:11:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:22.376 14:11:36 -- common/autotest_common.sh@10 -- # set +x 00:07:22.376 14:11:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:22.376 14:11:36 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:22.376 14:11:36 -- target/filesystem.sh@101 -- # killprocess 226621 00:07:22.376 14:11:36 -- common/autotest_common.sh@936 -- # '[' -z 226621 ']' 00:07:22.376 14:11:36 -- common/autotest_common.sh@940 -- # kill -0 226621 00:07:22.376 14:11:36 -- common/autotest_common.sh@941 -- # uname 00:07:22.376 14:11:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:22.376 14:11:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 226621 00:07:22.635 14:11:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:22.635 14:11:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:22.635 14:11:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 226621' 00:07:22.635 killing process with pid 226621 00:07:22.635 14:11:36 -- common/autotest_common.sh@955 -- # kill 226621 00:07:22.635 14:11:36 -- common/autotest_common.sh@960 -- # wait 226621 00:07:22.894 14:11:37 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:22.894 00:07:22.894 real 0m17.574s 00:07:22.894 user 1m9.078s 00:07:22.894 sys 0m1.359s 00:07:22.894 14:11:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.894 14:11:37 -- common/autotest_common.sh@10 -- # set +x 00:07:22.894 ************************************ 00:07:22.894 END TEST nvmf_filesystem_no_in_capsule 00:07:22.894 ************************************ 00:07:22.894 14:11:37 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:07:22.894 14:11:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:22.894 14:11:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.894 14:11:37 -- common/autotest_common.sh@10 -- # set +x 00:07:22.894 ************************************ 00:07:22.894 START TEST nvmf_filesystem_in_capsule 00:07:22.894 ************************************ 00:07:22.894 14:11:37 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:07:22.894 14:11:37 -- target/filesystem.sh@47 -- # in_capsule=4096 00:07:22.894 14:11:37 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:07:22.894 14:11:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:22.894 14:11:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:22.894 14:11:37 -- common/autotest_common.sh@10 -- # set +x 00:07:22.894 14:11:37 -- nvmf/common.sh@469 -- # nvmfpid=229769 00:07:22.894 14:11:37 -- nvmf/common.sh@470 -- # waitforlisten 229769 00:07:22.894 14:11:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:22.894 14:11:37 -- common/autotest_common.sh@829 -- # '[' -z 229769 ']' 00:07:22.894 14:11:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:22.894 14:11:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:22.894 14:11:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:22.894 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:22.894 14:11:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:22.894 14:11:37 -- common/autotest_common.sh@10 -- # set +x 00:07:22.894 [2024-12-16 14:11:37.406703] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:22.894 [2024-12-16 14:11:37.406749] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:22.894 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.894 [2024-12-16 14:11:37.465802] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:23.153 [2024-12-16 14:11:37.535532] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:23.153 [2024-12-16 14:11:37.535647] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:23.153 [2024-12-16 14:11:37.535654] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:23.153 [2024-12-16 14:11:37.535661] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:23.153 [2024-12-16 14:11:37.535698] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:23.153 [2024-12-16 14:11:37.535799] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:23.153 [2024-12-16 14:11:37.535886] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:23.153 [2024-12-16 14:11:37.535888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.720 14:11:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:23.720 14:11:38 -- common/autotest_common.sh@862 -- # return 0 00:07:23.720 14:11:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:23.720 14:11:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:23.720 14:11:38 -- common/autotest_common.sh@10 -- # set +x 00:07:23.720 14:11:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:23.720 14:11:38 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:07:23.720 14:11:38 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:07:23.720 14:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.720 14:11:38 -- common/autotest_common.sh@10 -- # set +x 00:07:23.720 [2024-12-16 14:11:38.267254] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:23.720 14:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.720 14:11:38 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:07:23.720 14:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.720 14:11:38 -- common/autotest_common.sh@10 -- # set +x 00:07:23.979 Malloc1 00:07:23.979 14:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.979 14:11:38 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:07:23.979 14:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.979 14:11:38 -- common/autotest_common.sh@10 -- # set +x 00:07:23.979 14:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.979 14:11:38 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:07:23.979 14:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.979 14:11:38 -- common/autotest_common.sh@10 -- # set +x 00:07:23.979 14:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.979 14:11:38 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:23.979 14:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.979 14:11:38 -- common/autotest_common.sh@10 -- # set +x 00:07:23.979 [2024-12-16 14:11:38.413406] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:23.979 14:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.979 14:11:38 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:07:23.979 14:11:38 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:07:23.979 14:11:38 -- common/autotest_common.sh@1368 -- # local bdev_info 00:07:23.979 14:11:38 -- common/autotest_common.sh@1369 -- # local bs 00:07:23.979 14:11:38 -- common/autotest_common.sh@1370 -- # local nb 00:07:23.979 14:11:38 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:07:23.979 14:11:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:23.979 14:11:38 -- common/autotest_common.sh@10 -- # set +x 00:07:23.979 14:11:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:23.979 14:11:38 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:07:23.979 { 00:07:23.979 "name": "Malloc1", 00:07:23.979 "aliases": [ 00:07:23.979 "66a2018c-5f8d-497f-ad15-25f18425122e" 00:07:23.979 ], 00:07:23.979 "product_name": "Malloc disk", 00:07:23.979 "block_size": 512, 00:07:23.979 "num_blocks": 1048576, 00:07:23.979 "uuid": "66a2018c-5f8d-497f-ad15-25f18425122e", 00:07:23.979 "assigned_rate_limits": { 00:07:23.979 "rw_ios_per_sec": 0, 00:07:23.979 "rw_mbytes_per_sec": 0, 00:07:23.979 "r_mbytes_per_sec": 0, 00:07:23.979 "w_mbytes_per_sec": 0 00:07:23.979 }, 00:07:23.979 "claimed": true, 00:07:23.979 "claim_type": "exclusive_write", 00:07:23.979 "zoned": false, 00:07:23.979 "supported_io_types": { 00:07:23.980 "read": true, 00:07:23.980 "write": true, 00:07:23.980 "unmap": true, 00:07:23.980 "write_zeroes": true, 00:07:23.980 "flush": true, 00:07:23.980 "reset": true, 00:07:23.980 "compare": false, 00:07:23.980 "compare_and_write": false, 00:07:23.980 "abort": true, 00:07:23.980 "nvme_admin": false, 00:07:23.980 "nvme_io": false 00:07:23.980 }, 00:07:23.980 "memory_domains": [ 00:07:23.980 { 00:07:23.980 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:07:23.980 "dma_device_type": 2 00:07:23.980 } 00:07:23.980 ], 00:07:23.980 "driver_specific": {} 00:07:23.980 } 00:07:23.980 ]' 00:07:23.980 14:11:38 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:07:23.980 14:11:38 -- common/autotest_common.sh@1372 -- # bs=512 00:07:23.980 14:11:38 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:07:23.980 14:11:38 -- common/autotest_common.sh@1373 -- # nb=1048576 00:07:23.980 14:11:38 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:07:23.980 14:11:38 -- common/autotest_common.sh@1377 -- # echo 512 00:07:23.980 14:11:38 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:07:23.980 14:11:38 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:07:25.356 14:11:39 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:07:25.356 14:11:39 -- common/autotest_common.sh@1187 -- # local i=0 00:07:25.356 14:11:39 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:07:25.356 14:11:39 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:07:25.356 14:11:39 -- common/autotest_common.sh@1194 -- # sleep 2 00:07:27.259 14:11:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:07:27.259 14:11:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:07:27.259 14:11:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:07:27.259 14:11:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:07:27.259 14:11:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:07:27.259 14:11:41 -- common/autotest_common.sh@1197 -- # return 0 00:07:27.259 14:11:41 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:07:27.260 14:11:41 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:07:27.260 14:11:41 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:07:27.260 14:11:41 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:07:27.260 14:11:41 -- setup/common.sh@76 -- # local dev=nvme0n1 00:07:27.260 14:11:41 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:07:27.260 14:11:41 -- setup/common.sh@80 -- # echo 536870912 00:07:27.260 14:11:41 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:07:27.260 14:11:41 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:07:27.260 14:11:41 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:07:27.260 14:11:41 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:07:27.518 14:11:41 -- target/filesystem.sh@69 -- # partprobe 00:07:28.454 14:11:42 -- target/filesystem.sh@70 -- # sleep 1 00:07:29.391 14:11:43 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:07:29.391 14:11:43 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:07:29.391 14:11:43 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:29.391 14:11:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:29.391 14:11:43 -- common/autotest_common.sh@10 -- # set +x 00:07:29.391 ************************************ 00:07:29.391 START TEST filesystem_in_capsule_ext4 00:07:29.391 ************************************ 00:07:29.391 14:11:43 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:07:29.391 14:11:43 -- target/filesystem.sh@18 -- # fstype=ext4 00:07:29.391 14:11:43 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:29.391 14:11:43 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:07:29.391 14:11:43 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:07:29.391 14:11:43 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:29.391 14:11:43 -- common/autotest_common.sh@914 -- # local i=0 00:07:29.391 14:11:43 -- common/autotest_common.sh@915 -- # local force 00:07:29.391 14:11:43 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:07:29.391 14:11:43 -- common/autotest_common.sh@918 -- # force=-F 00:07:29.391 14:11:43 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:07:29.391 mke2fs 1.47.0 (5-Feb-2023) 00:07:29.391 Discarding device blocks: 0/522240 done 00:07:29.391 Creating filesystem with 522240 1k blocks and 130560 inodes 00:07:29.391 Filesystem UUID: 0bba5a39-aea0-4ef2-be0d-79706dfc3db3 00:07:29.391 Superblock backups stored on blocks: 00:07:29.391 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:07:29.391 00:07:29.391 Allocating group tables: 0/64 done 00:07:29.391 Writing inode tables: 0/64 done 00:07:29.649 Creating journal (8192 blocks): done 00:07:31.041 Writing superblocks and filesystem accounting information: 0/64 done 00:07:31.041 00:07:31.041 14:11:45 -- common/autotest_common.sh@931 -- # return 0 00:07:31.041 14:11:45 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:36.311 14:11:50 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:36.311 14:11:50 -- target/filesystem.sh@25 -- # sync 00:07:36.311 14:11:50 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:36.311 14:11:50 -- target/filesystem.sh@27 -- # sync 00:07:36.311 14:11:50 -- target/filesystem.sh@29 -- # i=0 00:07:36.311 14:11:50 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:36.311 14:11:50 -- target/filesystem.sh@37 -- # kill -0 229769 00:07:36.311 14:11:50 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:36.311 14:11:50 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:36.311 14:11:50 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:36.311 14:11:50 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:36.311 00:07:36.311 real 0m7.061s 00:07:36.311 user 0m0.023s 00:07:36.311 sys 0m0.073s 00:07:36.311 14:11:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.311 14:11:50 -- common/autotest_common.sh@10 -- # set +x 00:07:36.311 ************************************ 00:07:36.311 END TEST filesystem_in_capsule_ext4 00:07:36.311 ************************************ 00:07:36.311 14:11:50 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:07:36.311 14:11:50 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:36.311 14:11:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.311 14:11:50 -- common/autotest_common.sh@10 -- # set +x 00:07:36.311 ************************************ 00:07:36.311 START TEST filesystem_in_capsule_btrfs 00:07:36.311 ************************************ 00:07:36.311 14:11:50 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:07:36.311 14:11:50 -- target/filesystem.sh@18 -- # fstype=btrfs 00:07:36.311 14:11:50 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:36.311 14:11:50 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:07:36.311 14:11:50 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:07:36.311 14:11:50 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:36.311 14:11:50 -- common/autotest_common.sh@914 -- # local i=0 00:07:36.311 14:11:50 -- common/autotest_common.sh@915 -- # local force 00:07:36.311 14:11:50 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:07:36.311 14:11:50 -- common/autotest_common.sh@920 -- # force=-f 00:07:36.311 14:11:50 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:07:36.879 btrfs-progs v6.8.1 00:07:36.879 See https://btrfs.readthedocs.io for more information. 00:07:36.879 00:07:36.879 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:07:36.879 NOTE: several default settings have changed in version 5.15, please make sure 00:07:36.879 this does not affect your deployments: 00:07:36.879 - DUP for metadata (-m dup) 00:07:36.879 - enabled no-holes (-O no-holes) 00:07:36.879 - enabled free-space-tree (-R free-space-tree) 00:07:36.879 00:07:36.879 Label: (null) 00:07:36.879 UUID: 29295174-7814-45cc-b90a-ad186c9c11be 00:07:36.879 Node size: 16384 00:07:36.879 Sector size: 4096 (CPU page size: 4096) 00:07:36.879 Filesystem size: 510.00MiB 00:07:36.879 Block group profiles: 00:07:36.879 Data: single 8.00MiB 00:07:36.879 Metadata: DUP 32.00MiB 00:07:36.879 System: DUP 8.00MiB 00:07:36.879 SSD detected: yes 00:07:36.879 Zoned device: no 00:07:36.879 Features: extref, skinny-metadata, no-holes, free-space-tree 00:07:36.879 Checksum: crc32c 00:07:36.879 Number of devices: 1 00:07:36.879 Devices: 00:07:36.879 ID SIZE PATH 00:07:36.879 1 510.00MiB /dev/nvme0n1p1 00:07:36.879 00:07:36.879 14:11:51 -- common/autotest_common.sh@931 -- # return 0 00:07:36.879 14:11:51 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:36.879 14:11:51 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:36.879 14:11:51 -- target/filesystem.sh@25 -- # sync 00:07:36.879 14:11:51 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:36.879 14:11:51 -- target/filesystem.sh@27 -- # sync 00:07:36.879 14:11:51 -- target/filesystem.sh@29 -- # i=0 00:07:36.879 14:11:51 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:36.879 14:11:51 -- target/filesystem.sh@37 -- # kill -0 229769 00:07:36.879 14:11:51 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:36.879 14:11:51 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:36.879 14:11:51 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:36.879 14:11:51 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:37.138 00:07:37.138 real 0m0.620s 00:07:37.138 user 0m0.026s 00:07:37.138 sys 0m0.112s 00:07:37.138 14:11:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:37.138 14:11:51 -- common/autotest_common.sh@10 -- # set +x 00:07:37.138 ************************************ 00:07:37.138 END TEST filesystem_in_capsule_btrfs 00:07:37.138 ************************************ 00:07:37.138 14:11:51 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:07:37.138 14:11:51 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:37.138 14:11:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:37.138 14:11:51 -- common/autotest_common.sh@10 -- # set +x 00:07:37.138 ************************************ 00:07:37.138 START TEST filesystem_in_capsule_xfs 00:07:37.138 ************************************ 00:07:37.138 14:11:51 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:07:37.138 14:11:51 -- target/filesystem.sh@18 -- # fstype=xfs 00:07:37.138 14:11:51 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:07:37.138 14:11:51 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:07:37.138 14:11:51 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:07:37.138 14:11:51 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:07:37.138 14:11:51 -- common/autotest_common.sh@914 -- # local i=0 00:07:37.138 14:11:51 -- common/autotest_common.sh@915 -- # local force 00:07:37.138 14:11:51 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:07:37.138 14:11:51 -- common/autotest_common.sh@920 -- # force=-f 00:07:37.138 14:11:51 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:07:37.138 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:07:37.138 = sectsz=512 attr=2, projid32bit=1 00:07:37.138 = crc=1 finobt=1, sparse=1, rmapbt=0 00:07:37.138 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:07:37.138 data = bsize=4096 blocks=130560, imaxpct=25 00:07:37.138 = sunit=0 swidth=0 blks 00:07:37.138 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:07:37.138 log =internal log bsize=4096 blocks=16384, version=2 00:07:37.138 = sectsz=512 sunit=0 blks, lazy-count=1 00:07:37.138 realtime =none extsz=4096 blocks=0, rtextents=0 00:07:38.074 Discarding blocks...Done. 00:07:38.074 14:11:52 -- common/autotest_common.sh@931 -- # return 0 00:07:38.074 14:11:52 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:07:40.606 14:11:54 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:07:40.606 14:11:54 -- target/filesystem.sh@25 -- # sync 00:07:40.606 14:11:54 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:07:40.606 14:11:54 -- target/filesystem.sh@27 -- # sync 00:07:40.606 14:11:54 -- target/filesystem.sh@29 -- # i=0 00:07:40.606 14:11:54 -- target/filesystem.sh@30 -- # umount /mnt/device 00:07:40.606 14:11:54 -- target/filesystem.sh@37 -- # kill -0 229769 00:07:40.606 14:11:54 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:07:40.606 14:11:54 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:07:40.606 14:11:54 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:07:40.606 14:11:54 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:07:40.606 00:07:40.606 real 0m3.337s 00:07:40.606 user 0m0.026s 00:07:40.606 sys 0m0.072s 00:07:40.606 14:11:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:40.606 14:11:54 -- common/autotest_common.sh@10 -- # set +x 00:07:40.606 ************************************ 00:07:40.606 END TEST filesystem_in_capsule_xfs 00:07:40.606 ************************************ 00:07:40.607 14:11:54 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:07:40.607 14:11:54 -- target/filesystem.sh@93 -- # sync 00:07:40.607 14:11:54 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:07:40.607 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:07:40.607 14:11:55 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:07:40.607 14:11:55 -- common/autotest_common.sh@1208 -- # local i=0 00:07:40.607 14:11:55 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:07:40.607 14:11:55 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:40.607 14:11:55 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:07:40.607 14:11:55 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:07:40.607 14:11:55 -- common/autotest_common.sh@1220 -- # return 0 00:07:40.607 14:11:55 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:40.607 14:11:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:40.607 14:11:55 -- common/autotest_common.sh@10 -- # set +x 00:07:40.607 14:11:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:40.607 14:11:55 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:07:40.607 14:11:55 -- target/filesystem.sh@101 -- # killprocess 229769 00:07:40.607 14:11:55 -- common/autotest_common.sh@936 -- # '[' -z 229769 ']' 00:07:40.607 14:11:55 -- common/autotest_common.sh@940 -- # kill -0 229769 00:07:40.607 14:11:55 -- common/autotest_common.sh@941 -- # uname 00:07:40.607 14:11:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:40.607 14:11:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 229769 00:07:40.607 14:11:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:40.607 14:11:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:40.607 14:11:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 229769' 00:07:40.607 killing process with pid 229769 00:07:40.607 14:11:55 -- common/autotest_common.sh@955 -- # kill 229769 00:07:40.607 14:11:55 -- common/autotest_common.sh@960 -- # wait 229769 00:07:41.175 14:11:55 -- target/filesystem.sh@102 -- # nvmfpid= 00:07:41.175 00:07:41.175 real 0m18.118s 00:07:41.175 user 1m11.237s 00:07:41.175 sys 0m1.414s 00:07:41.175 14:11:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.175 14:11:55 -- common/autotest_common.sh@10 -- # set +x 00:07:41.175 ************************************ 00:07:41.175 END TEST nvmf_filesystem_in_capsule 00:07:41.175 ************************************ 00:07:41.175 14:11:55 -- target/filesystem.sh@108 -- # nvmftestfini 00:07:41.175 14:11:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:41.175 14:11:55 -- nvmf/common.sh@116 -- # sync 00:07:41.175 14:11:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:41.175 14:11:55 -- nvmf/common.sh@119 -- # set +e 00:07:41.175 14:11:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:41.175 14:11:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:41.175 rmmod nvme_tcp 00:07:41.175 rmmod nvme_fabrics 00:07:41.175 rmmod nvme_keyring 00:07:41.175 14:11:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:41.175 14:11:55 -- nvmf/common.sh@123 -- # set -e 00:07:41.175 14:11:55 -- nvmf/common.sh@124 -- # return 0 00:07:41.175 14:11:55 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:07:41.175 14:11:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:41.175 14:11:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:41.175 14:11:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:41.175 14:11:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:41.175 14:11:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:41.175 14:11:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:41.175 14:11:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:41.175 14:11:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:43.080 14:11:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:43.080 00:07:43.080 real 0m43.620s 00:07:43.080 user 2m21.979s 00:07:43.080 sys 0m6.954s 00:07:43.080 14:11:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:43.080 14:11:57 -- common/autotest_common.sh@10 -- # set +x 00:07:43.080 ************************************ 00:07:43.080 END TEST nvmf_filesystem 00:07:43.080 ************************************ 00:07:43.339 14:11:57 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:43.339 14:11:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:43.339 14:11:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:43.339 14:11:57 -- common/autotest_common.sh@10 -- # set +x 00:07:43.339 ************************************ 00:07:43.339 START TEST nvmf_discovery 00:07:43.339 ************************************ 00:07:43.339 14:11:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:07:43.339 * Looking for test storage... 00:07:43.339 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:43.340 14:11:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:43.340 14:11:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:43.340 14:11:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:43.340 14:11:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:43.340 14:11:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:43.340 14:11:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:43.340 14:11:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:43.340 14:11:57 -- scripts/common.sh@335 -- # IFS=.-: 00:07:43.340 14:11:57 -- scripts/common.sh@335 -- # read -ra ver1 00:07:43.340 14:11:57 -- scripts/common.sh@336 -- # IFS=.-: 00:07:43.340 14:11:57 -- scripts/common.sh@336 -- # read -ra ver2 00:07:43.340 14:11:57 -- scripts/common.sh@337 -- # local 'op=<' 00:07:43.340 14:11:57 -- scripts/common.sh@339 -- # ver1_l=2 00:07:43.340 14:11:57 -- scripts/common.sh@340 -- # ver2_l=1 00:07:43.340 14:11:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:43.340 14:11:57 -- scripts/common.sh@343 -- # case "$op" in 00:07:43.340 14:11:57 -- scripts/common.sh@344 -- # : 1 00:07:43.340 14:11:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:43.340 14:11:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:43.340 14:11:57 -- scripts/common.sh@364 -- # decimal 1 00:07:43.340 14:11:57 -- scripts/common.sh@352 -- # local d=1 00:07:43.340 14:11:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:43.340 14:11:57 -- scripts/common.sh@354 -- # echo 1 00:07:43.340 14:11:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:43.340 14:11:57 -- scripts/common.sh@365 -- # decimal 2 00:07:43.340 14:11:57 -- scripts/common.sh@352 -- # local d=2 00:07:43.340 14:11:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:43.340 14:11:57 -- scripts/common.sh@354 -- # echo 2 00:07:43.340 14:11:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:43.340 14:11:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:43.340 14:11:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:43.340 14:11:57 -- scripts/common.sh@367 -- # return 0 00:07:43.340 14:11:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:43.340 14:11:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:43.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.340 --rc genhtml_branch_coverage=1 00:07:43.340 --rc genhtml_function_coverage=1 00:07:43.340 --rc genhtml_legend=1 00:07:43.340 --rc geninfo_all_blocks=1 00:07:43.340 --rc geninfo_unexecuted_blocks=1 00:07:43.340 00:07:43.340 ' 00:07:43.340 14:11:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:43.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.340 --rc genhtml_branch_coverage=1 00:07:43.340 --rc genhtml_function_coverage=1 00:07:43.340 --rc genhtml_legend=1 00:07:43.340 --rc geninfo_all_blocks=1 00:07:43.340 --rc geninfo_unexecuted_blocks=1 00:07:43.340 00:07:43.340 ' 00:07:43.340 14:11:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:43.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.340 --rc genhtml_branch_coverage=1 00:07:43.340 --rc genhtml_function_coverage=1 00:07:43.340 --rc genhtml_legend=1 00:07:43.340 --rc geninfo_all_blocks=1 00:07:43.340 --rc geninfo_unexecuted_blocks=1 00:07:43.340 00:07:43.340 ' 00:07:43.340 14:11:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:43.340 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:43.340 --rc genhtml_branch_coverage=1 00:07:43.340 --rc genhtml_function_coverage=1 00:07:43.340 --rc genhtml_legend=1 00:07:43.340 --rc geninfo_all_blocks=1 00:07:43.340 --rc geninfo_unexecuted_blocks=1 00:07:43.340 00:07:43.340 ' 00:07:43.340 14:11:57 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:43.340 14:11:57 -- nvmf/common.sh@7 -- # uname -s 00:07:43.340 14:11:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:43.340 14:11:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:43.340 14:11:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:43.340 14:11:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:43.340 14:11:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:43.340 14:11:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:43.340 14:11:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:43.340 14:11:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:43.340 14:11:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:43.340 14:11:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:43.340 14:11:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:07:43.340 14:11:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:07:43.340 14:11:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:43.340 14:11:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:43.340 14:11:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:43.340 14:11:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:43.340 14:11:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:43.340 14:11:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:43.340 14:11:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:43.340 14:11:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:43.340 14:11:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:43.340 14:11:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:43.340 14:11:57 -- paths/export.sh@5 -- # export PATH 00:07:43.340 14:11:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:43.340 14:11:57 -- nvmf/common.sh@46 -- # : 0 00:07:43.340 14:11:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:43.340 14:11:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:43.340 14:11:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:43.340 14:11:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:43.340 14:11:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:43.340 14:11:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:43.340 14:11:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:43.340 14:11:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:43.340 14:11:57 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:07:43.340 14:11:57 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:07:43.340 14:11:57 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:07:43.340 14:11:57 -- target/discovery.sh@15 -- # hash nvme 00:07:43.340 14:11:57 -- target/discovery.sh@20 -- # nvmftestinit 00:07:43.340 14:11:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:43.340 14:11:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:43.340 14:11:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:43.340 14:11:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:43.340 14:11:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:43.340 14:11:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:43.340 14:11:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:43.340 14:11:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:43.340 14:11:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:43.340 14:11:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:43.340 14:11:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:43.340 14:11:57 -- common/autotest_common.sh@10 -- # set +x 00:07:48.613 14:12:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:48.613 14:12:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:48.613 14:12:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:48.613 14:12:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:48.613 14:12:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:48.613 14:12:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:48.613 14:12:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:48.613 14:12:03 -- nvmf/common.sh@294 -- # net_devs=() 00:07:48.613 14:12:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:48.613 14:12:03 -- nvmf/common.sh@295 -- # e810=() 00:07:48.613 14:12:03 -- nvmf/common.sh@295 -- # local -ga e810 00:07:48.613 14:12:03 -- nvmf/common.sh@296 -- # x722=() 00:07:48.613 14:12:03 -- nvmf/common.sh@296 -- # local -ga x722 00:07:48.613 14:12:03 -- nvmf/common.sh@297 -- # mlx=() 00:07:48.613 14:12:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:48.613 14:12:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:48.613 14:12:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:48.613 14:12:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:48.613 14:12:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:48.613 14:12:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.613 14:12:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:07:48.613 Found 0000:af:00.0 (0x8086 - 0x159b) 00:07:48.613 14:12:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:48.613 14:12:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:07:48.613 Found 0000:af:00.1 (0x8086 - 0x159b) 00:07:48.613 14:12:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:48.613 14:12:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.613 14:12:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.613 14:12:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.613 14:12:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.613 14:12:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:07:48.613 Found net devices under 0000:af:00.0: cvl_0_0 00:07:48.613 14:12:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.613 14:12:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:48.613 14:12:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:48.613 14:12:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:48.613 14:12:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:48.613 14:12:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:07:48.613 Found net devices under 0000:af:00.1: cvl_0_1 00:07:48.613 14:12:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:48.613 14:12:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:48.613 14:12:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:48.613 14:12:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:48.613 14:12:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:48.613 14:12:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:48.613 14:12:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:48.613 14:12:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:48.613 14:12:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:48.613 14:12:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:48.613 14:12:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:48.613 14:12:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:48.613 14:12:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:48.613 14:12:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:48.613 14:12:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:48.613 14:12:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:48.613 14:12:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:48.613 14:12:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:48.872 14:12:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:48.872 14:12:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:48.873 14:12:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:48.873 14:12:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:48.873 14:12:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:48.873 14:12:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:48.873 14:12:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:48.873 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:48.873 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.377 ms 00:07:48.873 00:07:48.873 --- 10.0.0.2 ping statistics --- 00:07:48.873 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.873 rtt min/avg/max/mdev = 0.377/0.377/0.377/0.000 ms 00:07:48.873 14:12:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:48.873 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:48.873 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.168 ms 00:07:48.873 00:07:48.873 --- 10.0.0.1 ping statistics --- 00:07:48.873 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:48.873 rtt min/avg/max/mdev = 0.168/0.168/0.168/0.000 ms 00:07:48.873 14:12:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:48.873 14:12:03 -- nvmf/common.sh@410 -- # return 0 00:07:48.873 14:12:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:48.873 14:12:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:48.873 14:12:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:48.873 14:12:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:48.873 14:12:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:48.873 14:12:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:48.873 14:12:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:48.873 14:12:03 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:07:48.873 14:12:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:48.873 14:12:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:48.873 14:12:03 -- common/autotest_common.sh@10 -- # set +x 00:07:48.873 14:12:03 -- nvmf/common.sh@469 -- # nvmfpid=236455 00:07:48.873 14:12:03 -- nvmf/common.sh@470 -- # waitforlisten 236455 00:07:48.873 14:12:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:48.873 14:12:03 -- common/autotest_common.sh@829 -- # '[' -z 236455 ']' 00:07:48.873 14:12:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.873 14:12:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:48.873 14:12:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.873 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.873 14:12:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:48.873 14:12:03 -- common/autotest_common.sh@10 -- # set +x 00:07:49.132 [2024-12-16 14:12:03.451173] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:49.132 [2024-12-16 14:12:03.451215] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:49.132 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.132 [2024-12-16 14:12:03.510199] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:49.132 [2024-12-16 14:12:03.587271] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:49.132 [2024-12-16 14:12:03.587379] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:49.132 [2024-12-16 14:12:03.587387] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:49.132 [2024-12-16 14:12:03.587393] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:49.132 [2024-12-16 14:12:03.587438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:49.132 [2024-12-16 14:12:03.587449] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:49.132 [2024-12-16 14:12:03.587547] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:49.132 [2024-12-16 14:12:03.587549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:49.699 14:12:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:49.699 14:12:04 -- common/autotest_common.sh@862 -- # return 0 00:07:49.699 14:12:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:49.958 14:12:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 14:12:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:49.958 14:12:04 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 [2024-12-16 14:12:04.312215] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@26 -- # seq 1 4 00:07:49.958 14:12:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:49.958 14:12:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 Null1 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 [2024-12-16 14:12:04.361583] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:49.958 14:12:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 Null2 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.958 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.958 14:12:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:49.958 14:12:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:07:49.958 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.958 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 Null3 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:07:49.959 14:12:04 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 Null4 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:07:49.959 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:49.959 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:49.959 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:49.959 14:12:04 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 4420 00:07:50.218 00:07:50.218 Discovery Log Number of Records 6, Generation counter 6 00:07:50.218 =====Discovery Log Entry 0====== 00:07:50.218 trtype: tcp 00:07:50.218 adrfam: ipv4 00:07:50.218 subtype: current discovery subsystem 00:07:50.218 treq: not required 00:07:50.218 portid: 0 00:07:50.218 trsvcid: 4420 00:07:50.218 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:50.218 traddr: 10.0.0.2 00:07:50.218 eflags: explicit discovery connections, duplicate discovery information 00:07:50.218 sectype: none 00:07:50.218 =====Discovery Log Entry 1====== 00:07:50.218 trtype: tcp 00:07:50.218 adrfam: ipv4 00:07:50.218 subtype: nvme subsystem 00:07:50.218 treq: not required 00:07:50.218 portid: 0 00:07:50.218 trsvcid: 4420 00:07:50.218 subnqn: nqn.2016-06.io.spdk:cnode1 00:07:50.218 traddr: 10.0.0.2 00:07:50.218 eflags: none 00:07:50.218 sectype: none 00:07:50.218 =====Discovery Log Entry 2====== 00:07:50.218 trtype: tcp 00:07:50.218 adrfam: ipv4 00:07:50.218 subtype: nvme subsystem 00:07:50.218 treq: not required 00:07:50.218 portid: 0 00:07:50.218 trsvcid: 4420 00:07:50.218 subnqn: nqn.2016-06.io.spdk:cnode2 00:07:50.218 traddr: 10.0.0.2 00:07:50.218 eflags: none 00:07:50.218 sectype: none 00:07:50.218 =====Discovery Log Entry 3====== 00:07:50.218 trtype: tcp 00:07:50.218 adrfam: ipv4 00:07:50.218 subtype: nvme subsystem 00:07:50.218 treq: not required 00:07:50.218 portid: 0 00:07:50.218 trsvcid: 4420 00:07:50.218 subnqn: nqn.2016-06.io.spdk:cnode3 00:07:50.218 traddr: 10.0.0.2 00:07:50.218 eflags: none 00:07:50.218 sectype: none 00:07:50.218 =====Discovery Log Entry 4====== 00:07:50.218 trtype: tcp 00:07:50.218 adrfam: ipv4 00:07:50.218 subtype: nvme subsystem 00:07:50.218 treq: not required 00:07:50.218 portid: 0 00:07:50.218 trsvcid: 4420 00:07:50.218 subnqn: nqn.2016-06.io.spdk:cnode4 00:07:50.218 traddr: 10.0.0.2 00:07:50.218 eflags: none 00:07:50.218 sectype: none 00:07:50.218 =====Discovery Log Entry 5====== 00:07:50.218 trtype: tcp 00:07:50.218 adrfam: ipv4 00:07:50.218 subtype: discovery subsystem referral 00:07:50.218 treq: not required 00:07:50.218 portid: 0 00:07:50.218 trsvcid: 4430 00:07:50.218 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:07:50.218 traddr: 10.0.0.2 00:07:50.218 eflags: none 00:07:50.218 sectype: none 00:07:50.218 14:12:04 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:07:50.218 Perform nvmf subsystem discovery via RPC 00:07:50.218 14:12:04 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:07:50.218 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.218 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.218 [2024-12-16 14:12:04.702642] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:07:50.218 [ 00:07:50.218 { 00:07:50.218 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:07:50.218 "subtype": "Discovery", 00:07:50.218 "listen_addresses": [ 00:07:50.218 { 00:07:50.218 "transport": "TCP", 00:07:50.218 "trtype": "TCP", 00:07:50.218 "adrfam": "IPv4", 00:07:50.218 "traddr": "10.0.0.2", 00:07:50.218 "trsvcid": "4420" 00:07:50.218 } 00:07:50.218 ], 00:07:50.218 "allow_any_host": true, 00:07:50.218 "hosts": [] 00:07:50.218 }, 00:07:50.218 { 00:07:50.218 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:07:50.218 "subtype": "NVMe", 00:07:50.218 "listen_addresses": [ 00:07:50.218 { 00:07:50.218 "transport": "TCP", 00:07:50.218 "trtype": "TCP", 00:07:50.218 "adrfam": "IPv4", 00:07:50.218 "traddr": "10.0.0.2", 00:07:50.218 "trsvcid": "4420" 00:07:50.218 } 00:07:50.218 ], 00:07:50.218 "allow_any_host": true, 00:07:50.218 "hosts": [], 00:07:50.218 "serial_number": "SPDK00000000000001", 00:07:50.218 "model_number": "SPDK bdev Controller", 00:07:50.218 "max_namespaces": 32, 00:07:50.218 "min_cntlid": 1, 00:07:50.218 "max_cntlid": 65519, 00:07:50.218 "namespaces": [ 00:07:50.218 { 00:07:50.218 "nsid": 1, 00:07:50.218 "bdev_name": "Null1", 00:07:50.218 "name": "Null1", 00:07:50.218 "nguid": "2AC61A12B1864ACFA68D5D515D942E20", 00:07:50.218 "uuid": "2ac61a12-b186-4acf-a68d-5d515d942e20" 00:07:50.218 } 00:07:50.218 ] 00:07:50.218 }, 00:07:50.218 { 00:07:50.218 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:07:50.218 "subtype": "NVMe", 00:07:50.218 "listen_addresses": [ 00:07:50.218 { 00:07:50.218 "transport": "TCP", 00:07:50.218 "trtype": "TCP", 00:07:50.218 "adrfam": "IPv4", 00:07:50.218 "traddr": "10.0.0.2", 00:07:50.218 "trsvcid": "4420" 00:07:50.218 } 00:07:50.218 ], 00:07:50.218 "allow_any_host": true, 00:07:50.218 "hosts": [], 00:07:50.218 "serial_number": "SPDK00000000000002", 00:07:50.218 "model_number": "SPDK bdev Controller", 00:07:50.218 "max_namespaces": 32, 00:07:50.218 "min_cntlid": 1, 00:07:50.218 "max_cntlid": 65519, 00:07:50.218 "namespaces": [ 00:07:50.218 { 00:07:50.218 "nsid": 1, 00:07:50.218 "bdev_name": "Null2", 00:07:50.218 "name": "Null2", 00:07:50.218 "nguid": "06502110CADA4EF1A232528C3F0FBA63", 00:07:50.218 "uuid": "06502110-cada-4ef1-a232-528c3f0fba63" 00:07:50.218 } 00:07:50.218 ] 00:07:50.218 }, 00:07:50.218 { 00:07:50.218 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:07:50.218 "subtype": "NVMe", 00:07:50.218 "listen_addresses": [ 00:07:50.218 { 00:07:50.218 "transport": "TCP", 00:07:50.218 "trtype": "TCP", 00:07:50.218 "adrfam": "IPv4", 00:07:50.219 "traddr": "10.0.0.2", 00:07:50.219 "trsvcid": "4420" 00:07:50.219 } 00:07:50.219 ], 00:07:50.219 "allow_any_host": true, 00:07:50.219 "hosts": [], 00:07:50.219 "serial_number": "SPDK00000000000003", 00:07:50.219 "model_number": "SPDK bdev Controller", 00:07:50.219 "max_namespaces": 32, 00:07:50.219 "min_cntlid": 1, 00:07:50.219 "max_cntlid": 65519, 00:07:50.219 "namespaces": [ 00:07:50.219 { 00:07:50.219 "nsid": 1, 00:07:50.219 "bdev_name": "Null3", 00:07:50.219 "name": "Null3", 00:07:50.219 "nguid": "0B59EC5371694CB4AA4956C4D9BD90EF", 00:07:50.219 "uuid": "0b59ec53-7169-4cb4-aa49-56c4d9bd90ef" 00:07:50.219 } 00:07:50.219 ] 00:07:50.219 }, 00:07:50.219 { 00:07:50.219 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:07:50.219 "subtype": "NVMe", 00:07:50.219 "listen_addresses": [ 00:07:50.219 { 00:07:50.219 "transport": "TCP", 00:07:50.219 "trtype": "TCP", 00:07:50.219 "adrfam": "IPv4", 00:07:50.219 "traddr": "10.0.0.2", 00:07:50.219 "trsvcid": "4420" 00:07:50.219 } 00:07:50.219 ], 00:07:50.219 "allow_any_host": true, 00:07:50.219 "hosts": [], 00:07:50.219 "serial_number": "SPDK00000000000004", 00:07:50.219 "model_number": "SPDK bdev Controller", 00:07:50.219 "max_namespaces": 32, 00:07:50.219 "min_cntlid": 1, 00:07:50.219 "max_cntlid": 65519, 00:07:50.219 "namespaces": [ 00:07:50.219 { 00:07:50.219 "nsid": 1, 00:07:50.219 "bdev_name": "Null4", 00:07:50.219 "name": "Null4", 00:07:50.219 "nguid": "80077AE3E5D642158E9A26FF5CF1F8C1", 00:07:50.219 "uuid": "80077ae3-e5d6-4215-8e9a-26ff5cf1f8c1" 00:07:50.219 } 00:07:50.219 ] 00:07:50.219 } 00:07:50.219 ] 00:07:50.219 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.219 14:12:04 -- target/discovery.sh@42 -- # seq 1 4 00:07:50.219 14:12:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:50.219 14:12:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:07:50.219 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.219 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.219 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.219 14:12:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:07:50.219 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.219 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.219 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.219 14:12:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:50.219 14:12:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:07:50.219 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.219 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.219 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.219 14:12:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:07:50.219 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.219 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.219 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.219 14:12:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:50.219 14:12:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:07:50.219 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.219 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.219 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.219 14:12:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:07:50.219 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.219 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.219 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.219 14:12:04 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:07:50.219 14:12:04 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:07:50.219 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.219 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.219 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.219 14:12:04 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:07:50.219 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.219 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.478 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.478 14:12:04 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:07:50.478 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.478 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.478 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.478 14:12:04 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:07:50.478 14:12:04 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:07:50.478 14:12:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.478 14:12:04 -- common/autotest_common.sh@10 -- # set +x 00:07:50.478 14:12:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.478 14:12:04 -- target/discovery.sh@49 -- # check_bdevs= 00:07:50.478 14:12:04 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:07:50.478 14:12:04 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:07:50.478 14:12:04 -- target/discovery.sh@57 -- # nvmftestfini 00:07:50.478 14:12:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:07:50.478 14:12:04 -- nvmf/common.sh@116 -- # sync 00:07:50.478 14:12:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:07:50.478 14:12:04 -- nvmf/common.sh@119 -- # set +e 00:07:50.478 14:12:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:07:50.478 14:12:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:07:50.478 rmmod nvme_tcp 00:07:50.478 rmmod nvme_fabrics 00:07:50.478 rmmod nvme_keyring 00:07:50.478 14:12:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:07:50.478 14:12:04 -- nvmf/common.sh@123 -- # set -e 00:07:50.478 14:12:04 -- nvmf/common.sh@124 -- # return 0 00:07:50.478 14:12:04 -- nvmf/common.sh@477 -- # '[' -n 236455 ']' 00:07:50.478 14:12:04 -- nvmf/common.sh@478 -- # killprocess 236455 00:07:50.478 14:12:04 -- common/autotest_common.sh@936 -- # '[' -z 236455 ']' 00:07:50.478 14:12:04 -- common/autotest_common.sh@940 -- # kill -0 236455 00:07:50.478 14:12:04 -- common/autotest_common.sh@941 -- # uname 00:07:50.478 14:12:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:50.478 14:12:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 236455 00:07:50.478 14:12:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:50.478 14:12:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:50.478 14:12:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 236455' 00:07:50.478 killing process with pid 236455 00:07:50.478 14:12:04 -- common/autotest_common.sh@955 -- # kill 236455 00:07:50.478 [2024-12-16 14:12:04.971699] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:07:50.478 14:12:04 -- common/autotest_common.sh@960 -- # wait 236455 00:07:50.737 14:12:05 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:07:50.737 14:12:05 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:07:50.737 14:12:05 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:07:50.737 14:12:05 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:07:50.737 14:12:05 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:07:50.737 14:12:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:50.737 14:12:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:50.737 14:12:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:53.275 14:12:07 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:07:53.275 00:07:53.275 real 0m9.561s 00:07:53.275 user 0m8.064s 00:07:53.275 sys 0m4.501s 00:07:53.275 14:12:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:53.275 14:12:07 -- common/autotest_common.sh@10 -- # set +x 00:07:53.275 ************************************ 00:07:53.275 END TEST nvmf_discovery 00:07:53.275 ************************************ 00:07:53.275 14:12:07 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:53.275 14:12:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:53.275 14:12:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:53.275 14:12:07 -- common/autotest_common.sh@10 -- # set +x 00:07:53.275 ************************************ 00:07:53.275 START TEST nvmf_referrals 00:07:53.275 ************************************ 00:07:53.275 14:12:07 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:07:53.275 * Looking for test storage... 00:07:53.275 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:53.275 14:12:07 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:53.275 14:12:07 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:53.275 14:12:07 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:53.275 14:12:07 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:53.275 14:12:07 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:53.275 14:12:07 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:53.275 14:12:07 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:53.275 14:12:07 -- scripts/common.sh@335 -- # IFS=.-: 00:07:53.275 14:12:07 -- scripts/common.sh@335 -- # read -ra ver1 00:07:53.275 14:12:07 -- scripts/common.sh@336 -- # IFS=.-: 00:07:53.275 14:12:07 -- scripts/common.sh@336 -- # read -ra ver2 00:07:53.275 14:12:07 -- scripts/common.sh@337 -- # local 'op=<' 00:07:53.275 14:12:07 -- scripts/common.sh@339 -- # ver1_l=2 00:07:53.275 14:12:07 -- scripts/common.sh@340 -- # ver2_l=1 00:07:53.275 14:12:07 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:53.275 14:12:07 -- scripts/common.sh@343 -- # case "$op" in 00:07:53.275 14:12:07 -- scripts/common.sh@344 -- # : 1 00:07:53.275 14:12:07 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:53.275 14:12:07 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:53.275 14:12:07 -- scripts/common.sh@364 -- # decimal 1 00:07:53.275 14:12:07 -- scripts/common.sh@352 -- # local d=1 00:07:53.275 14:12:07 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:53.275 14:12:07 -- scripts/common.sh@354 -- # echo 1 00:07:53.275 14:12:07 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:53.275 14:12:07 -- scripts/common.sh@365 -- # decimal 2 00:07:53.275 14:12:07 -- scripts/common.sh@352 -- # local d=2 00:07:53.275 14:12:07 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:53.275 14:12:07 -- scripts/common.sh@354 -- # echo 2 00:07:53.275 14:12:07 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:53.275 14:12:07 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:53.275 14:12:07 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:53.275 14:12:07 -- scripts/common.sh@367 -- # return 0 00:07:53.275 14:12:07 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:53.275 14:12:07 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:53.275 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.275 --rc genhtml_branch_coverage=1 00:07:53.275 --rc genhtml_function_coverage=1 00:07:53.275 --rc genhtml_legend=1 00:07:53.275 --rc geninfo_all_blocks=1 00:07:53.275 --rc geninfo_unexecuted_blocks=1 00:07:53.275 00:07:53.275 ' 00:07:53.275 14:12:07 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:53.275 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.275 --rc genhtml_branch_coverage=1 00:07:53.275 --rc genhtml_function_coverage=1 00:07:53.275 --rc genhtml_legend=1 00:07:53.275 --rc geninfo_all_blocks=1 00:07:53.275 --rc geninfo_unexecuted_blocks=1 00:07:53.275 00:07:53.275 ' 00:07:53.275 14:12:07 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:53.275 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.275 --rc genhtml_branch_coverage=1 00:07:53.275 --rc genhtml_function_coverage=1 00:07:53.275 --rc genhtml_legend=1 00:07:53.275 --rc geninfo_all_blocks=1 00:07:53.275 --rc geninfo_unexecuted_blocks=1 00:07:53.275 00:07:53.275 ' 00:07:53.275 14:12:07 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:53.275 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:53.275 --rc genhtml_branch_coverage=1 00:07:53.275 --rc genhtml_function_coverage=1 00:07:53.275 --rc genhtml_legend=1 00:07:53.275 --rc geninfo_all_blocks=1 00:07:53.275 --rc geninfo_unexecuted_blocks=1 00:07:53.275 00:07:53.275 ' 00:07:53.275 14:12:07 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:53.275 14:12:07 -- nvmf/common.sh@7 -- # uname -s 00:07:53.275 14:12:07 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:53.275 14:12:07 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:53.275 14:12:07 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:53.275 14:12:07 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:53.275 14:12:07 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:53.275 14:12:07 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:53.275 14:12:07 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:53.275 14:12:07 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:53.275 14:12:07 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:53.275 14:12:07 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:53.275 14:12:07 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:07:53.275 14:12:07 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:07:53.275 14:12:07 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:53.275 14:12:07 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:53.275 14:12:07 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:53.275 14:12:07 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:53.275 14:12:07 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:53.275 14:12:07 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:53.275 14:12:07 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:53.275 14:12:07 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.275 14:12:07 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.275 14:12:07 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.276 14:12:07 -- paths/export.sh@5 -- # export PATH 00:07:53.276 14:12:07 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:53.276 14:12:07 -- nvmf/common.sh@46 -- # : 0 00:07:53.276 14:12:07 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:53.276 14:12:07 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:53.276 14:12:07 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:53.276 14:12:07 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:53.276 14:12:07 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:53.276 14:12:07 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:53.276 14:12:07 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:53.276 14:12:07 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:53.276 14:12:07 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:07:53.276 14:12:07 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:07:53.276 14:12:07 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:07:53.276 14:12:07 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:07:53.276 14:12:07 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:07:53.276 14:12:07 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:07:53.276 14:12:07 -- target/referrals.sh@37 -- # nvmftestinit 00:07:53.276 14:12:07 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:53.276 14:12:07 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:53.276 14:12:07 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:53.276 14:12:07 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:53.276 14:12:07 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:53.276 14:12:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:53.276 14:12:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:53.276 14:12:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:53.276 14:12:07 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:53.276 14:12:07 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:53.276 14:12:07 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:53.276 14:12:07 -- common/autotest_common.sh@10 -- # set +x 00:07:58.545 14:12:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:58.545 14:12:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:58.545 14:12:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:58.545 14:12:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:58.545 14:12:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:58.545 14:12:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:58.545 14:12:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:58.545 14:12:12 -- nvmf/common.sh@294 -- # net_devs=() 00:07:58.545 14:12:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:58.545 14:12:12 -- nvmf/common.sh@295 -- # e810=() 00:07:58.545 14:12:12 -- nvmf/common.sh@295 -- # local -ga e810 00:07:58.545 14:12:12 -- nvmf/common.sh@296 -- # x722=() 00:07:58.545 14:12:12 -- nvmf/common.sh@296 -- # local -ga x722 00:07:58.545 14:12:12 -- nvmf/common.sh@297 -- # mlx=() 00:07:58.545 14:12:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:58.545 14:12:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:58.545 14:12:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:58.545 14:12:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:58.545 14:12:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:58.545 14:12:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:58.545 14:12:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:07:58.545 Found 0000:af:00.0 (0x8086 - 0x159b) 00:07:58.545 14:12:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:58.545 14:12:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:07:58.545 Found 0000:af:00.1 (0x8086 - 0x159b) 00:07:58.545 14:12:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:58.545 14:12:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:58.545 14:12:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:58.545 14:12:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:58.545 14:12:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:58.545 14:12:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:07:58.545 Found net devices under 0000:af:00.0: cvl_0_0 00:07:58.545 14:12:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:58.545 14:12:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:58.545 14:12:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:58.545 14:12:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:58.545 14:12:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:58.545 14:12:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:07:58.545 Found net devices under 0000:af:00.1: cvl_0_1 00:07:58.545 14:12:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:58.545 14:12:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:58.545 14:12:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:58.545 14:12:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:58.545 14:12:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:58.545 14:12:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:58.545 14:12:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:58.545 14:12:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:58.545 14:12:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:58.545 14:12:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:58.545 14:12:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:58.545 14:12:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:58.545 14:12:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:58.545 14:12:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:58.545 14:12:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:58.545 14:12:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:58.545 14:12:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:58.545 14:12:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:58.545 14:12:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:58.545 14:12:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:58.545 14:12:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:58.545 14:12:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:58.545 14:12:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:58.545 14:12:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:58.545 14:12:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:58.545 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:58.545 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.347 ms 00:07:58.545 00:07:58.545 --- 10.0.0.2 ping statistics --- 00:07:58.545 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:58.545 rtt min/avg/max/mdev = 0.347/0.347/0.347/0.000 ms 00:07:58.545 14:12:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:58.545 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:58.545 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.238 ms 00:07:58.545 00:07:58.545 --- 10.0.0.1 ping statistics --- 00:07:58.545 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:58.545 rtt min/avg/max/mdev = 0.238/0.238/0.238/0.000 ms 00:07:58.545 14:12:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:58.546 14:12:12 -- nvmf/common.sh@410 -- # return 0 00:07:58.546 14:12:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:58.546 14:12:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:58.546 14:12:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:58.546 14:12:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:58.546 14:12:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:58.546 14:12:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:58.546 14:12:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:58.546 14:12:12 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:07:58.546 14:12:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:07:58.546 14:12:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:58.546 14:12:12 -- common/autotest_common.sh@10 -- # set +x 00:07:58.546 14:12:12 -- nvmf/common.sh@469 -- # nvmfpid=240532 00:07:58.546 14:12:12 -- nvmf/common.sh@470 -- # waitforlisten 240532 00:07:58.546 14:12:12 -- common/autotest_common.sh@829 -- # '[' -z 240532 ']' 00:07:58.546 14:12:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:58.546 14:12:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:58.546 14:12:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:58.546 14:12:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:07:58.546 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:58.546 14:12:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:58.546 14:12:12 -- common/autotest_common.sh@10 -- # set +x 00:07:58.546 [2024-12-16 14:12:12.787869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:58.546 [2024-12-16 14:12:12.787913] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:07:58.546 EAL: No free 2048 kB hugepages reported on node 1 00:07:58.546 [2024-12-16 14:12:12.846795] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:58.546 [2024-12-16 14:12:12.922942] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:58.546 [2024-12-16 14:12:12.923046] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:07:58.546 [2024-12-16 14:12:12.923054] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:07:58.546 [2024-12-16 14:12:12.923060] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:07:58.546 [2024-12-16 14:12:12.923104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:58.546 [2024-12-16 14:12:12.923234] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:58.546 [2024-12-16 14:12:12.923256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:58.546 [2024-12-16 14:12:12.923256] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:59.113 14:12:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:59.113 14:12:13 -- common/autotest_common.sh@862 -- # return 0 00:07:59.113 14:12:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:07:59.113 14:12:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:59.113 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.113 14:12:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:07:59.113 14:12:13 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:59.113 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.113 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.113 [2024-12-16 14:12:13.646178] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:07:59.113 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.113 14:12:13 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:07:59.113 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.113 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.113 [2024-12-16 14:12:13.659449] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:07:59.113 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.113 14:12:13 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:07:59.113 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.113 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.113 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.113 14:12:13 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:07:59.113 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.113 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.113 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.113 14:12:13 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:07:59.113 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.113 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.372 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.372 14:12:13 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:59.372 14:12:13 -- target/referrals.sh@48 -- # jq length 00:07:59.372 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.372 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.372 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.372 14:12:13 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:07:59.372 14:12:13 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:07:59.372 14:12:13 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:59.372 14:12:13 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:59.372 14:12:13 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:59.372 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.372 14:12:13 -- target/referrals.sh@21 -- # sort 00:07:59.372 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.372 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.372 14:12:13 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:59.372 14:12:13 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:59.372 14:12:13 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:07:59.372 14:12:13 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:59.372 14:12:13 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:59.372 14:12:13 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:59.372 14:12:13 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:59.372 14:12:13 -- target/referrals.sh@26 -- # sort 00:07:59.631 14:12:13 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:07:59.631 14:12:13 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:07:59.631 14:12:13 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:07:59.631 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.631 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.631 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.631 14:12:13 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:07:59.631 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.631 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.631 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.631 14:12:13 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:07:59.631 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.631 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.631 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.631 14:12:13 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:59.632 14:12:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.632 14:12:13 -- common/autotest_common.sh@10 -- # set +x 00:07:59.632 14:12:13 -- target/referrals.sh@56 -- # jq length 00:07:59.632 14:12:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.632 14:12:14 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:07:59.632 14:12:14 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:07:59.632 14:12:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:59.632 14:12:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:59.632 14:12:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:59.632 14:12:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:59.632 14:12:14 -- target/referrals.sh@26 -- # sort 00:07:59.632 14:12:14 -- target/referrals.sh@26 -- # echo 00:07:59.632 14:12:14 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:07:59.891 14:12:14 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:07:59.891 14:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.891 14:12:14 -- common/autotest_common.sh@10 -- # set +x 00:07:59.891 14:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.891 14:12:14 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:07:59.891 14:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.891 14:12:14 -- common/autotest_common.sh@10 -- # set +x 00:07:59.891 14:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.891 14:12:14 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:07:59.891 14:12:14 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:07:59.891 14:12:14 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:07:59.891 14:12:14 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:07:59.891 14:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:59.891 14:12:14 -- target/referrals.sh@21 -- # sort 00:07:59.891 14:12:14 -- common/autotest_common.sh@10 -- # set +x 00:07:59.891 14:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:59.891 14:12:14 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:07:59.891 14:12:14 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:59.891 14:12:14 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:07:59.891 14:12:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:07:59.891 14:12:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:07:59.891 14:12:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:59.891 14:12:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:07:59.891 14:12:14 -- target/referrals.sh@26 -- # sort 00:07:59.891 14:12:14 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:07:59.891 14:12:14 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:07:59.891 14:12:14 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:07:59.891 14:12:14 -- target/referrals.sh@67 -- # jq -r .subnqn 00:07:59.891 14:12:14 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:07:59.891 14:12:14 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:07:59.891 14:12:14 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:00.150 14:12:14 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:00.150 14:12:14 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:00.150 14:12:14 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:00.150 14:12:14 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:00.150 14:12:14 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:00.150 14:12:14 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:00.409 14:12:14 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:00.409 14:12:14 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:00.409 14:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.409 14:12:14 -- common/autotest_common.sh@10 -- # set +x 00:08:00.409 14:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.409 14:12:14 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:00.409 14:12:14 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:00.409 14:12:14 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:00.409 14:12:14 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:00.409 14:12:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.409 14:12:14 -- target/referrals.sh@21 -- # sort 00:08:00.409 14:12:14 -- common/autotest_common.sh@10 -- # set +x 00:08:00.409 14:12:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.409 14:12:14 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:00.409 14:12:14 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:00.409 14:12:14 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:00.409 14:12:14 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:00.409 14:12:14 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:00.409 14:12:14 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:00.409 14:12:14 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:00.409 14:12:14 -- target/referrals.sh@26 -- # sort 00:08:00.668 14:12:15 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:00.668 14:12:15 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:00.668 14:12:15 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:00.668 14:12:15 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:00.668 14:12:15 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:00.668 14:12:15 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:00.668 14:12:15 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:00.668 14:12:15 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:00.668 14:12:15 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:00.668 14:12:15 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:00.668 14:12:15 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:00.668 14:12:15 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:00.668 14:12:15 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:00.927 14:12:15 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:00.927 14:12:15 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:00.927 14:12:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.927 14:12:15 -- common/autotest_common.sh@10 -- # set +x 00:08:00.927 14:12:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.927 14:12:15 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:00.927 14:12:15 -- target/referrals.sh@82 -- # jq length 00:08:00.927 14:12:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:00.927 14:12:15 -- common/autotest_common.sh@10 -- # set +x 00:08:00.927 14:12:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:00.927 14:12:15 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:00.927 14:12:15 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:00.927 14:12:15 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:00.927 14:12:15 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:00.927 14:12:15 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:00.927 14:12:15 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:00.927 14:12:15 -- target/referrals.sh@26 -- # sort 00:08:01.185 14:12:15 -- target/referrals.sh@26 -- # echo 00:08:01.185 14:12:15 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:01.185 14:12:15 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:01.185 14:12:15 -- target/referrals.sh@86 -- # nvmftestfini 00:08:01.185 14:12:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:01.185 14:12:15 -- nvmf/common.sh@116 -- # sync 00:08:01.185 14:12:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:01.185 14:12:15 -- nvmf/common.sh@119 -- # set +e 00:08:01.185 14:12:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:01.185 14:12:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:01.185 rmmod nvme_tcp 00:08:01.185 rmmod nvme_fabrics 00:08:01.185 rmmod nvme_keyring 00:08:01.185 14:12:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:01.185 14:12:15 -- nvmf/common.sh@123 -- # set -e 00:08:01.185 14:12:15 -- nvmf/common.sh@124 -- # return 0 00:08:01.185 14:12:15 -- nvmf/common.sh@477 -- # '[' -n 240532 ']' 00:08:01.185 14:12:15 -- nvmf/common.sh@478 -- # killprocess 240532 00:08:01.185 14:12:15 -- common/autotest_common.sh@936 -- # '[' -z 240532 ']' 00:08:01.185 14:12:15 -- common/autotest_common.sh@940 -- # kill -0 240532 00:08:01.185 14:12:15 -- common/autotest_common.sh@941 -- # uname 00:08:01.185 14:12:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:01.185 14:12:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 240532 00:08:01.444 14:12:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:01.444 14:12:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:01.444 14:12:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 240532' 00:08:01.444 killing process with pid 240532 00:08:01.444 14:12:15 -- common/autotest_common.sh@955 -- # kill 240532 00:08:01.444 14:12:15 -- common/autotest_common.sh@960 -- # wait 240532 00:08:01.444 14:12:15 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:01.444 14:12:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:01.444 14:12:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:01.444 14:12:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:01.444 14:12:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:01.444 14:12:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:01.444 14:12:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:01.444 14:12:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:03.980 14:12:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:03.980 00:08:03.980 real 0m10.774s 00:08:03.980 user 0m14.588s 00:08:03.980 sys 0m4.662s 00:08:03.980 14:12:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:03.980 14:12:18 -- common/autotest_common.sh@10 -- # set +x 00:08:03.980 ************************************ 00:08:03.980 END TEST nvmf_referrals 00:08:03.980 ************************************ 00:08:03.980 14:12:18 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:03.980 14:12:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:03.980 14:12:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:03.980 14:12:18 -- common/autotest_common.sh@10 -- # set +x 00:08:03.980 ************************************ 00:08:03.980 START TEST nvmf_connect_disconnect 00:08:03.980 ************************************ 00:08:03.980 14:12:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:08:03.980 * Looking for test storage... 00:08:03.980 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:03.980 14:12:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:03.980 14:12:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:03.980 14:12:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:03.980 14:12:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:03.980 14:12:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:03.980 14:12:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:03.980 14:12:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:03.980 14:12:18 -- scripts/common.sh@335 -- # IFS=.-: 00:08:03.980 14:12:18 -- scripts/common.sh@335 -- # read -ra ver1 00:08:03.980 14:12:18 -- scripts/common.sh@336 -- # IFS=.-: 00:08:03.980 14:12:18 -- scripts/common.sh@336 -- # read -ra ver2 00:08:03.980 14:12:18 -- scripts/common.sh@337 -- # local 'op=<' 00:08:03.980 14:12:18 -- scripts/common.sh@339 -- # ver1_l=2 00:08:03.980 14:12:18 -- scripts/common.sh@340 -- # ver2_l=1 00:08:03.980 14:12:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:03.980 14:12:18 -- scripts/common.sh@343 -- # case "$op" in 00:08:03.980 14:12:18 -- scripts/common.sh@344 -- # : 1 00:08:03.980 14:12:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:03.980 14:12:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:03.980 14:12:18 -- scripts/common.sh@364 -- # decimal 1 00:08:03.980 14:12:18 -- scripts/common.sh@352 -- # local d=1 00:08:03.980 14:12:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:03.980 14:12:18 -- scripts/common.sh@354 -- # echo 1 00:08:03.980 14:12:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:03.980 14:12:18 -- scripts/common.sh@365 -- # decimal 2 00:08:03.980 14:12:18 -- scripts/common.sh@352 -- # local d=2 00:08:03.980 14:12:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:03.980 14:12:18 -- scripts/common.sh@354 -- # echo 2 00:08:03.980 14:12:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:03.980 14:12:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:03.980 14:12:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:03.980 14:12:18 -- scripts/common.sh@367 -- # return 0 00:08:03.980 14:12:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:03.980 14:12:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:03.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.980 --rc genhtml_branch_coverage=1 00:08:03.980 --rc genhtml_function_coverage=1 00:08:03.980 --rc genhtml_legend=1 00:08:03.980 --rc geninfo_all_blocks=1 00:08:03.980 --rc geninfo_unexecuted_blocks=1 00:08:03.980 00:08:03.980 ' 00:08:03.980 14:12:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:03.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.980 --rc genhtml_branch_coverage=1 00:08:03.980 --rc genhtml_function_coverage=1 00:08:03.980 --rc genhtml_legend=1 00:08:03.980 --rc geninfo_all_blocks=1 00:08:03.980 --rc geninfo_unexecuted_blocks=1 00:08:03.980 00:08:03.980 ' 00:08:03.980 14:12:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:03.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.980 --rc genhtml_branch_coverage=1 00:08:03.980 --rc genhtml_function_coverage=1 00:08:03.980 --rc genhtml_legend=1 00:08:03.980 --rc geninfo_all_blocks=1 00:08:03.980 --rc geninfo_unexecuted_blocks=1 00:08:03.980 00:08:03.980 ' 00:08:03.980 14:12:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:03.980 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:03.980 --rc genhtml_branch_coverage=1 00:08:03.980 --rc genhtml_function_coverage=1 00:08:03.980 --rc genhtml_legend=1 00:08:03.980 --rc geninfo_all_blocks=1 00:08:03.980 --rc geninfo_unexecuted_blocks=1 00:08:03.980 00:08:03.980 ' 00:08:03.980 14:12:18 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:03.980 14:12:18 -- nvmf/common.sh@7 -- # uname -s 00:08:03.980 14:12:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:03.980 14:12:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:03.980 14:12:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:03.980 14:12:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:03.980 14:12:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:03.980 14:12:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:03.980 14:12:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:03.980 14:12:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:03.980 14:12:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:03.980 14:12:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:03.980 14:12:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:08:03.980 14:12:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:08:03.980 14:12:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:03.980 14:12:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:03.980 14:12:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:03.980 14:12:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:03.980 14:12:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:03.980 14:12:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:03.980 14:12:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:03.980 14:12:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.980 14:12:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.980 14:12:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.980 14:12:18 -- paths/export.sh@5 -- # export PATH 00:08:03.980 14:12:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:03.980 14:12:18 -- nvmf/common.sh@46 -- # : 0 00:08:03.980 14:12:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:03.980 14:12:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:03.980 14:12:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:03.980 14:12:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:03.980 14:12:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:03.980 14:12:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:03.980 14:12:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:03.980 14:12:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:03.980 14:12:18 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:08:03.980 14:12:18 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:08:03.980 14:12:18 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:08:03.980 14:12:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:03.980 14:12:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:03.980 14:12:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:03.980 14:12:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:03.980 14:12:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:03.980 14:12:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:03.980 14:12:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:03.980 14:12:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:03.980 14:12:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:03.980 14:12:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:03.980 14:12:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:03.980 14:12:18 -- common/autotest_common.sh@10 -- # set +x 00:08:09.380 14:12:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:09.380 14:12:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:09.380 14:12:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:09.380 14:12:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:09.380 14:12:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:09.380 14:12:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:09.380 14:12:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:09.380 14:12:23 -- nvmf/common.sh@294 -- # net_devs=() 00:08:09.380 14:12:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:09.380 14:12:23 -- nvmf/common.sh@295 -- # e810=() 00:08:09.380 14:12:23 -- nvmf/common.sh@295 -- # local -ga e810 00:08:09.380 14:12:23 -- nvmf/common.sh@296 -- # x722=() 00:08:09.380 14:12:23 -- nvmf/common.sh@296 -- # local -ga x722 00:08:09.380 14:12:23 -- nvmf/common.sh@297 -- # mlx=() 00:08:09.380 14:12:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:09.380 14:12:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:09.380 14:12:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:09.380 14:12:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:09.380 14:12:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:09.380 14:12:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:09.380 14:12:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:08:09.380 Found 0000:af:00.0 (0x8086 - 0x159b) 00:08:09.380 14:12:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:09.380 14:12:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:08:09.380 Found 0000:af:00.1 (0x8086 - 0x159b) 00:08:09.380 14:12:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:09.380 14:12:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:09.380 14:12:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:09.380 14:12:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:09.380 14:12:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:09.380 14:12:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:09.380 14:12:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:08:09.380 Found net devices under 0000:af:00.0: cvl_0_0 00:08:09.381 14:12:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:09.381 14:12:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:09.381 14:12:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:09.381 14:12:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:09.381 14:12:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:09.381 14:12:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:08:09.381 Found net devices under 0000:af:00.1: cvl_0_1 00:08:09.381 14:12:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:09.381 14:12:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:09.381 14:12:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:09.381 14:12:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:09.381 14:12:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:09.381 14:12:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:09.381 14:12:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:09.381 14:12:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:09.381 14:12:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:09.381 14:12:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:09.381 14:12:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:09.381 14:12:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:09.381 14:12:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:09.381 14:12:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:09.381 14:12:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:09.381 14:12:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:09.381 14:12:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:09.381 14:12:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:09.381 14:12:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:09.381 14:12:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:09.381 14:12:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:09.381 14:12:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:09.381 14:12:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:09.381 14:12:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:09.381 14:12:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:09.381 14:12:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:09.381 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:09.381 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.398 ms 00:08:09.381 00:08:09.381 --- 10.0.0.2 ping statistics --- 00:08:09.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:09.381 rtt min/avg/max/mdev = 0.398/0.398/0.398/0.000 ms 00:08:09.381 14:12:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:09.381 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:09.381 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.201 ms 00:08:09.381 00:08:09.381 --- 10.0.0.1 ping statistics --- 00:08:09.381 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:09.381 rtt min/avg/max/mdev = 0.201/0.201/0.201/0.000 ms 00:08:09.381 14:12:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:09.381 14:12:23 -- nvmf/common.sh@410 -- # return 0 00:08:09.381 14:12:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:09.381 14:12:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:09.381 14:12:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:09.381 14:12:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:09.381 14:12:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:09.381 14:12:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:09.381 14:12:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:09.381 14:12:23 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:08:09.381 14:12:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:09.381 14:12:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:09.381 14:12:23 -- common/autotest_common.sh@10 -- # set +x 00:08:09.381 14:12:23 -- nvmf/common.sh@469 -- # nvmfpid=244576 00:08:09.381 14:12:23 -- nvmf/common.sh@470 -- # waitforlisten 244576 00:08:09.381 14:12:23 -- common/autotest_common.sh@829 -- # '[' -z 244576 ']' 00:08:09.381 14:12:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:09.381 14:12:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:09.381 14:12:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:09.381 14:12:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:09.381 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:09.381 14:12:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:09.381 14:12:23 -- common/autotest_common.sh@10 -- # set +x 00:08:09.381 [2024-12-16 14:12:23.629913] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:09.381 [2024-12-16 14:12:23.629955] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:09.381 EAL: No free 2048 kB hugepages reported on node 1 00:08:09.381 [2024-12-16 14:12:23.688230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:09.381 [2024-12-16 14:12:23.765478] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:09.381 [2024-12-16 14:12:23.765586] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:09.381 [2024-12-16 14:12:23.765594] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:09.381 [2024-12-16 14:12:23.765600] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:09.381 [2024-12-16 14:12:23.765646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:09.381 [2024-12-16 14:12:23.765746] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:09.381 [2024-12-16 14:12:23.765766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:09.381 [2024-12-16 14:12:23.765767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:09.949 14:12:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:09.949 14:12:24 -- common/autotest_common.sh@862 -- # return 0 00:08:09.949 14:12:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:09.949 14:12:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:09.949 14:12:24 -- common/autotest_common.sh@10 -- # set +x 00:08:09.949 14:12:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:09.949 14:12:24 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:09.949 14:12:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.949 14:12:24 -- common/autotest_common.sh@10 -- # set +x 00:08:09.949 [2024-12-16 14:12:24.491195] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:09.949 14:12:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:09.949 14:12:24 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:08:09.949 14:12:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.949 14:12:24 -- common/autotest_common.sh@10 -- # set +x 00:08:09.949 14:12:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:09.949 14:12:24 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:08:09.949 14:12:24 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:09.949 14:12:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:09.949 14:12:24 -- common/autotest_common.sh@10 -- # set +x 00:08:10.209 14:12:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:10.209 14:12:24 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:08:10.209 14:12:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:10.209 14:12:24 -- common/autotest_common.sh@10 -- # set +x 00:08:10.209 14:12:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:10.209 14:12:24 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:10.209 14:12:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:10.209 14:12:24 -- common/autotest_common.sh@10 -- # set +x 00:08:10.209 [2024-12-16 14:12:24.542772] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:10.209 14:12:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:10.209 14:12:24 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:08:10.209 14:12:24 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:08:10.209 14:12:24 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:08:10.209 14:12:24 -- target/connect_disconnect.sh@34 -- # set +x 00:08:12.744 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:14.648 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:17.183 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:19.717 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:21.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:24.161 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:26.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:28.601 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:31.134 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:33.038 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:35.571 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:38.106 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:40.647 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:42.553 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.087 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:46.998 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:49.531 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:52.064 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:53.968 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:56.502 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:59.037 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:01.571 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:03.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:06.089 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:08.054 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.589 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.122 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.027 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.563 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.097 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.002 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.537 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:27.071 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:28.975 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.518 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:34.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:35.958 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.396 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:42.929 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.466 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.372 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:49.909 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.445 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.352 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:56.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:58.796 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.334 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:03.870 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.026 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:07.935 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:10.614 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.147 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:15.053 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:17.590 [2024-12-16 14:14:31.926836] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bddd90 is same with the state(5) to be set 00:10:17.590 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.120 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:22.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:24.550 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.079 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:28.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.510 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:33.411 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:35.942 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.472 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.003 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:42.943 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.544 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:47.450 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:49.981 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.513 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:54.418 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:56.952 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:59.486 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.019 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:03.923 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.454 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:08.357 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:10.889 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.424 [2024-12-16 14:15:27.486645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1bddd90 is same with the state(5) to be set 00:11:13.424 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:15.329 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:17.865 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.399 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:22.303 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:24.838 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:26.743 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:29.277 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:31.382 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:33.921 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:36.458 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:38.365 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:40.902 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:43.439 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:45.347 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:47.883 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:49.790 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:52.326 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:54.862 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:56.767 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:59.303 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:01.465 14:16:15 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:01.465 14:16:15 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:01.465 14:16:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:01.465 14:16:15 -- nvmf/common.sh@116 -- # sync 00:12:01.465 14:16:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:01.465 14:16:15 -- nvmf/common.sh@119 -- # set +e 00:12:01.465 14:16:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:01.465 14:16:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:01.465 rmmod nvme_tcp 00:12:01.465 rmmod nvme_fabrics 00:12:01.465 rmmod nvme_keyring 00:12:01.465 14:16:15 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:01.465 14:16:15 -- nvmf/common.sh@123 -- # set -e 00:12:01.465 14:16:15 -- nvmf/common.sh@124 -- # return 0 00:12:01.465 14:16:15 -- nvmf/common.sh@477 -- # '[' -n 244576 ']' 00:12:01.465 14:16:15 -- nvmf/common.sh@478 -- # killprocess 244576 00:12:01.466 14:16:15 -- common/autotest_common.sh@936 -- # '[' -z 244576 ']' 00:12:01.466 14:16:15 -- common/autotest_common.sh@940 -- # kill -0 244576 00:12:01.466 14:16:15 -- common/autotest_common.sh@941 -- # uname 00:12:01.466 14:16:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:01.466 14:16:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 244576 00:12:01.466 14:16:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:01.466 14:16:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:01.466 14:16:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 244576' 00:12:01.466 killing process with pid 244576 00:12:01.466 14:16:15 -- common/autotest_common.sh@955 -- # kill 244576 00:12:01.466 14:16:15 -- common/autotest_common.sh@960 -- # wait 244576 00:12:01.725 14:16:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:01.725 14:16:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:01.725 14:16:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:01.725 14:16:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:01.725 14:16:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:01.725 14:16:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:01.725 14:16:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:01.725 14:16:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:03.631 14:16:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:03.631 00:12:03.631 real 4m0.088s 00:12:03.631 user 15m19.755s 00:12:03.631 sys 0m23.987s 00:12:03.631 14:16:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:03.631 14:16:18 -- common/autotest_common.sh@10 -- # set +x 00:12:03.631 ************************************ 00:12:03.631 END TEST nvmf_connect_disconnect 00:12:03.631 ************************************ 00:12:03.890 14:16:18 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:03.890 14:16:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:03.890 14:16:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:03.890 14:16:18 -- common/autotest_common.sh@10 -- # set +x 00:12:03.890 ************************************ 00:12:03.890 START TEST nvmf_multitarget 00:12:03.890 ************************************ 00:12:03.890 14:16:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:12:03.890 * Looking for test storage... 00:12:03.890 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:03.890 14:16:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:03.891 14:16:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:03.891 14:16:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:03.891 14:16:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:03.891 14:16:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:03.891 14:16:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:03.891 14:16:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:03.891 14:16:18 -- scripts/common.sh@335 -- # IFS=.-: 00:12:03.891 14:16:18 -- scripts/common.sh@335 -- # read -ra ver1 00:12:03.891 14:16:18 -- scripts/common.sh@336 -- # IFS=.-: 00:12:03.891 14:16:18 -- scripts/common.sh@336 -- # read -ra ver2 00:12:03.891 14:16:18 -- scripts/common.sh@337 -- # local 'op=<' 00:12:03.891 14:16:18 -- scripts/common.sh@339 -- # ver1_l=2 00:12:03.891 14:16:18 -- scripts/common.sh@340 -- # ver2_l=1 00:12:03.891 14:16:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:03.891 14:16:18 -- scripts/common.sh@343 -- # case "$op" in 00:12:03.891 14:16:18 -- scripts/common.sh@344 -- # : 1 00:12:03.891 14:16:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:03.891 14:16:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:03.891 14:16:18 -- scripts/common.sh@364 -- # decimal 1 00:12:03.891 14:16:18 -- scripts/common.sh@352 -- # local d=1 00:12:03.891 14:16:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:03.891 14:16:18 -- scripts/common.sh@354 -- # echo 1 00:12:03.891 14:16:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:03.891 14:16:18 -- scripts/common.sh@365 -- # decimal 2 00:12:03.891 14:16:18 -- scripts/common.sh@352 -- # local d=2 00:12:03.891 14:16:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:03.891 14:16:18 -- scripts/common.sh@354 -- # echo 2 00:12:03.891 14:16:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:03.891 14:16:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:03.891 14:16:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:03.891 14:16:18 -- scripts/common.sh@367 -- # return 0 00:12:03.891 14:16:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:03.891 14:16:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:03.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:03.891 --rc genhtml_branch_coverage=1 00:12:03.891 --rc genhtml_function_coverage=1 00:12:03.891 --rc genhtml_legend=1 00:12:03.891 --rc geninfo_all_blocks=1 00:12:03.891 --rc geninfo_unexecuted_blocks=1 00:12:03.891 00:12:03.891 ' 00:12:03.891 14:16:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:03.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:03.891 --rc genhtml_branch_coverage=1 00:12:03.891 --rc genhtml_function_coverage=1 00:12:03.891 --rc genhtml_legend=1 00:12:03.891 --rc geninfo_all_blocks=1 00:12:03.891 --rc geninfo_unexecuted_blocks=1 00:12:03.891 00:12:03.891 ' 00:12:03.891 14:16:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:03.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:03.891 --rc genhtml_branch_coverage=1 00:12:03.891 --rc genhtml_function_coverage=1 00:12:03.891 --rc genhtml_legend=1 00:12:03.891 --rc geninfo_all_blocks=1 00:12:03.891 --rc geninfo_unexecuted_blocks=1 00:12:03.891 00:12:03.891 ' 00:12:03.891 14:16:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:03.891 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:03.891 --rc genhtml_branch_coverage=1 00:12:03.891 --rc genhtml_function_coverage=1 00:12:03.891 --rc genhtml_legend=1 00:12:03.891 --rc geninfo_all_blocks=1 00:12:03.891 --rc geninfo_unexecuted_blocks=1 00:12:03.891 00:12:03.891 ' 00:12:03.891 14:16:18 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:03.891 14:16:18 -- nvmf/common.sh@7 -- # uname -s 00:12:03.891 14:16:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:03.891 14:16:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:03.891 14:16:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:03.891 14:16:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:03.891 14:16:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:03.891 14:16:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:03.891 14:16:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:03.891 14:16:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:03.891 14:16:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:03.891 14:16:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:03.891 14:16:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:12:03.891 14:16:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:12:03.891 14:16:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:03.891 14:16:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:03.891 14:16:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:03.891 14:16:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:03.891 14:16:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:03.891 14:16:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:03.891 14:16:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:03.891 14:16:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:03.891 14:16:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:03.891 14:16:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:03.891 14:16:18 -- paths/export.sh@5 -- # export PATH 00:12:03.891 14:16:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:03.891 14:16:18 -- nvmf/common.sh@46 -- # : 0 00:12:03.891 14:16:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:03.891 14:16:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:03.891 14:16:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:03.891 14:16:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:03.891 14:16:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:03.891 14:16:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:03.891 14:16:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:03.891 14:16:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:03.891 14:16:18 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:03.891 14:16:18 -- target/multitarget.sh@15 -- # nvmftestinit 00:12:03.891 14:16:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:03.891 14:16:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:03.891 14:16:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:03.891 14:16:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:03.891 14:16:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:03.891 14:16:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:03.891 14:16:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:03.891 14:16:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:03.891 14:16:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:03.891 14:16:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:03.891 14:16:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:03.891 14:16:18 -- common/autotest_common.sh@10 -- # set +x 00:12:09.169 14:16:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:09.169 14:16:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:09.169 14:16:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:09.169 14:16:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:09.169 14:16:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:09.169 14:16:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:09.169 14:16:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:09.169 14:16:23 -- nvmf/common.sh@294 -- # net_devs=() 00:12:09.169 14:16:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:09.169 14:16:23 -- nvmf/common.sh@295 -- # e810=() 00:12:09.169 14:16:23 -- nvmf/common.sh@295 -- # local -ga e810 00:12:09.169 14:16:23 -- nvmf/common.sh@296 -- # x722=() 00:12:09.169 14:16:23 -- nvmf/common.sh@296 -- # local -ga x722 00:12:09.169 14:16:23 -- nvmf/common.sh@297 -- # mlx=() 00:12:09.169 14:16:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:09.169 14:16:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:09.169 14:16:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:09.169 14:16:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:09.169 14:16:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:09.169 14:16:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:09.169 14:16:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:09.169 14:16:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:09.169 14:16:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:09.169 14:16:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:12:09.169 Found 0000:af:00.0 (0x8086 - 0x159b) 00:12:09.169 14:16:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:09.169 14:16:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:09.169 14:16:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:09.169 14:16:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:09.169 14:16:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:09.169 14:16:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:09.169 14:16:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:12:09.169 Found 0000:af:00.1 (0x8086 - 0x159b) 00:12:09.170 14:16:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:09.170 14:16:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:09.170 14:16:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:09.170 14:16:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:09.170 14:16:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:09.170 14:16:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:12:09.170 Found net devices under 0000:af:00.0: cvl_0_0 00:12:09.170 14:16:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:09.170 14:16:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:09.170 14:16:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:09.170 14:16:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:09.170 14:16:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:09.170 14:16:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:12:09.170 Found net devices under 0000:af:00.1: cvl_0_1 00:12:09.170 14:16:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:09.170 14:16:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:09.170 14:16:23 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:09.170 14:16:23 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:09.170 14:16:23 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:09.170 14:16:23 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:09.170 14:16:23 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:09.170 14:16:23 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:09.170 14:16:23 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:09.170 14:16:23 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:09.170 14:16:23 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:09.170 14:16:23 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:09.170 14:16:23 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:09.170 14:16:23 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:09.170 14:16:23 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:09.170 14:16:23 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:09.170 14:16:23 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:09.170 14:16:23 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:09.430 14:16:23 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:09.430 14:16:23 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:09.430 14:16:23 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:09.430 14:16:23 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:09.430 14:16:23 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:09.430 14:16:23 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:09.430 14:16:23 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:09.430 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:09.430 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.439 ms 00:12:09.430 00:12:09.430 --- 10.0.0.2 ping statistics --- 00:12:09.430 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:09.430 rtt min/avg/max/mdev = 0.439/0.439/0.439/0.000 ms 00:12:09.430 14:16:23 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:09.430 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:09.430 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.146 ms 00:12:09.430 00:12:09.430 --- 10.0.0.1 ping statistics --- 00:12:09.430 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:09.430 rtt min/avg/max/mdev = 0.146/0.146/0.146/0.000 ms 00:12:09.430 14:16:23 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:09.430 14:16:23 -- nvmf/common.sh@410 -- # return 0 00:12:09.430 14:16:23 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:09.430 14:16:23 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:09.430 14:16:23 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:09.430 14:16:23 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:09.430 14:16:23 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:09.430 14:16:23 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:09.430 14:16:23 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:09.430 14:16:23 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:12:09.430 14:16:23 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:09.430 14:16:23 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:09.430 14:16:23 -- common/autotest_common.sh@10 -- # set +x 00:12:09.430 14:16:23 -- nvmf/common.sh@469 -- # nvmfpid=288396 00:12:09.430 14:16:23 -- nvmf/common.sh@470 -- # waitforlisten 288396 00:12:09.430 14:16:23 -- common/autotest_common.sh@829 -- # '[' -z 288396 ']' 00:12:09.430 14:16:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:09.430 14:16:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:09.430 14:16:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:09.430 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:09.430 14:16:23 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:09.430 14:16:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:09.430 14:16:23 -- common/autotest_common.sh@10 -- # set +x 00:12:09.689 [2024-12-16 14:16:24.007656] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:09.689 [2024-12-16 14:16:24.007700] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:09.689 EAL: No free 2048 kB hugepages reported on node 1 00:12:09.689 [2024-12-16 14:16:24.067239] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:09.690 [2024-12-16 14:16:24.145900] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:09.690 [2024-12-16 14:16:24.146003] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:09.690 [2024-12-16 14:16:24.146011] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:09.690 [2024-12-16 14:16:24.146017] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:09.690 [2024-12-16 14:16:24.146060] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:09.690 [2024-12-16 14:16:24.146159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:09.690 [2024-12-16 14:16:24.146178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:09.690 [2024-12-16 14:16:24.146178] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:10.258 14:16:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:10.258 14:16:24 -- common/autotest_common.sh@862 -- # return 0 00:12:10.258 14:16:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:10.258 14:16:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:10.258 14:16:24 -- common/autotest_common.sh@10 -- # set +x 00:12:10.517 14:16:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:10.517 14:16:24 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:10.517 14:16:24 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:10.517 14:16:24 -- target/multitarget.sh@21 -- # jq length 00:12:10.517 14:16:24 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:12:10.517 14:16:24 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:12:10.517 "nvmf_tgt_1" 00:12:10.517 14:16:25 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:12:10.775 "nvmf_tgt_2" 00:12:10.775 14:16:25 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:10.775 14:16:25 -- target/multitarget.sh@28 -- # jq length 00:12:10.775 14:16:25 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:12:10.775 14:16:25 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:12:11.033 true 00:12:11.033 14:16:25 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:12:11.033 true 00:12:11.033 14:16:25 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:12:11.033 14:16:25 -- target/multitarget.sh@35 -- # jq length 00:12:11.033 14:16:25 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:12:11.033 14:16:25 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:12:11.033 14:16:25 -- target/multitarget.sh@41 -- # nvmftestfini 00:12:11.033 14:16:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:11.033 14:16:25 -- nvmf/common.sh@116 -- # sync 00:12:11.033 14:16:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:11.033 14:16:25 -- nvmf/common.sh@119 -- # set +e 00:12:11.033 14:16:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:11.033 14:16:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:11.292 rmmod nvme_tcp 00:12:11.292 rmmod nvme_fabrics 00:12:11.292 rmmod nvme_keyring 00:12:11.292 14:16:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:11.292 14:16:25 -- nvmf/common.sh@123 -- # set -e 00:12:11.292 14:16:25 -- nvmf/common.sh@124 -- # return 0 00:12:11.292 14:16:25 -- nvmf/common.sh@477 -- # '[' -n 288396 ']' 00:12:11.292 14:16:25 -- nvmf/common.sh@478 -- # killprocess 288396 00:12:11.292 14:16:25 -- common/autotest_common.sh@936 -- # '[' -z 288396 ']' 00:12:11.292 14:16:25 -- common/autotest_common.sh@940 -- # kill -0 288396 00:12:11.292 14:16:25 -- common/autotest_common.sh@941 -- # uname 00:12:11.292 14:16:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:11.292 14:16:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 288396 00:12:11.292 14:16:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:11.292 14:16:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:11.292 14:16:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 288396' 00:12:11.292 killing process with pid 288396 00:12:11.292 14:16:25 -- common/autotest_common.sh@955 -- # kill 288396 00:12:11.292 14:16:25 -- common/autotest_common.sh@960 -- # wait 288396 00:12:11.552 14:16:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:11.552 14:16:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:11.552 14:16:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:11.552 14:16:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:11.552 14:16:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:11.552 14:16:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:11.552 14:16:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:11.552 14:16:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:13.586 14:16:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:13.586 00:12:13.586 real 0m9.744s 00:12:13.586 user 0m9.347s 00:12:13.586 sys 0m4.604s 00:12:13.586 14:16:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:13.586 14:16:27 -- common/autotest_common.sh@10 -- # set +x 00:12:13.586 ************************************ 00:12:13.586 END TEST nvmf_multitarget 00:12:13.586 ************************************ 00:12:13.586 14:16:28 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:13.586 14:16:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:13.586 14:16:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:13.586 14:16:28 -- common/autotest_common.sh@10 -- # set +x 00:12:13.586 ************************************ 00:12:13.586 START TEST nvmf_rpc 00:12:13.586 ************************************ 00:12:13.586 14:16:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:12:13.586 * Looking for test storage... 00:12:13.586 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:13.586 14:16:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:13.586 14:16:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:13.586 14:16:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:13.846 14:16:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:13.846 14:16:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:13.846 14:16:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:13.846 14:16:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:13.846 14:16:28 -- scripts/common.sh@335 -- # IFS=.-: 00:12:13.846 14:16:28 -- scripts/common.sh@335 -- # read -ra ver1 00:12:13.846 14:16:28 -- scripts/common.sh@336 -- # IFS=.-: 00:12:13.846 14:16:28 -- scripts/common.sh@336 -- # read -ra ver2 00:12:13.846 14:16:28 -- scripts/common.sh@337 -- # local 'op=<' 00:12:13.846 14:16:28 -- scripts/common.sh@339 -- # ver1_l=2 00:12:13.846 14:16:28 -- scripts/common.sh@340 -- # ver2_l=1 00:12:13.846 14:16:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:13.846 14:16:28 -- scripts/common.sh@343 -- # case "$op" in 00:12:13.846 14:16:28 -- scripts/common.sh@344 -- # : 1 00:12:13.846 14:16:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:13.846 14:16:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:13.846 14:16:28 -- scripts/common.sh@364 -- # decimal 1 00:12:13.846 14:16:28 -- scripts/common.sh@352 -- # local d=1 00:12:13.846 14:16:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:13.846 14:16:28 -- scripts/common.sh@354 -- # echo 1 00:12:13.846 14:16:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:13.846 14:16:28 -- scripts/common.sh@365 -- # decimal 2 00:12:13.846 14:16:28 -- scripts/common.sh@352 -- # local d=2 00:12:13.846 14:16:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:13.846 14:16:28 -- scripts/common.sh@354 -- # echo 2 00:12:13.846 14:16:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:13.846 14:16:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:13.846 14:16:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:13.846 14:16:28 -- scripts/common.sh@367 -- # return 0 00:12:13.847 14:16:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:13.847 14:16:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:13.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.847 --rc genhtml_branch_coverage=1 00:12:13.847 --rc genhtml_function_coverage=1 00:12:13.847 --rc genhtml_legend=1 00:12:13.847 --rc geninfo_all_blocks=1 00:12:13.847 --rc geninfo_unexecuted_blocks=1 00:12:13.847 00:12:13.847 ' 00:12:13.847 14:16:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:13.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.847 --rc genhtml_branch_coverage=1 00:12:13.847 --rc genhtml_function_coverage=1 00:12:13.847 --rc genhtml_legend=1 00:12:13.847 --rc geninfo_all_blocks=1 00:12:13.847 --rc geninfo_unexecuted_blocks=1 00:12:13.847 00:12:13.847 ' 00:12:13.847 14:16:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:13.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.847 --rc genhtml_branch_coverage=1 00:12:13.847 --rc genhtml_function_coverage=1 00:12:13.847 --rc genhtml_legend=1 00:12:13.847 --rc geninfo_all_blocks=1 00:12:13.847 --rc geninfo_unexecuted_blocks=1 00:12:13.847 00:12:13.847 ' 00:12:13.847 14:16:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:13.847 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:13.847 --rc genhtml_branch_coverage=1 00:12:13.847 --rc genhtml_function_coverage=1 00:12:13.847 --rc genhtml_legend=1 00:12:13.847 --rc geninfo_all_blocks=1 00:12:13.847 --rc geninfo_unexecuted_blocks=1 00:12:13.847 00:12:13.847 ' 00:12:13.847 14:16:28 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:13.847 14:16:28 -- nvmf/common.sh@7 -- # uname -s 00:12:13.847 14:16:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:13.847 14:16:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:13.847 14:16:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:13.847 14:16:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:13.847 14:16:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:13.847 14:16:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:13.847 14:16:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:13.847 14:16:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:13.847 14:16:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:13.847 14:16:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:13.847 14:16:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:12:13.847 14:16:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:12:13.847 14:16:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:13.847 14:16:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:13.847 14:16:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:13.847 14:16:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:13.847 14:16:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:13.847 14:16:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:13.847 14:16:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:13.847 14:16:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.847 14:16:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.847 14:16:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.847 14:16:28 -- paths/export.sh@5 -- # export PATH 00:12:13.847 14:16:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:13.847 14:16:28 -- nvmf/common.sh@46 -- # : 0 00:12:13.847 14:16:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:13.847 14:16:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:13.847 14:16:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:13.847 14:16:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:13.847 14:16:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:13.847 14:16:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:13.847 14:16:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:13.847 14:16:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:13.847 14:16:28 -- target/rpc.sh@11 -- # loops=5 00:12:13.847 14:16:28 -- target/rpc.sh@23 -- # nvmftestinit 00:12:13.847 14:16:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:13.847 14:16:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:13.847 14:16:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:13.847 14:16:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:13.847 14:16:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:13.847 14:16:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:13.847 14:16:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:13.847 14:16:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:13.847 14:16:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:13.847 14:16:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:13.847 14:16:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:13.847 14:16:28 -- common/autotest_common.sh@10 -- # set +x 00:12:19.119 14:16:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:19.119 14:16:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:19.119 14:16:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:19.119 14:16:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:19.119 14:16:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:19.119 14:16:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:19.119 14:16:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:19.119 14:16:32 -- nvmf/common.sh@294 -- # net_devs=() 00:12:19.119 14:16:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:19.119 14:16:32 -- nvmf/common.sh@295 -- # e810=() 00:12:19.119 14:16:32 -- nvmf/common.sh@295 -- # local -ga e810 00:12:19.119 14:16:32 -- nvmf/common.sh@296 -- # x722=() 00:12:19.119 14:16:32 -- nvmf/common.sh@296 -- # local -ga x722 00:12:19.119 14:16:32 -- nvmf/common.sh@297 -- # mlx=() 00:12:19.119 14:16:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:19.119 14:16:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:19.119 14:16:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:19.119 14:16:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:19.119 14:16:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:19.119 14:16:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:19.119 14:16:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:19.119 14:16:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:19.119 14:16:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:19.119 14:16:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:12:19.119 Found 0000:af:00.0 (0x8086 - 0x159b) 00:12:19.119 14:16:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:19.120 14:16:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:12:19.120 Found 0000:af:00.1 (0x8086 - 0x159b) 00:12:19.120 14:16:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:19.120 14:16:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:19.120 14:16:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:19.120 14:16:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:19.120 14:16:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:19.120 14:16:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:12:19.120 Found net devices under 0000:af:00.0: cvl_0_0 00:12:19.120 14:16:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:19.120 14:16:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:19.120 14:16:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:19.120 14:16:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:19.120 14:16:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:19.120 14:16:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:12:19.120 Found net devices under 0000:af:00.1: cvl_0_1 00:12:19.120 14:16:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:19.120 14:16:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:19.120 14:16:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:19.120 14:16:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:19.120 14:16:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:19.120 14:16:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:19.120 14:16:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:19.120 14:16:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:19.120 14:16:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:19.120 14:16:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:19.120 14:16:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:19.120 14:16:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:19.120 14:16:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:19.120 14:16:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:19.120 14:16:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:19.120 14:16:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:19.120 14:16:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:19.120 14:16:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:19.120 14:16:33 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:19.120 14:16:33 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:19.120 14:16:33 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:19.120 14:16:33 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:19.120 14:16:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:19.120 14:16:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:19.120 14:16:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:19.120 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:19.120 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.384 ms 00:12:19.120 00:12:19.120 --- 10.0.0.2 ping statistics --- 00:12:19.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:19.120 rtt min/avg/max/mdev = 0.384/0.384/0.384/0.000 ms 00:12:19.120 14:16:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:19.120 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:19.120 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.154 ms 00:12:19.120 00:12:19.120 --- 10.0.0.1 ping statistics --- 00:12:19.120 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:19.120 rtt min/avg/max/mdev = 0.154/0.154/0.154/0.000 ms 00:12:19.120 14:16:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:19.120 14:16:33 -- nvmf/common.sh@410 -- # return 0 00:12:19.120 14:16:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:19.120 14:16:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:19.120 14:16:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:19.120 14:16:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:19.120 14:16:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:19.120 14:16:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:19.120 14:16:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:19.120 14:16:33 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:12:19.120 14:16:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:19.120 14:16:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:19.120 14:16:33 -- common/autotest_common.sh@10 -- # set +x 00:12:19.120 14:16:33 -- nvmf/common.sh@469 -- # nvmfpid=292142 00:12:19.120 14:16:33 -- nvmf/common.sh@470 -- # waitforlisten 292142 00:12:19.120 14:16:33 -- common/autotest_common.sh@829 -- # '[' -z 292142 ']' 00:12:19.120 14:16:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:19.120 14:16:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:19.120 14:16:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:19.120 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:19.120 14:16:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:19.120 14:16:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:19.120 14:16:33 -- common/autotest_common.sh@10 -- # set +x 00:12:19.120 [2024-12-16 14:16:33.257980] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:19.120 [2024-12-16 14:16:33.258021] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:19.120 EAL: No free 2048 kB hugepages reported on node 1 00:12:19.120 [2024-12-16 14:16:33.316700] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:19.120 [2024-12-16 14:16:33.393738] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:19.120 [2024-12-16 14:16:33.393842] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:19.120 [2024-12-16 14:16:33.393858] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:19.120 [2024-12-16 14:16:33.393865] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:19.120 [2024-12-16 14:16:33.393901] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:19.120 [2024-12-16 14:16:33.393921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:19.120 [2024-12-16 14:16:33.394009] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:19.120 [2024-12-16 14:16:33.394010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:19.688 14:16:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:19.688 14:16:34 -- common/autotest_common.sh@862 -- # return 0 00:12:19.688 14:16:34 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:19.688 14:16:34 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:19.688 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.688 14:16:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:19.688 14:16:34 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:12:19.688 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.688 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.688 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.688 14:16:34 -- target/rpc.sh@26 -- # stats='{ 00:12:19.688 "tick_rate": 2100000000, 00:12:19.688 "poll_groups": [ 00:12:19.688 { 00:12:19.688 "name": "nvmf_tgt_poll_group_0", 00:12:19.688 "admin_qpairs": 0, 00:12:19.688 "io_qpairs": 0, 00:12:19.688 "current_admin_qpairs": 0, 00:12:19.688 "current_io_qpairs": 0, 00:12:19.688 "pending_bdev_io": 0, 00:12:19.688 "completed_nvme_io": 0, 00:12:19.688 "transports": [] 00:12:19.688 }, 00:12:19.688 { 00:12:19.688 "name": "nvmf_tgt_poll_group_1", 00:12:19.688 "admin_qpairs": 0, 00:12:19.688 "io_qpairs": 0, 00:12:19.688 "current_admin_qpairs": 0, 00:12:19.688 "current_io_qpairs": 0, 00:12:19.688 "pending_bdev_io": 0, 00:12:19.688 "completed_nvme_io": 0, 00:12:19.688 "transports": [] 00:12:19.688 }, 00:12:19.688 { 00:12:19.688 "name": "nvmf_tgt_poll_group_2", 00:12:19.688 "admin_qpairs": 0, 00:12:19.688 "io_qpairs": 0, 00:12:19.688 "current_admin_qpairs": 0, 00:12:19.688 "current_io_qpairs": 0, 00:12:19.688 "pending_bdev_io": 0, 00:12:19.688 "completed_nvme_io": 0, 00:12:19.688 "transports": [] 00:12:19.688 }, 00:12:19.688 { 00:12:19.688 "name": "nvmf_tgt_poll_group_3", 00:12:19.688 "admin_qpairs": 0, 00:12:19.688 "io_qpairs": 0, 00:12:19.688 "current_admin_qpairs": 0, 00:12:19.688 "current_io_qpairs": 0, 00:12:19.688 "pending_bdev_io": 0, 00:12:19.688 "completed_nvme_io": 0, 00:12:19.688 "transports": [] 00:12:19.688 } 00:12:19.688 ] 00:12:19.688 }' 00:12:19.688 14:16:34 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:12:19.688 14:16:34 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:12:19.688 14:16:34 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:12:19.688 14:16:34 -- target/rpc.sh@15 -- # wc -l 00:12:19.688 14:16:34 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:12:19.688 14:16:34 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:12:19.688 14:16:34 -- target/rpc.sh@29 -- # [[ null == null ]] 00:12:19.688 14:16:34 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:12:19.688 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.688 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.688 [2024-12-16 14:16:34.238617] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:19.688 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.688 14:16:34 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:12:19.688 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.688 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.688 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.688 14:16:34 -- target/rpc.sh@33 -- # stats='{ 00:12:19.688 "tick_rate": 2100000000, 00:12:19.688 "poll_groups": [ 00:12:19.688 { 00:12:19.688 "name": "nvmf_tgt_poll_group_0", 00:12:19.688 "admin_qpairs": 0, 00:12:19.688 "io_qpairs": 0, 00:12:19.688 "current_admin_qpairs": 0, 00:12:19.688 "current_io_qpairs": 0, 00:12:19.688 "pending_bdev_io": 0, 00:12:19.688 "completed_nvme_io": 0, 00:12:19.688 "transports": [ 00:12:19.688 { 00:12:19.688 "trtype": "TCP" 00:12:19.688 } 00:12:19.688 ] 00:12:19.688 }, 00:12:19.688 { 00:12:19.688 "name": "nvmf_tgt_poll_group_1", 00:12:19.688 "admin_qpairs": 0, 00:12:19.688 "io_qpairs": 0, 00:12:19.688 "current_admin_qpairs": 0, 00:12:19.688 "current_io_qpairs": 0, 00:12:19.688 "pending_bdev_io": 0, 00:12:19.688 "completed_nvme_io": 0, 00:12:19.688 "transports": [ 00:12:19.688 { 00:12:19.688 "trtype": "TCP" 00:12:19.688 } 00:12:19.688 ] 00:12:19.688 }, 00:12:19.688 { 00:12:19.688 "name": "nvmf_tgt_poll_group_2", 00:12:19.688 "admin_qpairs": 0, 00:12:19.688 "io_qpairs": 0, 00:12:19.688 "current_admin_qpairs": 0, 00:12:19.688 "current_io_qpairs": 0, 00:12:19.688 "pending_bdev_io": 0, 00:12:19.688 "completed_nvme_io": 0, 00:12:19.688 "transports": [ 00:12:19.688 { 00:12:19.688 "trtype": "TCP" 00:12:19.688 } 00:12:19.688 ] 00:12:19.688 }, 00:12:19.688 { 00:12:19.688 "name": "nvmf_tgt_poll_group_3", 00:12:19.688 "admin_qpairs": 0, 00:12:19.688 "io_qpairs": 0, 00:12:19.688 "current_admin_qpairs": 0, 00:12:19.688 "current_io_qpairs": 0, 00:12:19.688 "pending_bdev_io": 0, 00:12:19.688 "completed_nvme_io": 0, 00:12:19.688 "transports": [ 00:12:19.688 { 00:12:19.688 "trtype": "TCP" 00:12:19.688 } 00:12:19.688 ] 00:12:19.688 } 00:12:19.688 ] 00:12:19.688 }' 00:12:19.948 14:16:34 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:12:19.948 14:16:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:19.948 14:16:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:19.948 14:16:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:19.948 14:16:34 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:12:19.948 14:16:34 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:12:19.948 14:16:34 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:19.948 14:16:34 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:19.948 14:16:34 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:19.948 14:16:34 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:12:19.948 14:16:34 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:12:19.948 14:16:34 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:12:19.948 14:16:34 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:12:19.948 14:16:34 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:12:19.948 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.948 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.948 Malloc1 00:12:19.948 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.948 14:16:34 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:12:19.948 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.948 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.948 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.948 14:16:34 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:19.948 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.948 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.948 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.948 14:16:34 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:12:19.948 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.948 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.948 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.948 14:16:34 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:19.948 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.948 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.948 [2024-12-16 14:16:34.402525] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:19.948 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.948 14:16:34 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:12:19.948 14:16:34 -- common/autotest_common.sh@650 -- # local es=0 00:12:19.948 14:16:34 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:12:19.948 14:16:34 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:19.948 14:16:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:19.948 14:16:34 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:19.948 14:16:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:19.948 14:16:34 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:19.948 14:16:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:19.948 14:16:34 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:19.948 14:16:34 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:19.948 14:16:34 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 -a 10.0.0.2 -s 4420 00:12:19.948 [2024-12-16 14:16:34.431097] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562' 00:12:19.948 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:19.948 could not add new controller: failed to write to nvme-fabrics device 00:12:19.948 14:16:34 -- common/autotest_common.sh@653 -- # es=1 00:12:19.948 14:16:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:19.948 14:16:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:19.948 14:16:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:19.948 14:16:34 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:12:19.948 14:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:19.948 14:16:34 -- common/autotest_common.sh@10 -- # set +x 00:12:19.948 14:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:19.948 14:16:34 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:21.324 14:16:35 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:12:21.324 14:16:35 -- common/autotest_common.sh@1187 -- # local i=0 00:12:21.324 14:16:35 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:21.324 14:16:35 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:21.324 14:16:35 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:23.228 14:16:37 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:23.228 14:16:37 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:23.228 14:16:37 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:23.228 14:16:37 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:23.228 14:16:37 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:23.228 14:16:37 -- common/autotest_common.sh@1197 -- # return 0 00:12:23.228 14:16:37 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:23.228 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.228 14:16:37 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:23.228 14:16:37 -- common/autotest_common.sh@1208 -- # local i=0 00:12:23.228 14:16:37 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:23.228 14:16:37 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:23.228 14:16:37 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:23.228 14:16:37 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:23.228 14:16:37 -- common/autotest_common.sh@1220 -- # return 0 00:12:23.228 14:16:37 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:12:23.228 14:16:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.228 14:16:37 -- common/autotest_common.sh@10 -- # set +x 00:12:23.228 14:16:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.228 14:16:37 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:23.228 14:16:37 -- common/autotest_common.sh@650 -- # local es=0 00:12:23.228 14:16:37 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:23.228 14:16:37 -- common/autotest_common.sh@638 -- # local arg=nvme 00:12:23.228 14:16:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:23.228 14:16:37 -- common/autotest_common.sh@642 -- # type -t nvme 00:12:23.228 14:16:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:23.228 14:16:37 -- common/autotest_common.sh@644 -- # type -P nvme 00:12:23.228 14:16:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:12:23.228 14:16:37 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:12:23.228 14:16:37 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:12:23.228 14:16:37 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:23.228 [2024-12-16 14:16:37.796594] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562' 00:12:23.486 Failed to write to /dev/nvme-fabrics: Input/output error 00:12:23.486 could not add new controller: failed to write to nvme-fabrics device 00:12:23.486 14:16:37 -- common/autotest_common.sh@653 -- # es=1 00:12:23.486 14:16:37 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:12:23.486 14:16:37 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:12:23.486 14:16:37 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:12:23.486 14:16:37 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:12:23.486 14:16:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:23.486 14:16:37 -- common/autotest_common.sh@10 -- # set +x 00:12:23.486 14:16:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:23.486 14:16:37 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:24.864 14:16:38 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:12:24.864 14:16:38 -- common/autotest_common.sh@1187 -- # local i=0 00:12:24.864 14:16:38 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:24.864 14:16:38 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:24.864 14:16:38 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:26.768 14:16:41 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:26.768 14:16:41 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:26.768 14:16:41 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:26.768 14:16:41 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:26.768 14:16:41 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:26.768 14:16:41 -- common/autotest_common.sh@1197 -- # return 0 00:12:26.768 14:16:41 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:26.768 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:26.768 14:16:41 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:26.768 14:16:41 -- common/autotest_common.sh@1208 -- # local i=0 00:12:26.768 14:16:41 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:26.768 14:16:41 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:26.768 14:16:41 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:26.768 14:16:41 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:26.768 14:16:41 -- common/autotest_common.sh@1220 -- # return 0 00:12:26.768 14:16:41 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:26.768 14:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:26.768 14:16:41 -- common/autotest_common.sh@10 -- # set +x 00:12:26.768 14:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:26.768 14:16:41 -- target/rpc.sh@81 -- # seq 1 5 00:12:26.768 14:16:41 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:26.768 14:16:41 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:26.768 14:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:26.768 14:16:41 -- common/autotest_common.sh@10 -- # set +x 00:12:26.768 14:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:26.768 14:16:41 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:26.768 14:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:26.768 14:16:41 -- common/autotest_common.sh@10 -- # set +x 00:12:26.768 [2024-12-16 14:16:41.192987] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:26.768 14:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:26.768 14:16:41 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:26.768 14:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:26.768 14:16:41 -- common/autotest_common.sh@10 -- # set +x 00:12:26.768 14:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:26.768 14:16:41 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:26.768 14:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:26.768 14:16:41 -- common/autotest_common.sh@10 -- # set +x 00:12:26.768 14:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:26.768 14:16:41 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:28.145 14:16:42 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:28.145 14:16:42 -- common/autotest_common.sh@1187 -- # local i=0 00:12:28.145 14:16:42 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:28.145 14:16:42 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:28.145 14:16:42 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:30.049 14:16:44 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:30.049 14:16:44 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:30.049 14:16:44 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:30.049 14:16:44 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:30.049 14:16:44 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:30.049 14:16:44 -- common/autotest_common.sh@1197 -- # return 0 00:12:30.049 14:16:44 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:30.049 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.049 14:16:44 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:30.049 14:16:44 -- common/autotest_common.sh@1208 -- # local i=0 00:12:30.049 14:16:44 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:30.049 14:16:44 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:30.049 14:16:44 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:30.049 14:16:44 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:30.049 14:16:44 -- common/autotest_common.sh@1220 -- # return 0 00:12:30.049 14:16:44 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:30.049 14:16:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.049 14:16:44 -- common/autotest_common.sh@10 -- # set +x 00:12:30.049 14:16:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.049 14:16:44 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:30.049 14:16:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.049 14:16:44 -- common/autotest_common.sh@10 -- # set +x 00:12:30.049 14:16:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.049 14:16:44 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:30.049 14:16:44 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:30.049 14:16:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.049 14:16:44 -- common/autotest_common.sh@10 -- # set +x 00:12:30.049 14:16:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.049 14:16:44 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:30.049 14:16:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.049 14:16:44 -- common/autotest_common.sh@10 -- # set +x 00:12:30.049 [2024-12-16 14:16:44.469590] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:30.049 14:16:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.049 14:16:44 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:30.049 14:16:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.049 14:16:44 -- common/autotest_common.sh@10 -- # set +x 00:12:30.049 14:16:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.049 14:16:44 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:30.049 14:16:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:30.049 14:16:44 -- common/autotest_common.sh@10 -- # set +x 00:12:30.049 14:16:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:30.049 14:16:44 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:31.429 14:16:45 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:31.429 14:16:45 -- common/autotest_common.sh@1187 -- # local i=0 00:12:31.429 14:16:45 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:31.429 14:16:45 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:31.429 14:16:45 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:33.402 14:16:47 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:33.402 14:16:47 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:33.402 14:16:47 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:33.402 14:16:47 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:33.402 14:16:47 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:33.402 14:16:47 -- common/autotest_common.sh@1197 -- # return 0 00:12:33.402 14:16:47 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:33.402 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:33.402 14:16:47 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:33.402 14:16:47 -- common/autotest_common.sh@1208 -- # local i=0 00:12:33.402 14:16:47 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:33.402 14:16:47 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:33.402 14:16:47 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:33.402 14:16:47 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:33.402 14:16:47 -- common/autotest_common.sh@1220 -- # return 0 00:12:33.402 14:16:47 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:33.402 14:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.402 14:16:47 -- common/autotest_common.sh@10 -- # set +x 00:12:33.402 14:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.402 14:16:47 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:33.402 14:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.402 14:16:47 -- common/autotest_common.sh@10 -- # set +x 00:12:33.402 14:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.402 14:16:47 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:33.402 14:16:47 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:33.402 14:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.402 14:16:47 -- common/autotest_common.sh@10 -- # set +x 00:12:33.402 14:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.402 14:16:47 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:33.402 14:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.402 14:16:47 -- common/autotest_common.sh@10 -- # set +x 00:12:33.402 [2024-12-16 14:16:47.814221] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:33.402 14:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.402 14:16:47 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:33.402 14:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.402 14:16:47 -- common/autotest_common.sh@10 -- # set +x 00:12:33.402 14:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.402 14:16:47 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:33.402 14:16:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:33.402 14:16:47 -- common/autotest_common.sh@10 -- # set +x 00:12:33.402 14:16:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:33.402 14:16:47 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:34.863 14:16:49 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:34.863 14:16:49 -- common/autotest_common.sh@1187 -- # local i=0 00:12:34.863 14:16:49 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:34.863 14:16:49 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:34.863 14:16:49 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:36.765 14:16:51 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:36.765 14:16:51 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:36.765 14:16:51 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:36.765 14:16:51 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:36.765 14:16:51 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:36.765 14:16:51 -- common/autotest_common.sh@1197 -- # return 0 00:12:36.765 14:16:51 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:36.765 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:36.765 14:16:51 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:36.765 14:16:51 -- common/autotest_common.sh@1208 -- # local i=0 00:12:36.765 14:16:51 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:36.765 14:16:51 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:36.765 14:16:51 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:36.765 14:16:51 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:36.765 14:16:51 -- common/autotest_common.sh@1220 -- # return 0 00:12:36.765 14:16:51 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:36.765 14:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:36.765 14:16:51 -- common/autotest_common.sh@10 -- # set +x 00:12:36.765 14:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:36.765 14:16:51 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:36.765 14:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:36.765 14:16:51 -- common/autotest_common.sh@10 -- # set +x 00:12:36.765 14:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:36.765 14:16:51 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:36.765 14:16:51 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:36.765 14:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:36.765 14:16:51 -- common/autotest_common.sh@10 -- # set +x 00:12:36.765 14:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:36.765 14:16:51 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:36.765 14:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:36.765 14:16:51 -- common/autotest_common.sh@10 -- # set +x 00:12:36.765 [2024-12-16 14:16:51.171869] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:36.765 14:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:36.765 14:16:51 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:36.765 14:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:36.765 14:16:51 -- common/autotest_common.sh@10 -- # set +x 00:12:36.765 14:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:36.765 14:16:51 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:36.765 14:16:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:36.765 14:16:51 -- common/autotest_common.sh@10 -- # set +x 00:12:36.765 14:16:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:36.765 14:16:51 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:38.141 14:16:52 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:38.141 14:16:52 -- common/autotest_common.sh@1187 -- # local i=0 00:12:38.141 14:16:52 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:38.141 14:16:52 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:38.141 14:16:52 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:40.046 14:16:54 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:40.046 14:16:54 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:40.046 14:16:54 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:40.046 14:16:54 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:40.046 14:16:54 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:40.046 14:16:54 -- common/autotest_common.sh@1197 -- # return 0 00:12:40.046 14:16:54 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:40.046 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:40.046 14:16:54 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:40.046 14:16:54 -- common/autotest_common.sh@1208 -- # local i=0 00:12:40.046 14:16:54 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:40.046 14:16:54 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:40.046 14:16:54 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:40.046 14:16:54 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:40.046 14:16:54 -- common/autotest_common.sh@1220 -- # return 0 00:12:40.046 14:16:54 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:40.046 14:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.046 14:16:54 -- common/autotest_common.sh@10 -- # set +x 00:12:40.046 14:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.046 14:16:54 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:40.046 14:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.046 14:16:54 -- common/autotest_common.sh@10 -- # set +x 00:12:40.046 14:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.046 14:16:54 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:12:40.046 14:16:54 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:40.046 14:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.046 14:16:54 -- common/autotest_common.sh@10 -- # set +x 00:12:40.046 14:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.046 14:16:54 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:40.046 14:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.046 14:16:54 -- common/autotest_common.sh@10 -- # set +x 00:12:40.046 [2024-12-16 14:16:54.535495] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:40.046 14:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.046 14:16:54 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:12:40.046 14:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.046 14:16:54 -- common/autotest_common.sh@10 -- # set +x 00:12:40.046 14:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.046 14:16:54 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:40.046 14:16:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:40.046 14:16:54 -- common/autotest_common.sh@10 -- # set +x 00:12:40.046 14:16:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:40.046 14:16:54 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:12:41.423 14:16:55 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:12:41.423 14:16:55 -- common/autotest_common.sh@1187 -- # local i=0 00:12:41.423 14:16:55 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:12:41.423 14:16:55 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:12:41.423 14:16:55 -- common/autotest_common.sh@1194 -- # sleep 2 00:12:43.327 14:16:57 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:12:43.327 14:16:57 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:12:43.327 14:16:57 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:12:43.327 14:16:57 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:12:43.327 14:16:57 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:12:43.327 14:16:57 -- common/autotest_common.sh@1197 -- # return 0 00:12:43.327 14:16:57 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:12:43.327 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:43.327 14:16:57 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:12:43.327 14:16:57 -- common/autotest_common.sh@1208 -- # local i=0 00:12:43.327 14:16:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:12:43.327 14:16:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:43.327 14:16:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:12:43.327 14:16:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:12:43.327 14:16:57 -- common/autotest_common.sh@1220 -- # return 0 00:12:43.327 14:16:57 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@99 -- # seq 1 5 00:12:43.327 14:16:57 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:43.327 14:16:57 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 [2024-12-16 14:16:57.790834] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:43.327 14:16:57 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 [2024-12-16 14:16:57.838954] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:43.327 14:16:57 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 [2024-12-16 14:16:57.887119] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.327 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.327 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.327 14:16:57 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:43.327 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:43.586 14:16:57 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 [2024-12-16 14:16:57.935280] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:12:43.586 14:16:57 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 [2024-12-16 14:16:57.983427] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:57 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:12:43.586 14:16:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:57 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:58 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:12:43.586 14:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:58 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:58 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:12:43.586 14:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:58 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:58 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:12:43.586 14:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:12:43.586 14:16:58 -- common/autotest_common.sh@10 -- # set +x 00:12:43.586 14:16:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:12:43.586 14:16:58 -- target/rpc.sh@110 -- # stats='{ 00:12:43.586 "tick_rate": 2100000000, 00:12:43.586 "poll_groups": [ 00:12:43.586 { 00:12:43.586 "name": "nvmf_tgt_poll_group_0", 00:12:43.586 "admin_qpairs": 2, 00:12:43.586 "io_qpairs": 168, 00:12:43.586 "current_admin_qpairs": 0, 00:12:43.586 "current_io_qpairs": 0, 00:12:43.586 "pending_bdev_io": 0, 00:12:43.586 "completed_nvme_io": 232, 00:12:43.586 "transports": [ 00:12:43.586 { 00:12:43.586 "trtype": "TCP" 00:12:43.586 } 00:12:43.586 ] 00:12:43.586 }, 00:12:43.587 { 00:12:43.587 "name": "nvmf_tgt_poll_group_1", 00:12:43.587 "admin_qpairs": 2, 00:12:43.587 "io_qpairs": 168, 00:12:43.587 "current_admin_qpairs": 0, 00:12:43.587 "current_io_qpairs": 0, 00:12:43.587 "pending_bdev_io": 0, 00:12:43.587 "completed_nvme_io": 213, 00:12:43.587 "transports": [ 00:12:43.587 { 00:12:43.587 "trtype": "TCP" 00:12:43.587 } 00:12:43.587 ] 00:12:43.587 }, 00:12:43.587 { 00:12:43.587 "name": "nvmf_tgt_poll_group_2", 00:12:43.587 "admin_qpairs": 1, 00:12:43.587 "io_qpairs": 168, 00:12:43.587 "current_admin_qpairs": 0, 00:12:43.587 "current_io_qpairs": 0, 00:12:43.587 "pending_bdev_io": 0, 00:12:43.587 "completed_nvme_io": 358, 00:12:43.587 "transports": [ 00:12:43.587 { 00:12:43.587 "trtype": "TCP" 00:12:43.587 } 00:12:43.587 ] 00:12:43.587 }, 00:12:43.587 { 00:12:43.587 "name": "nvmf_tgt_poll_group_3", 00:12:43.587 "admin_qpairs": 2, 00:12:43.587 "io_qpairs": 168, 00:12:43.587 "current_admin_qpairs": 0, 00:12:43.587 "current_io_qpairs": 0, 00:12:43.587 "pending_bdev_io": 0, 00:12:43.587 "completed_nvme_io": 219, 00:12:43.587 "transports": [ 00:12:43.587 { 00:12:43.587 "trtype": "TCP" 00:12:43.587 } 00:12:43.587 ] 00:12:43.587 } 00:12:43.587 ] 00:12:43.587 }' 00:12:43.587 14:16:58 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:12:43.587 14:16:58 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:12:43.587 14:16:58 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:12:43.587 14:16:58 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:43.587 14:16:58 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:12:43.587 14:16:58 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:12:43.587 14:16:58 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:12:43.587 14:16:58 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:12:43.587 14:16:58 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:12:43.587 14:16:58 -- target/rpc.sh@113 -- # (( 672 > 0 )) 00:12:43.587 14:16:58 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:12:43.587 14:16:58 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:12:43.587 14:16:58 -- target/rpc.sh@123 -- # nvmftestfini 00:12:43.587 14:16:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:43.587 14:16:58 -- nvmf/common.sh@116 -- # sync 00:12:43.587 14:16:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:43.587 14:16:58 -- nvmf/common.sh@119 -- # set +e 00:12:43.587 14:16:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:43.587 14:16:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:43.587 rmmod nvme_tcp 00:12:43.587 rmmod nvme_fabrics 00:12:43.587 rmmod nvme_keyring 00:12:43.846 14:16:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:43.846 14:16:58 -- nvmf/common.sh@123 -- # set -e 00:12:43.846 14:16:58 -- nvmf/common.sh@124 -- # return 0 00:12:43.846 14:16:58 -- nvmf/common.sh@477 -- # '[' -n 292142 ']' 00:12:43.846 14:16:58 -- nvmf/common.sh@478 -- # killprocess 292142 00:12:43.846 14:16:58 -- common/autotest_common.sh@936 -- # '[' -z 292142 ']' 00:12:43.846 14:16:58 -- common/autotest_common.sh@940 -- # kill -0 292142 00:12:43.846 14:16:58 -- common/autotest_common.sh@941 -- # uname 00:12:43.846 14:16:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:43.846 14:16:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 292142 00:12:43.846 14:16:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:43.846 14:16:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:43.846 14:16:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 292142' 00:12:43.846 killing process with pid 292142 00:12:43.846 14:16:58 -- common/autotest_common.sh@955 -- # kill 292142 00:12:43.846 14:16:58 -- common/autotest_common.sh@960 -- # wait 292142 00:12:44.105 14:16:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:44.105 14:16:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:44.105 14:16:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:44.105 14:16:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:44.105 14:16:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:44.105 14:16:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:44.105 14:16:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:44.105 14:16:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:46.010 14:17:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:46.010 00:12:46.010 real 0m32.496s 00:12:46.010 user 1m41.274s 00:12:46.010 sys 0m5.765s 00:12:46.010 14:17:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:46.010 14:17:00 -- common/autotest_common.sh@10 -- # set +x 00:12:46.010 ************************************ 00:12:46.010 END TEST nvmf_rpc 00:12:46.010 ************************************ 00:12:46.010 14:17:00 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:46.010 14:17:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:46.010 14:17:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:46.010 14:17:00 -- common/autotest_common.sh@10 -- # set +x 00:12:46.010 ************************************ 00:12:46.010 START TEST nvmf_invalid 00:12:46.010 ************************************ 00:12:46.010 14:17:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:12:46.270 * Looking for test storage... 00:12:46.270 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:46.270 14:17:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:46.270 14:17:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:46.270 14:17:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:46.270 14:17:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:46.270 14:17:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:46.270 14:17:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:46.270 14:17:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:46.270 14:17:00 -- scripts/common.sh@335 -- # IFS=.-: 00:12:46.270 14:17:00 -- scripts/common.sh@335 -- # read -ra ver1 00:12:46.270 14:17:00 -- scripts/common.sh@336 -- # IFS=.-: 00:12:46.270 14:17:00 -- scripts/common.sh@336 -- # read -ra ver2 00:12:46.270 14:17:00 -- scripts/common.sh@337 -- # local 'op=<' 00:12:46.270 14:17:00 -- scripts/common.sh@339 -- # ver1_l=2 00:12:46.270 14:17:00 -- scripts/common.sh@340 -- # ver2_l=1 00:12:46.270 14:17:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:46.270 14:17:00 -- scripts/common.sh@343 -- # case "$op" in 00:12:46.270 14:17:00 -- scripts/common.sh@344 -- # : 1 00:12:46.270 14:17:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:46.270 14:17:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:46.270 14:17:00 -- scripts/common.sh@364 -- # decimal 1 00:12:46.270 14:17:00 -- scripts/common.sh@352 -- # local d=1 00:12:46.270 14:17:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:46.270 14:17:00 -- scripts/common.sh@354 -- # echo 1 00:12:46.270 14:17:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:46.270 14:17:00 -- scripts/common.sh@365 -- # decimal 2 00:12:46.270 14:17:00 -- scripts/common.sh@352 -- # local d=2 00:12:46.270 14:17:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:46.270 14:17:00 -- scripts/common.sh@354 -- # echo 2 00:12:46.270 14:17:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:46.270 14:17:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:46.270 14:17:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:46.270 14:17:00 -- scripts/common.sh@367 -- # return 0 00:12:46.270 14:17:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:46.270 14:17:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:46.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:46.270 --rc genhtml_branch_coverage=1 00:12:46.270 --rc genhtml_function_coverage=1 00:12:46.270 --rc genhtml_legend=1 00:12:46.270 --rc geninfo_all_blocks=1 00:12:46.270 --rc geninfo_unexecuted_blocks=1 00:12:46.270 00:12:46.270 ' 00:12:46.270 14:17:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:46.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:46.270 --rc genhtml_branch_coverage=1 00:12:46.270 --rc genhtml_function_coverage=1 00:12:46.270 --rc genhtml_legend=1 00:12:46.270 --rc geninfo_all_blocks=1 00:12:46.270 --rc geninfo_unexecuted_blocks=1 00:12:46.270 00:12:46.270 ' 00:12:46.270 14:17:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:46.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:46.270 --rc genhtml_branch_coverage=1 00:12:46.270 --rc genhtml_function_coverage=1 00:12:46.270 --rc genhtml_legend=1 00:12:46.270 --rc geninfo_all_blocks=1 00:12:46.270 --rc geninfo_unexecuted_blocks=1 00:12:46.270 00:12:46.270 ' 00:12:46.270 14:17:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:46.270 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:46.270 --rc genhtml_branch_coverage=1 00:12:46.270 --rc genhtml_function_coverage=1 00:12:46.270 --rc genhtml_legend=1 00:12:46.270 --rc geninfo_all_blocks=1 00:12:46.270 --rc geninfo_unexecuted_blocks=1 00:12:46.270 00:12:46.270 ' 00:12:46.270 14:17:00 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:46.270 14:17:00 -- nvmf/common.sh@7 -- # uname -s 00:12:46.270 14:17:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:46.270 14:17:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:46.270 14:17:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:46.270 14:17:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:46.270 14:17:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:46.270 14:17:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:46.270 14:17:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:46.270 14:17:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:46.270 14:17:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:46.270 14:17:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:46.270 14:17:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:12:46.270 14:17:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:12:46.270 14:17:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:46.271 14:17:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:46.271 14:17:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:46.271 14:17:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:46.271 14:17:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:46.271 14:17:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:46.271 14:17:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:46.271 14:17:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.271 14:17:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.271 14:17:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.271 14:17:00 -- paths/export.sh@5 -- # export PATH 00:12:46.271 14:17:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:46.271 14:17:00 -- nvmf/common.sh@46 -- # : 0 00:12:46.271 14:17:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:46.271 14:17:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:46.271 14:17:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:46.271 14:17:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:46.271 14:17:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:46.271 14:17:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:46.271 14:17:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:46.271 14:17:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:46.271 14:17:00 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:12:46.271 14:17:00 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:12:46.271 14:17:00 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:12:46.271 14:17:00 -- target/invalid.sh@14 -- # target=foobar 00:12:46.271 14:17:00 -- target/invalid.sh@16 -- # RANDOM=0 00:12:46.271 14:17:00 -- target/invalid.sh@34 -- # nvmftestinit 00:12:46.271 14:17:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:46.271 14:17:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:46.271 14:17:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:46.271 14:17:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:46.271 14:17:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:46.271 14:17:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:46.271 14:17:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:46.271 14:17:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:46.271 14:17:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:46.271 14:17:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:46.271 14:17:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:46.271 14:17:00 -- common/autotest_common.sh@10 -- # set +x 00:12:51.544 14:17:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:12:51.544 14:17:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:12:51.544 14:17:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:12:51.544 14:17:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:12:51.544 14:17:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:12:51.544 14:17:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:12:51.544 14:17:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:12:51.544 14:17:05 -- nvmf/common.sh@294 -- # net_devs=() 00:12:51.544 14:17:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:12:51.544 14:17:05 -- nvmf/common.sh@295 -- # e810=() 00:12:51.544 14:17:05 -- nvmf/common.sh@295 -- # local -ga e810 00:12:51.544 14:17:05 -- nvmf/common.sh@296 -- # x722=() 00:12:51.544 14:17:05 -- nvmf/common.sh@296 -- # local -ga x722 00:12:51.544 14:17:05 -- nvmf/common.sh@297 -- # mlx=() 00:12:51.544 14:17:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:12:51.544 14:17:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:12:51.544 14:17:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:12:51.544 14:17:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:12:51.544 14:17:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:12:51.544 14:17:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:12:51.544 14:17:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:12:51.544 14:17:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:12:51.544 14:17:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:51.545 14:17:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:12:51.545 Found 0000:af:00.0 (0x8086 - 0x159b) 00:12:51.545 14:17:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:12:51.545 14:17:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:12:51.545 Found 0000:af:00.1 (0x8086 - 0x159b) 00:12:51.545 14:17:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:12:51.545 14:17:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:51.545 14:17:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:51.545 14:17:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:51.545 14:17:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:51.545 14:17:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:12:51.545 Found net devices under 0000:af:00.0: cvl_0_0 00:12:51.545 14:17:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:51.545 14:17:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:12:51.545 14:17:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:12:51.545 14:17:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:12:51.545 14:17:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:12:51.545 14:17:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:12:51.545 Found net devices under 0000:af:00.1: cvl_0_1 00:12:51.545 14:17:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:12:51.545 14:17:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:12:51.545 14:17:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:12:51.545 14:17:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:12:51.545 14:17:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:12:51.545 14:17:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:12:51.545 14:17:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:12:51.545 14:17:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:12:51.545 14:17:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:12:51.545 14:17:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:12:51.545 14:17:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:12:51.545 14:17:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:12:51.545 14:17:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:12:51.545 14:17:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:12:51.545 14:17:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:12:51.545 14:17:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:12:51.545 14:17:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:12:51.545 14:17:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:12:51.545 14:17:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:12:51.545 14:17:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:12:51.545 14:17:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:12:51.545 14:17:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:12:51.545 14:17:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:12:51.545 14:17:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:12:51.545 14:17:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:12:51.545 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:12:51.545 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.234 ms 00:12:51.545 00:12:51.545 --- 10.0.0.2 ping statistics --- 00:12:51.545 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:51.545 rtt min/avg/max/mdev = 0.234/0.234/0.234/0.000 ms 00:12:51.545 14:17:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:12:51.545 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:12:51.545 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.073 ms 00:12:51.545 00:12:51.545 --- 10.0.0.1 ping statistics --- 00:12:51.545 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:12:51.545 rtt min/avg/max/mdev = 0.073/0.073/0.073/0.000 ms 00:12:51.545 14:17:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:12:51.545 14:17:06 -- nvmf/common.sh@410 -- # return 0 00:12:51.545 14:17:06 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:12:51.545 14:17:06 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:12:51.545 14:17:06 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:12:51.545 14:17:06 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:12:51.545 14:17:06 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:12:51.545 14:17:06 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:12:51.545 14:17:06 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:12:51.545 14:17:06 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:12:51.545 14:17:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:12:51.545 14:17:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:12:51.545 14:17:06 -- common/autotest_common.sh@10 -- # set +x 00:12:51.545 14:17:06 -- nvmf/common.sh@469 -- # nvmfpid=299833 00:12:51.545 14:17:06 -- nvmf/common.sh@470 -- # waitforlisten 299833 00:12:51.545 14:17:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:12:51.545 14:17:06 -- common/autotest_common.sh@829 -- # '[' -z 299833 ']' 00:12:51.545 14:17:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:12:51.545 14:17:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:12:51.545 14:17:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:12:51.545 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:12:51.545 14:17:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:12:51.545 14:17:06 -- common/autotest_common.sh@10 -- # set +x 00:12:51.545 [2024-12-16 14:17:06.089120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:12:51.545 [2024-12-16 14:17:06.089165] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:12:51.545 EAL: No free 2048 kB hugepages reported on node 1 00:12:51.804 [2024-12-16 14:17:06.148247] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:12:51.804 [2024-12-16 14:17:06.218357] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:12:51.804 [2024-12-16 14:17:06.218468] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:12:51.804 [2024-12-16 14:17:06.218475] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:12:51.804 [2024-12-16 14:17:06.218481] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:12:51.804 [2024-12-16 14:17:06.218578] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:12:51.804 [2024-12-16 14:17:06.218674] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:12:51.804 [2024-12-16 14:17:06.218768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:12:51.804 [2024-12-16 14:17:06.218769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:12:52.378 14:17:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:12:52.378 14:17:06 -- common/autotest_common.sh@862 -- # return 0 00:12:52.378 14:17:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:12:52.378 14:17:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:12:52.378 14:17:06 -- common/autotest_common.sh@10 -- # set +x 00:12:52.378 14:17:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:12:52.378 14:17:06 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:12:52.378 14:17:06 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode6900 00:12:52.636 [2024-12-16 14:17:07.095636] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:12:52.636 14:17:07 -- target/invalid.sh@40 -- # out='request: 00:12:52.636 { 00:12:52.636 "nqn": "nqn.2016-06.io.spdk:cnode6900", 00:12:52.636 "tgt_name": "foobar", 00:12:52.636 "method": "nvmf_create_subsystem", 00:12:52.636 "req_id": 1 00:12:52.636 } 00:12:52.636 Got JSON-RPC error response 00:12:52.636 response: 00:12:52.636 { 00:12:52.636 "code": -32603, 00:12:52.636 "message": "Unable to find target foobar" 00:12:52.636 }' 00:12:52.636 14:17:07 -- target/invalid.sh@41 -- # [[ request: 00:12:52.636 { 00:12:52.636 "nqn": "nqn.2016-06.io.spdk:cnode6900", 00:12:52.636 "tgt_name": "foobar", 00:12:52.636 "method": "nvmf_create_subsystem", 00:12:52.636 "req_id": 1 00:12:52.636 } 00:12:52.636 Got JSON-RPC error response 00:12:52.636 response: 00:12:52.636 { 00:12:52.636 "code": -32603, 00:12:52.636 "message": "Unable to find target foobar" 00:12:52.636 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:12:52.636 14:17:07 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:12:52.636 14:17:07 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode8077 00:12:52.895 [2024-12-16 14:17:07.304367] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode8077: invalid serial number 'SPDKISFASTANDAWESOME' 00:12:52.895 14:17:07 -- target/invalid.sh@45 -- # out='request: 00:12:52.895 { 00:12:52.895 "nqn": "nqn.2016-06.io.spdk:cnode8077", 00:12:52.895 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:52.895 "method": "nvmf_create_subsystem", 00:12:52.895 "req_id": 1 00:12:52.895 } 00:12:52.895 Got JSON-RPC error response 00:12:52.895 response: 00:12:52.895 { 00:12:52.895 "code": -32602, 00:12:52.895 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:52.895 }' 00:12:52.895 14:17:07 -- target/invalid.sh@46 -- # [[ request: 00:12:52.895 { 00:12:52.895 "nqn": "nqn.2016-06.io.spdk:cnode8077", 00:12:52.895 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:12:52.895 "method": "nvmf_create_subsystem", 00:12:52.895 "req_id": 1 00:12:52.895 } 00:12:52.895 Got JSON-RPC error response 00:12:52.895 response: 00:12:52.895 { 00:12:52.895 "code": -32602, 00:12:52.895 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:12:52.895 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:52.895 14:17:07 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:12:52.895 14:17:07 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode6253 00:12:53.154 [2024-12-16 14:17:07.517044] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode6253: invalid model number 'SPDK_Controller' 00:12:53.154 14:17:07 -- target/invalid.sh@50 -- # out='request: 00:12:53.154 { 00:12:53.154 "nqn": "nqn.2016-06.io.spdk:cnode6253", 00:12:53.154 "model_number": "SPDK_Controller\u001f", 00:12:53.154 "method": "nvmf_create_subsystem", 00:12:53.154 "req_id": 1 00:12:53.154 } 00:12:53.154 Got JSON-RPC error response 00:12:53.154 response: 00:12:53.154 { 00:12:53.154 "code": -32602, 00:12:53.154 "message": "Invalid MN SPDK_Controller\u001f" 00:12:53.154 }' 00:12:53.154 14:17:07 -- target/invalid.sh@51 -- # [[ request: 00:12:53.154 { 00:12:53.154 "nqn": "nqn.2016-06.io.spdk:cnode6253", 00:12:53.154 "model_number": "SPDK_Controller\u001f", 00:12:53.154 "method": "nvmf_create_subsystem", 00:12:53.154 "req_id": 1 00:12:53.154 } 00:12:53.154 Got JSON-RPC error response 00:12:53.154 response: 00:12:53.154 { 00:12:53.154 "code": -32602, 00:12:53.154 "message": "Invalid MN SPDK_Controller\u001f" 00:12:53.154 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:53.154 14:17:07 -- target/invalid.sh@54 -- # gen_random_s 21 00:12:53.154 14:17:07 -- target/invalid.sh@19 -- # local length=21 ll 00:12:53.154 14:17:07 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:53.154 14:17:07 -- target/invalid.sh@21 -- # local chars 00:12:53.154 14:17:07 -- target/invalid.sh@22 -- # local string 00:12:53.154 14:17:07 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:53.154 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.154 14:17:07 -- target/invalid.sh@25 -- # printf %x 97 00:12:53.154 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:53.154 14:17:07 -- target/invalid.sh@25 -- # string+=a 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 33 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+='!' 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 53 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=5 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 45 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x2d' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=- 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 108 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=l 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 53 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=5 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 106 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=j 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 124 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+='|' 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 37 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=% 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 67 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=C 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 108 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=l 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 87 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x57' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=W 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 110 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=n 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 39 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x27' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=\' 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 127 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=$'\177' 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 61 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x3d' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+== 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 72 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x48' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=H 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 44 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x2c' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=, 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 75 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x4b' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=K 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 68 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x44' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=D 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # printf %x 53 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:53.155 14:17:07 -- target/invalid.sh@25 -- # string+=5 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.155 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.155 14:17:07 -- target/invalid.sh@28 -- # [[ a == \- ]] 00:12:53.155 14:17:07 -- target/invalid.sh@31 -- # echo 'a!5-l5j|%ClWn'\''=H,KD5' 00:12:53.155 14:17:07 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'a!5-l5j|%ClWn'\''=H,KD5' nqn.2016-06.io.spdk:cnode13263 00:12:53.415 [2024-12-16 14:17:07.838120] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode13263: invalid serial number 'a!5-l5j|%ClWn'=H,KD5' 00:12:53.415 14:17:07 -- target/invalid.sh@54 -- # out='request: 00:12:53.415 { 00:12:53.415 "nqn": "nqn.2016-06.io.spdk:cnode13263", 00:12:53.415 "serial_number": "a!5-l5j|%ClWn'\''\u007f=H,KD5", 00:12:53.415 "method": "nvmf_create_subsystem", 00:12:53.415 "req_id": 1 00:12:53.415 } 00:12:53.415 Got JSON-RPC error response 00:12:53.415 response: 00:12:53.415 { 00:12:53.415 "code": -32602, 00:12:53.415 "message": "Invalid SN a!5-l5j|%ClWn'\''\u007f=H,KD5" 00:12:53.415 }' 00:12:53.415 14:17:07 -- target/invalid.sh@55 -- # [[ request: 00:12:53.415 { 00:12:53.415 "nqn": "nqn.2016-06.io.spdk:cnode13263", 00:12:53.415 "serial_number": "a!5-l5j|%ClWn'\u007f=H,KD5", 00:12:53.415 "method": "nvmf_create_subsystem", 00:12:53.415 "req_id": 1 00:12:53.415 } 00:12:53.415 Got JSON-RPC error response 00:12:53.415 response: 00:12:53.415 { 00:12:53.415 "code": -32602, 00:12:53.415 "message": "Invalid SN a!5-l5j|%ClWn'\u007f=H,KD5" 00:12:53.415 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:12:53.415 14:17:07 -- target/invalid.sh@58 -- # gen_random_s 41 00:12:53.415 14:17:07 -- target/invalid.sh@19 -- # local length=41 ll 00:12:53.415 14:17:07 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:12:53.415 14:17:07 -- target/invalid.sh@21 -- # local chars 00:12:53.415 14:17:07 -- target/invalid.sh@22 -- # local string 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 74 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=J 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 109 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x6d' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=m 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 56 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=8 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 86 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x56' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=V 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 105 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x69' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=i 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 116 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x74' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=t 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 32 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=' ' 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 97 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x61' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=a 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 37 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=% 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 46 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x2e' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=. 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 62 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+='>' 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 80 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x50' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=P 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 62 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+='>' 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 82 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x52' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=R 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 48 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x30' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=0 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 37 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x25' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=% 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 62 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+='>' 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 56 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x38' 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # string+=8 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.415 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.415 14:17:07 -- target/invalid.sh@25 -- # printf %x 55 00:12:53.674 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x37' 00:12:53.674 14:17:07 -- target/invalid.sh@25 -- # string+=7 00:12:53.674 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.674 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.674 14:17:07 -- target/invalid.sh@25 -- # printf %x 88 00:12:53.674 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x58' 00:12:53.674 14:17:07 -- target/invalid.sh@25 -- # string+=X 00:12:53.674 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.674 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.674 14:17:07 -- target/invalid.sh@25 -- # printf %x 67 00:12:53.674 14:17:07 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:53.674 14:17:07 -- target/invalid.sh@25 -- # string+=C 00:12:53.674 14:17:07 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.674 14:17:07 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.674 14:17:08 -- target/invalid.sh@25 -- # printf %x 32 00:12:53.674 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x20' 00:12:53.674 14:17:08 -- target/invalid.sh@25 -- # string+=' ' 00:12:53.674 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.674 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.674 14:17:08 -- target/invalid.sh@25 -- # printf %x 74 00:12:53.674 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:12:53.674 14:17:08 -- target/invalid.sh@25 -- # string+=J 00:12:53.674 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.674 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.674 14:17:08 -- target/invalid.sh@25 -- # printf %x 121 00:12:53.674 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x79' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=y 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 76 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x4c' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=L 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 54 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=6 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 33 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x21' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+='!' 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 42 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+='*' 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 95 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=_ 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 64 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x40' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=@ 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 95 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x5f' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=_ 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 71 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x47' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=G 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 102 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x66' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=f 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 41 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x29' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=')' 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 81 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x51' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=Q 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 54 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x36' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=6 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 67 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x43' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=C 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 89 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x59' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=Y 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 53 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x35' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=5 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 50 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x32' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=2 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # printf %x 101 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # echo -e '\x65' 00:12:53.675 14:17:08 -- target/invalid.sh@25 -- # string+=e 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll++ )) 00:12:53.675 14:17:08 -- target/invalid.sh@24 -- # (( ll < length )) 00:12:53.675 14:17:08 -- target/invalid.sh@28 -- # [[ J == \- ]] 00:12:53.675 14:17:08 -- target/invalid.sh@31 -- # echo 'Jm8Vit a%.>P>R0%>87XC JyL6!*_@_Gf)Q6CY52e' 00:12:53.675 14:17:08 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'Jm8Vit a%.>P>R0%>87XC JyL6!*_@_Gf)Q6CY52e' nqn.2016-06.io.spdk:cnode892 00:12:53.934 [2024-12-16 14:17:08.275585] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode892: invalid model number 'Jm8Vit a%.>P>R0%>87XC JyL6!*_@_Gf)Q6CY52e' 00:12:53.934 14:17:08 -- target/invalid.sh@58 -- # out='request: 00:12:53.934 { 00:12:53.934 "nqn": "nqn.2016-06.io.spdk:cnode892", 00:12:53.934 "model_number": "Jm8Vit a%.>P>R0%>87XC JyL6!*_@_Gf)Q6CY52e", 00:12:53.934 "method": "nvmf_create_subsystem", 00:12:53.934 "req_id": 1 00:12:53.934 } 00:12:53.934 Got JSON-RPC error response 00:12:53.934 response: 00:12:53.934 { 00:12:53.934 "code": -32602, 00:12:53.934 "message": "Invalid MN Jm8Vit a%.>P>R0%>87XC JyL6!*_@_Gf)Q6CY52e" 00:12:53.934 }' 00:12:53.934 14:17:08 -- target/invalid.sh@59 -- # [[ request: 00:12:53.934 { 00:12:53.934 "nqn": "nqn.2016-06.io.spdk:cnode892", 00:12:53.934 "model_number": "Jm8Vit a%.>P>R0%>87XC JyL6!*_@_Gf)Q6CY52e", 00:12:53.934 "method": "nvmf_create_subsystem", 00:12:53.934 "req_id": 1 00:12:53.934 } 00:12:53.934 Got JSON-RPC error response 00:12:53.934 response: 00:12:53.934 { 00:12:53.934 "code": -32602, 00:12:53.934 "message": "Invalid MN Jm8Vit a%.>P>R0%>87XC JyL6!*_@_Gf)Q6CY52e" 00:12:53.934 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:12:53.934 14:17:08 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:12:53.934 [2024-12-16 14:17:08.460273] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:12:53.934 14:17:08 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:12:54.192 14:17:08 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:12:54.192 14:17:08 -- target/invalid.sh@67 -- # echo '' 00:12:54.192 14:17:08 -- target/invalid.sh@67 -- # head -n 1 00:12:54.192 14:17:08 -- target/invalid.sh@67 -- # IP= 00:12:54.192 14:17:08 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:12:54.451 [2024-12-16 14:17:08.879063] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:12:54.451 14:17:08 -- target/invalid.sh@69 -- # out='request: 00:12:54.451 { 00:12:54.451 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:54.451 "listen_address": { 00:12:54.451 "trtype": "tcp", 00:12:54.451 "traddr": "", 00:12:54.451 "trsvcid": "4421" 00:12:54.451 }, 00:12:54.451 "method": "nvmf_subsystem_remove_listener", 00:12:54.451 "req_id": 1 00:12:54.451 } 00:12:54.451 Got JSON-RPC error response 00:12:54.451 response: 00:12:54.451 { 00:12:54.451 "code": -32602, 00:12:54.451 "message": "Invalid parameters" 00:12:54.451 }' 00:12:54.451 14:17:08 -- target/invalid.sh@70 -- # [[ request: 00:12:54.451 { 00:12:54.451 "nqn": "nqn.2016-06.io.spdk:cnode", 00:12:54.451 "listen_address": { 00:12:54.451 "trtype": "tcp", 00:12:54.451 "traddr": "", 00:12:54.451 "trsvcid": "4421" 00:12:54.451 }, 00:12:54.451 "method": "nvmf_subsystem_remove_listener", 00:12:54.451 "req_id": 1 00:12:54.451 } 00:12:54.451 Got JSON-RPC error response 00:12:54.451 response: 00:12:54.451 { 00:12:54.451 "code": -32602, 00:12:54.451 "message": "Invalid parameters" 00:12:54.451 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:12:54.451 14:17:08 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode28760 -i 0 00:12:54.710 [2024-12-16 14:17:09.075669] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode28760: invalid cntlid range [0-65519] 00:12:54.710 14:17:09 -- target/invalid.sh@73 -- # out='request: 00:12:54.710 { 00:12:54.710 "nqn": "nqn.2016-06.io.spdk:cnode28760", 00:12:54.710 "min_cntlid": 0, 00:12:54.710 "method": "nvmf_create_subsystem", 00:12:54.710 "req_id": 1 00:12:54.710 } 00:12:54.710 Got JSON-RPC error response 00:12:54.710 response: 00:12:54.710 { 00:12:54.710 "code": -32602, 00:12:54.710 "message": "Invalid cntlid range [0-65519]" 00:12:54.710 }' 00:12:54.710 14:17:09 -- target/invalid.sh@74 -- # [[ request: 00:12:54.710 { 00:12:54.710 "nqn": "nqn.2016-06.io.spdk:cnode28760", 00:12:54.710 "min_cntlid": 0, 00:12:54.710 "method": "nvmf_create_subsystem", 00:12:54.710 "req_id": 1 00:12:54.710 } 00:12:54.710 Got JSON-RPC error response 00:12:54.710 response: 00:12:54.710 { 00:12:54.710 "code": -32602, 00:12:54.710 "message": "Invalid cntlid range [0-65519]" 00:12:54.710 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:54.710 14:17:09 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode29825 -i 65520 00:12:54.710 [2024-12-16 14:17:09.260311] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode29825: invalid cntlid range [65520-65519] 00:12:54.969 14:17:09 -- target/invalid.sh@75 -- # out='request: 00:12:54.969 { 00:12:54.969 "nqn": "nqn.2016-06.io.spdk:cnode29825", 00:12:54.969 "min_cntlid": 65520, 00:12:54.969 "method": "nvmf_create_subsystem", 00:12:54.969 "req_id": 1 00:12:54.969 } 00:12:54.969 Got JSON-RPC error response 00:12:54.969 response: 00:12:54.969 { 00:12:54.969 "code": -32602, 00:12:54.969 "message": "Invalid cntlid range [65520-65519]" 00:12:54.969 }' 00:12:54.969 14:17:09 -- target/invalid.sh@76 -- # [[ request: 00:12:54.969 { 00:12:54.969 "nqn": "nqn.2016-06.io.spdk:cnode29825", 00:12:54.969 "min_cntlid": 65520, 00:12:54.969 "method": "nvmf_create_subsystem", 00:12:54.969 "req_id": 1 00:12:54.969 } 00:12:54.969 Got JSON-RPC error response 00:12:54.969 response: 00:12:54.969 { 00:12:54.969 "code": -32602, 00:12:54.969 "message": "Invalid cntlid range [65520-65519]" 00:12:54.969 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:54.969 14:17:09 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10085 -I 0 00:12:54.969 [2024-12-16 14:17:09.444935] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10085: invalid cntlid range [1-0] 00:12:54.969 14:17:09 -- target/invalid.sh@77 -- # out='request: 00:12:54.969 { 00:12:54.969 "nqn": "nqn.2016-06.io.spdk:cnode10085", 00:12:54.969 "max_cntlid": 0, 00:12:54.969 "method": "nvmf_create_subsystem", 00:12:54.969 "req_id": 1 00:12:54.969 } 00:12:54.969 Got JSON-RPC error response 00:12:54.969 response: 00:12:54.969 { 00:12:54.969 "code": -32602, 00:12:54.969 "message": "Invalid cntlid range [1-0]" 00:12:54.969 }' 00:12:54.969 14:17:09 -- target/invalid.sh@78 -- # [[ request: 00:12:54.969 { 00:12:54.969 "nqn": "nqn.2016-06.io.spdk:cnode10085", 00:12:54.969 "max_cntlid": 0, 00:12:54.969 "method": "nvmf_create_subsystem", 00:12:54.969 "req_id": 1 00:12:54.969 } 00:12:54.969 Got JSON-RPC error response 00:12:54.969 response: 00:12:54.969 { 00:12:54.969 "code": -32602, 00:12:54.969 "message": "Invalid cntlid range [1-0]" 00:12:54.969 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:54.969 14:17:09 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode32654 -I 65520 00:12:55.228 [2024-12-16 14:17:09.633569] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32654: invalid cntlid range [1-65520] 00:12:55.228 14:17:09 -- target/invalid.sh@79 -- # out='request: 00:12:55.228 { 00:12:55.228 "nqn": "nqn.2016-06.io.spdk:cnode32654", 00:12:55.228 "max_cntlid": 65520, 00:12:55.228 "method": "nvmf_create_subsystem", 00:12:55.228 "req_id": 1 00:12:55.228 } 00:12:55.228 Got JSON-RPC error response 00:12:55.228 response: 00:12:55.228 { 00:12:55.228 "code": -32602, 00:12:55.228 "message": "Invalid cntlid range [1-65520]" 00:12:55.228 }' 00:12:55.228 14:17:09 -- target/invalid.sh@80 -- # [[ request: 00:12:55.228 { 00:12:55.228 "nqn": "nqn.2016-06.io.spdk:cnode32654", 00:12:55.228 "max_cntlid": 65520, 00:12:55.228 "method": "nvmf_create_subsystem", 00:12:55.228 "req_id": 1 00:12:55.228 } 00:12:55.228 Got JSON-RPC error response 00:12:55.228 response: 00:12:55.228 { 00:12:55.228 "code": -32602, 00:12:55.228 "message": "Invalid cntlid range [1-65520]" 00:12:55.228 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:55.228 14:17:09 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode26631 -i 6 -I 5 00:12:55.487 [2024-12-16 14:17:09.822230] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode26631: invalid cntlid range [6-5] 00:12:55.487 14:17:09 -- target/invalid.sh@83 -- # out='request: 00:12:55.487 { 00:12:55.487 "nqn": "nqn.2016-06.io.spdk:cnode26631", 00:12:55.487 "min_cntlid": 6, 00:12:55.487 "max_cntlid": 5, 00:12:55.487 "method": "nvmf_create_subsystem", 00:12:55.487 "req_id": 1 00:12:55.487 } 00:12:55.487 Got JSON-RPC error response 00:12:55.487 response: 00:12:55.487 { 00:12:55.487 "code": -32602, 00:12:55.487 "message": "Invalid cntlid range [6-5]" 00:12:55.487 }' 00:12:55.487 14:17:09 -- target/invalid.sh@84 -- # [[ request: 00:12:55.487 { 00:12:55.487 "nqn": "nqn.2016-06.io.spdk:cnode26631", 00:12:55.487 "min_cntlid": 6, 00:12:55.487 "max_cntlid": 5, 00:12:55.487 "method": "nvmf_create_subsystem", 00:12:55.487 "req_id": 1 00:12:55.487 } 00:12:55.487 Got JSON-RPC error response 00:12:55.487 response: 00:12:55.487 { 00:12:55.487 "code": -32602, 00:12:55.487 "message": "Invalid cntlid range [6-5]" 00:12:55.487 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:12:55.487 14:17:09 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:12:55.487 14:17:09 -- target/invalid.sh@87 -- # out='request: 00:12:55.487 { 00:12:55.487 "name": "foobar", 00:12:55.487 "method": "nvmf_delete_target", 00:12:55.487 "req_id": 1 00:12:55.487 } 00:12:55.487 Got JSON-RPC error response 00:12:55.487 response: 00:12:55.487 { 00:12:55.487 "code": -32602, 00:12:55.487 "message": "The specified target doesn'\''t exist, cannot delete it." 00:12:55.487 }' 00:12:55.487 14:17:09 -- target/invalid.sh@88 -- # [[ request: 00:12:55.487 { 00:12:55.487 "name": "foobar", 00:12:55.487 "method": "nvmf_delete_target", 00:12:55.487 "req_id": 1 00:12:55.487 } 00:12:55.487 Got JSON-RPC error response 00:12:55.487 response: 00:12:55.487 { 00:12:55.487 "code": -32602, 00:12:55.487 "message": "The specified target doesn't exist, cannot delete it." 00:12:55.487 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:12:55.487 14:17:09 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:12:55.487 14:17:09 -- target/invalid.sh@91 -- # nvmftestfini 00:12:55.487 14:17:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:55.487 14:17:09 -- nvmf/common.sh@116 -- # sync 00:12:55.487 14:17:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:55.487 14:17:09 -- nvmf/common.sh@119 -- # set +e 00:12:55.487 14:17:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:55.487 14:17:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:55.487 rmmod nvme_tcp 00:12:55.487 rmmod nvme_fabrics 00:12:55.487 rmmod nvme_keyring 00:12:55.487 14:17:10 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:55.487 14:17:10 -- nvmf/common.sh@123 -- # set -e 00:12:55.487 14:17:10 -- nvmf/common.sh@124 -- # return 0 00:12:55.487 14:17:10 -- nvmf/common.sh@477 -- # '[' -n 299833 ']' 00:12:55.487 14:17:10 -- nvmf/common.sh@478 -- # killprocess 299833 00:12:55.487 14:17:10 -- common/autotest_common.sh@936 -- # '[' -z 299833 ']' 00:12:55.487 14:17:10 -- common/autotest_common.sh@940 -- # kill -0 299833 00:12:55.487 14:17:10 -- common/autotest_common.sh@941 -- # uname 00:12:55.487 14:17:10 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:55.487 14:17:10 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 299833 00:12:55.746 14:17:10 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:55.746 14:17:10 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:55.746 14:17:10 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 299833' 00:12:55.746 killing process with pid 299833 00:12:55.746 14:17:10 -- common/autotest_common.sh@955 -- # kill 299833 00:12:55.747 14:17:10 -- common/autotest_common.sh@960 -- # wait 299833 00:12:55.747 14:17:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:55.747 14:17:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:55.747 14:17:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:55.747 14:17:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:55.747 14:17:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:55.747 14:17:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:55.747 14:17:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:55.747 14:17:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:58.282 14:17:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:12:58.282 00:12:58.282 real 0m11.805s 00:12:58.282 user 0m20.127s 00:12:58.282 sys 0m4.921s 00:12:58.282 14:17:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:12:58.282 14:17:12 -- common/autotest_common.sh@10 -- # set +x 00:12:58.282 ************************************ 00:12:58.282 END TEST nvmf_invalid 00:12:58.282 ************************************ 00:12:58.282 14:17:12 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:58.282 14:17:12 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:12:58.282 14:17:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:12:58.282 14:17:12 -- common/autotest_common.sh@10 -- # set +x 00:12:58.282 ************************************ 00:12:58.282 START TEST nvmf_abort 00:12:58.282 ************************************ 00:12:58.282 14:17:12 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:12:58.282 * Looking for test storage... 00:12:58.282 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:12:58.282 14:17:12 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:12:58.282 14:17:12 -- common/autotest_common.sh@1690 -- # lcov --version 00:12:58.282 14:17:12 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:12:58.282 14:17:12 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:12:58.282 14:17:12 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:12:58.282 14:17:12 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:12:58.282 14:17:12 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:12:58.282 14:17:12 -- scripts/common.sh@335 -- # IFS=.-: 00:12:58.282 14:17:12 -- scripts/common.sh@335 -- # read -ra ver1 00:12:58.282 14:17:12 -- scripts/common.sh@336 -- # IFS=.-: 00:12:58.282 14:17:12 -- scripts/common.sh@336 -- # read -ra ver2 00:12:58.282 14:17:12 -- scripts/common.sh@337 -- # local 'op=<' 00:12:58.282 14:17:12 -- scripts/common.sh@339 -- # ver1_l=2 00:12:58.282 14:17:12 -- scripts/common.sh@340 -- # ver2_l=1 00:12:58.282 14:17:12 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:12:58.282 14:17:12 -- scripts/common.sh@343 -- # case "$op" in 00:12:58.282 14:17:12 -- scripts/common.sh@344 -- # : 1 00:12:58.282 14:17:12 -- scripts/common.sh@363 -- # (( v = 0 )) 00:12:58.282 14:17:12 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:12:58.282 14:17:12 -- scripts/common.sh@364 -- # decimal 1 00:12:58.282 14:17:12 -- scripts/common.sh@352 -- # local d=1 00:12:58.282 14:17:12 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:12:58.282 14:17:12 -- scripts/common.sh@354 -- # echo 1 00:12:58.282 14:17:12 -- scripts/common.sh@364 -- # ver1[v]=1 00:12:58.282 14:17:12 -- scripts/common.sh@365 -- # decimal 2 00:12:58.282 14:17:12 -- scripts/common.sh@352 -- # local d=2 00:12:58.282 14:17:12 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:12:58.282 14:17:12 -- scripts/common.sh@354 -- # echo 2 00:12:58.282 14:17:12 -- scripts/common.sh@365 -- # ver2[v]=2 00:12:58.282 14:17:12 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:12:58.282 14:17:12 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:12:58.282 14:17:12 -- scripts/common.sh@367 -- # return 0 00:12:58.282 14:17:12 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:12:58.282 14:17:12 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:12:58.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:58.282 --rc genhtml_branch_coverage=1 00:12:58.282 --rc genhtml_function_coverage=1 00:12:58.282 --rc genhtml_legend=1 00:12:58.282 --rc geninfo_all_blocks=1 00:12:58.282 --rc geninfo_unexecuted_blocks=1 00:12:58.282 00:12:58.282 ' 00:12:58.282 14:17:12 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:12:58.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:58.282 --rc genhtml_branch_coverage=1 00:12:58.282 --rc genhtml_function_coverage=1 00:12:58.282 --rc genhtml_legend=1 00:12:58.282 --rc geninfo_all_blocks=1 00:12:58.282 --rc geninfo_unexecuted_blocks=1 00:12:58.282 00:12:58.282 ' 00:12:58.282 14:17:12 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:12:58.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:58.282 --rc genhtml_branch_coverage=1 00:12:58.282 --rc genhtml_function_coverage=1 00:12:58.282 --rc genhtml_legend=1 00:12:58.282 --rc geninfo_all_blocks=1 00:12:58.282 --rc geninfo_unexecuted_blocks=1 00:12:58.282 00:12:58.282 ' 00:12:58.282 14:17:12 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:12:58.282 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:12:58.282 --rc genhtml_branch_coverage=1 00:12:58.282 --rc genhtml_function_coverage=1 00:12:58.282 --rc genhtml_legend=1 00:12:58.282 --rc geninfo_all_blocks=1 00:12:58.282 --rc geninfo_unexecuted_blocks=1 00:12:58.282 00:12:58.282 ' 00:12:58.282 14:17:12 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:12:58.282 14:17:12 -- nvmf/common.sh@7 -- # uname -s 00:12:58.282 14:17:12 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:12:58.282 14:17:12 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:12:58.282 14:17:12 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:12:58.282 14:17:12 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:12:58.282 14:17:12 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:12:58.282 14:17:12 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:12:58.282 14:17:12 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:12:58.282 14:17:12 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:12:58.282 14:17:12 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:12:58.282 14:17:12 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:12:58.282 14:17:12 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:12:58.282 14:17:12 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:12:58.282 14:17:12 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:12:58.282 14:17:12 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:12:58.282 14:17:12 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:12:58.282 14:17:12 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:12:58.282 14:17:12 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:12:58.282 14:17:12 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:12:58.282 14:17:12 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:12:58.282 14:17:12 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:58.282 14:17:12 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:58.282 14:17:12 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:58.282 14:17:12 -- paths/export.sh@5 -- # export PATH 00:12:58.282 14:17:12 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:12:58.282 14:17:12 -- nvmf/common.sh@46 -- # : 0 00:12:58.282 14:17:12 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:12:58.282 14:17:12 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:12:58.282 14:17:12 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:12:58.282 14:17:12 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:12:58.282 14:17:12 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:12:58.282 14:17:12 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:12:58.282 14:17:12 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:12:58.282 14:17:12 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:12:58.282 14:17:12 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:12:58.282 14:17:12 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:12:58.282 14:17:12 -- target/abort.sh@14 -- # nvmftestinit 00:12:58.282 14:17:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:12:58.282 14:17:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:12:58.282 14:17:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:12:58.282 14:17:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:12:58.282 14:17:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:12:58.282 14:17:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:58.282 14:17:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:58.282 14:17:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:12:58.283 14:17:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:12:58.283 14:17:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:12:58.283 14:17:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:12:58.283 14:17:12 -- common/autotest_common.sh@10 -- # set +x 00:13:03.557 14:17:17 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:03.557 14:17:17 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:03.557 14:17:17 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:03.557 14:17:17 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:03.557 14:17:17 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:03.557 14:17:17 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:03.557 14:17:17 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:03.557 14:17:17 -- nvmf/common.sh@294 -- # net_devs=() 00:13:03.557 14:17:17 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:03.557 14:17:17 -- nvmf/common.sh@295 -- # e810=() 00:13:03.557 14:17:17 -- nvmf/common.sh@295 -- # local -ga e810 00:13:03.557 14:17:17 -- nvmf/common.sh@296 -- # x722=() 00:13:03.557 14:17:17 -- nvmf/common.sh@296 -- # local -ga x722 00:13:03.557 14:17:17 -- nvmf/common.sh@297 -- # mlx=() 00:13:03.557 14:17:17 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:03.557 14:17:17 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:03.557 14:17:17 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:03.557 14:17:17 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:03.557 14:17:17 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:03.557 14:17:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:03.557 14:17:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:13:03.557 Found 0000:af:00.0 (0x8086 - 0x159b) 00:13:03.557 14:17:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:03.557 14:17:17 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:13:03.557 Found 0000:af:00.1 (0x8086 - 0x159b) 00:13:03.557 14:17:17 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:03.557 14:17:17 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:03.557 14:17:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:03.557 14:17:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:03.557 14:17:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:03.557 14:17:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:13:03.557 Found net devices under 0000:af:00.0: cvl_0_0 00:13:03.557 14:17:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:03.557 14:17:17 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:03.557 14:17:17 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:03.557 14:17:17 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:03.557 14:17:17 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:03.557 14:17:17 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:13:03.557 Found net devices under 0000:af:00.1: cvl_0_1 00:13:03.557 14:17:17 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:03.557 14:17:17 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:03.557 14:17:17 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:03.557 14:17:17 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:03.557 14:17:17 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:03.557 14:17:17 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:03.557 14:17:17 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:03.557 14:17:17 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:03.557 14:17:17 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:03.557 14:17:17 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:03.557 14:17:17 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:03.557 14:17:17 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:03.557 14:17:17 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:03.557 14:17:17 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:03.557 14:17:17 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:03.557 14:17:17 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:03.557 14:17:17 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:03.557 14:17:17 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:03.557 14:17:18 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:03.557 14:17:18 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:03.557 14:17:18 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:03.557 14:17:18 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:03.557 14:17:18 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:03.557 14:17:18 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:03.557 14:17:18 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:03.557 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:03.557 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.302 ms 00:13:03.557 00:13:03.557 --- 10.0.0.2 ping statistics --- 00:13:03.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:03.557 rtt min/avg/max/mdev = 0.302/0.302/0.302/0.000 ms 00:13:03.557 14:17:18 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:03.557 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:03.557 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:13:03.557 00:13:03.557 --- 10.0.0.1 ping statistics --- 00:13:03.557 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:03.557 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:13:03.557 14:17:18 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:03.557 14:17:18 -- nvmf/common.sh@410 -- # return 0 00:13:03.557 14:17:18 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:03.557 14:17:18 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:03.557 14:17:18 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:03.557 14:17:18 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:03.557 14:17:18 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:03.557 14:17:18 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:03.557 14:17:18 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:03.817 14:17:18 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:03.817 14:17:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:03.817 14:17:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:03.817 14:17:18 -- common/autotest_common.sh@10 -- # set +x 00:13:03.817 14:17:18 -- nvmf/common.sh@469 -- # nvmfpid=304035 00:13:03.817 14:17:18 -- nvmf/common.sh@470 -- # waitforlisten 304035 00:13:03.817 14:17:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:03.817 14:17:18 -- common/autotest_common.sh@829 -- # '[' -z 304035 ']' 00:13:03.817 14:17:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:03.817 14:17:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:03.817 14:17:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:03.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:03.817 14:17:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:03.817 14:17:18 -- common/autotest_common.sh@10 -- # set +x 00:13:03.817 [2024-12-16 14:17:18.206491] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:03.817 [2024-12-16 14:17:18.206538] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:03.817 EAL: No free 2048 kB hugepages reported on node 1 00:13:03.817 [2024-12-16 14:17:18.266187] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:03.817 [2024-12-16 14:17:18.338966] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:03.817 [2024-12-16 14:17:18.339089] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:03.817 [2024-12-16 14:17:18.339098] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:03.817 [2024-12-16 14:17:18.339104] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:03.817 [2024-12-16 14:17:18.339224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:03.817 [2024-12-16 14:17:18.339311] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:03.817 [2024-12-16 14:17:18.339312] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:04.754 14:17:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:04.754 14:17:19 -- common/autotest_common.sh@862 -- # return 0 00:13:04.754 14:17:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:04.754 14:17:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:04.754 14:17:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.754 14:17:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:04.754 14:17:19 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:04.754 14:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.754 14:17:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.754 [2024-12-16 14:17:19.074508] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:04.754 14:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.754 14:17:19 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:04.754 14:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.754 14:17:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.754 Malloc0 00:13:04.754 14:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.754 14:17:19 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:04.754 14:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.754 14:17:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.754 Delay0 00:13:04.754 14:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.754 14:17:19 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:04.754 14:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.754 14:17:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.754 14:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.754 14:17:19 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:04.754 14:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.754 14:17:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.754 14:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.754 14:17:19 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:04.754 14:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.754 14:17:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.754 [2024-12-16 14:17:19.134980] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:04.754 14:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.754 14:17:19 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:04.754 14:17:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:04.754 14:17:19 -- common/autotest_common.sh@10 -- # set +x 00:13:04.754 14:17:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:04.754 14:17:19 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:04.754 EAL: No free 2048 kB hugepages reported on node 1 00:13:04.754 [2024-12-16 14:17:19.239176] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:07.287 Initializing NVMe Controllers 00:13:07.287 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:07.287 controller IO queue size 128 less than required 00:13:07.287 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:07.287 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:07.287 Initialization complete. Launching workers. 00:13:07.287 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 127, failed: 44459 00:13:07.287 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 44524, failed to submit 62 00:13:07.287 success 44459, unsuccess 65, failed 0 00:13:07.287 14:17:21 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:07.287 14:17:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:07.287 14:17:21 -- common/autotest_common.sh@10 -- # set +x 00:13:07.287 14:17:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:07.287 14:17:21 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:07.287 14:17:21 -- target/abort.sh@38 -- # nvmftestfini 00:13:07.287 14:17:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:07.287 14:17:21 -- nvmf/common.sh@116 -- # sync 00:13:07.287 14:17:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:07.287 14:17:21 -- nvmf/common.sh@119 -- # set +e 00:13:07.287 14:17:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:07.287 14:17:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:07.287 rmmod nvme_tcp 00:13:07.287 rmmod nvme_fabrics 00:13:07.287 rmmod nvme_keyring 00:13:07.287 14:17:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:07.287 14:17:21 -- nvmf/common.sh@123 -- # set -e 00:13:07.287 14:17:21 -- nvmf/common.sh@124 -- # return 0 00:13:07.287 14:17:21 -- nvmf/common.sh@477 -- # '[' -n 304035 ']' 00:13:07.287 14:17:21 -- nvmf/common.sh@478 -- # killprocess 304035 00:13:07.287 14:17:21 -- common/autotest_common.sh@936 -- # '[' -z 304035 ']' 00:13:07.287 14:17:21 -- common/autotest_common.sh@940 -- # kill -0 304035 00:13:07.287 14:17:21 -- common/autotest_common.sh@941 -- # uname 00:13:07.287 14:17:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:07.287 14:17:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 304035 00:13:07.287 14:17:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:07.287 14:17:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:07.287 14:17:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 304035' 00:13:07.287 killing process with pid 304035 00:13:07.287 14:17:21 -- common/autotest_common.sh@955 -- # kill 304035 00:13:07.287 14:17:21 -- common/autotest_common.sh@960 -- # wait 304035 00:13:07.287 14:17:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:07.287 14:17:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:07.287 14:17:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:07.287 14:17:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:07.287 14:17:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:07.287 14:17:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:07.287 14:17:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:07.287 14:17:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.193 14:17:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:09.194 00:13:09.194 real 0m11.255s 00:13:09.194 user 0m13.162s 00:13:09.194 sys 0m4.978s 00:13:09.194 14:17:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:09.194 14:17:23 -- common/autotest_common.sh@10 -- # set +x 00:13:09.194 ************************************ 00:13:09.194 END TEST nvmf_abort 00:13:09.194 ************************************ 00:13:09.194 14:17:23 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:09.194 14:17:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:09.194 14:17:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:09.194 14:17:23 -- common/autotest_common.sh@10 -- # set +x 00:13:09.194 ************************************ 00:13:09.194 START TEST nvmf_ns_hotplug_stress 00:13:09.194 ************************************ 00:13:09.194 14:17:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:09.194 * Looking for test storage... 00:13:09.453 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:09.453 14:17:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:09.453 14:17:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:09.453 14:17:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:09.453 14:17:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:09.453 14:17:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:09.453 14:17:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:09.453 14:17:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:09.453 14:17:23 -- scripts/common.sh@335 -- # IFS=.-: 00:13:09.453 14:17:23 -- scripts/common.sh@335 -- # read -ra ver1 00:13:09.453 14:17:23 -- scripts/common.sh@336 -- # IFS=.-: 00:13:09.453 14:17:23 -- scripts/common.sh@336 -- # read -ra ver2 00:13:09.453 14:17:23 -- scripts/common.sh@337 -- # local 'op=<' 00:13:09.453 14:17:23 -- scripts/common.sh@339 -- # ver1_l=2 00:13:09.453 14:17:23 -- scripts/common.sh@340 -- # ver2_l=1 00:13:09.453 14:17:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:09.453 14:17:23 -- scripts/common.sh@343 -- # case "$op" in 00:13:09.454 14:17:23 -- scripts/common.sh@344 -- # : 1 00:13:09.454 14:17:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:09.454 14:17:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:09.454 14:17:23 -- scripts/common.sh@364 -- # decimal 1 00:13:09.454 14:17:23 -- scripts/common.sh@352 -- # local d=1 00:13:09.454 14:17:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:09.454 14:17:23 -- scripts/common.sh@354 -- # echo 1 00:13:09.454 14:17:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:09.454 14:17:23 -- scripts/common.sh@365 -- # decimal 2 00:13:09.454 14:17:23 -- scripts/common.sh@352 -- # local d=2 00:13:09.454 14:17:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:09.454 14:17:23 -- scripts/common.sh@354 -- # echo 2 00:13:09.454 14:17:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:09.454 14:17:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:09.454 14:17:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:09.454 14:17:23 -- scripts/common.sh@367 -- # return 0 00:13:09.454 14:17:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:09.454 14:17:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:09.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.454 --rc genhtml_branch_coverage=1 00:13:09.454 --rc genhtml_function_coverage=1 00:13:09.454 --rc genhtml_legend=1 00:13:09.454 --rc geninfo_all_blocks=1 00:13:09.454 --rc geninfo_unexecuted_blocks=1 00:13:09.454 00:13:09.454 ' 00:13:09.454 14:17:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:09.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.454 --rc genhtml_branch_coverage=1 00:13:09.454 --rc genhtml_function_coverage=1 00:13:09.454 --rc genhtml_legend=1 00:13:09.454 --rc geninfo_all_blocks=1 00:13:09.454 --rc geninfo_unexecuted_blocks=1 00:13:09.454 00:13:09.454 ' 00:13:09.454 14:17:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:09.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.454 --rc genhtml_branch_coverage=1 00:13:09.454 --rc genhtml_function_coverage=1 00:13:09.454 --rc genhtml_legend=1 00:13:09.454 --rc geninfo_all_blocks=1 00:13:09.454 --rc geninfo_unexecuted_blocks=1 00:13:09.454 00:13:09.454 ' 00:13:09.454 14:17:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:09.454 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:09.454 --rc genhtml_branch_coverage=1 00:13:09.454 --rc genhtml_function_coverage=1 00:13:09.454 --rc genhtml_legend=1 00:13:09.454 --rc geninfo_all_blocks=1 00:13:09.454 --rc geninfo_unexecuted_blocks=1 00:13:09.454 00:13:09.454 ' 00:13:09.454 14:17:23 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:09.454 14:17:23 -- nvmf/common.sh@7 -- # uname -s 00:13:09.454 14:17:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:09.454 14:17:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:09.454 14:17:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:09.454 14:17:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:09.454 14:17:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:09.454 14:17:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:09.454 14:17:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:09.454 14:17:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:09.454 14:17:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:09.454 14:17:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:09.454 14:17:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:13:09.454 14:17:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:13:09.454 14:17:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:09.454 14:17:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:09.454 14:17:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:09.454 14:17:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:09.454 14:17:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:09.454 14:17:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:09.454 14:17:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:09.454 14:17:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.454 14:17:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.454 14:17:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.454 14:17:23 -- paths/export.sh@5 -- # export PATH 00:13:09.454 14:17:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:09.454 14:17:23 -- nvmf/common.sh@46 -- # : 0 00:13:09.454 14:17:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:09.454 14:17:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:09.454 14:17:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:09.454 14:17:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:09.454 14:17:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:09.454 14:17:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:09.454 14:17:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:09.454 14:17:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:09.454 14:17:23 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:09.454 14:17:23 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:09.454 14:17:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:09.454 14:17:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:09.454 14:17:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:09.454 14:17:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:09.454 14:17:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:09.454 14:17:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:09.454 14:17:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:09.454 14:17:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:09.454 14:17:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:09.454 14:17:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:09.454 14:17:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:09.454 14:17:23 -- common/autotest_common.sh@10 -- # set +x 00:13:14.727 14:17:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:14.727 14:17:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:14.727 14:17:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:14.727 14:17:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:14.727 14:17:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:14.727 14:17:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:14.727 14:17:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:14.727 14:17:29 -- nvmf/common.sh@294 -- # net_devs=() 00:13:14.727 14:17:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:14.727 14:17:29 -- nvmf/common.sh@295 -- # e810=() 00:13:14.727 14:17:29 -- nvmf/common.sh@295 -- # local -ga e810 00:13:14.727 14:17:29 -- nvmf/common.sh@296 -- # x722=() 00:13:14.727 14:17:29 -- nvmf/common.sh@296 -- # local -ga x722 00:13:14.727 14:17:29 -- nvmf/common.sh@297 -- # mlx=() 00:13:14.727 14:17:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:14.727 14:17:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:14.727 14:17:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:14.727 14:17:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:14.727 14:17:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:14.727 14:17:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:14.727 14:17:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:13:14.727 Found 0000:af:00.0 (0x8086 - 0x159b) 00:13:14.727 14:17:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:14.727 14:17:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:13:14.727 Found 0000:af:00.1 (0x8086 - 0x159b) 00:13:14.727 14:17:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:14.727 14:17:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:14.727 14:17:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:14.728 14:17:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:14.728 14:17:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:14.728 14:17:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:14.728 14:17:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:14.728 14:17:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:14.728 14:17:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:13:14.728 Found net devices under 0000:af:00.0: cvl_0_0 00:13:14.728 14:17:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:14.728 14:17:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:14.728 14:17:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:14.728 14:17:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:14.728 14:17:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:14.728 14:17:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:13:14.728 Found net devices under 0000:af:00.1: cvl_0_1 00:13:14.728 14:17:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:14.728 14:17:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:14.728 14:17:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:14.728 14:17:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:14.728 14:17:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:14.728 14:17:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:14.728 14:17:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:14.728 14:17:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:14.728 14:17:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:14.728 14:17:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:14.728 14:17:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:14.728 14:17:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:14.728 14:17:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:14.728 14:17:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:14.728 14:17:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:14.728 14:17:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:14.728 14:17:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:14.728 14:17:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:14.728 14:17:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:14.728 14:17:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:14.728 14:17:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:14.728 14:17:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:14.728 14:17:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:14.728 14:17:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:14.728 14:17:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:14.728 14:17:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:14.728 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:14.728 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.255 ms 00:13:14.728 00:13:14.728 --- 10.0.0.2 ping statistics --- 00:13:14.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:14.728 rtt min/avg/max/mdev = 0.255/0.255/0.255/0.000 ms 00:13:14.728 14:17:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:14.728 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:14.728 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.144 ms 00:13:14.728 00:13:14.728 --- 10.0.0.1 ping statistics --- 00:13:14.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:14.728 rtt min/avg/max/mdev = 0.144/0.144/0.144/0.000 ms 00:13:14.728 14:17:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:14.728 14:17:29 -- nvmf/common.sh@410 -- # return 0 00:13:14.728 14:17:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:14.728 14:17:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:14.728 14:17:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:14.728 14:17:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:14.728 14:17:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:14.728 14:17:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:14.728 14:17:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:14.728 14:17:29 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:14.728 14:17:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:14.728 14:17:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:14.728 14:17:29 -- common/autotest_common.sh@10 -- # set +x 00:13:14.728 14:17:29 -- nvmf/common.sh@469 -- # nvmfpid=308003 00:13:14.728 14:17:29 -- nvmf/common.sh@470 -- # waitforlisten 308003 00:13:14.728 14:17:29 -- common/autotest_common.sh@829 -- # '[' -z 308003 ']' 00:13:14.728 14:17:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:14.728 14:17:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:14.728 14:17:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:14.728 14:17:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:14.728 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:14.728 14:17:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:14.728 14:17:29 -- common/autotest_common.sh@10 -- # set +x 00:13:14.987 [2024-12-16 14:17:29.339058] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:14.987 [2024-12-16 14:17:29.339100] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:14.987 EAL: No free 2048 kB hugepages reported on node 1 00:13:14.987 [2024-12-16 14:17:29.396951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:14.987 [2024-12-16 14:17:29.470908] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:14.987 [2024-12-16 14:17:29.471019] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:14.987 [2024-12-16 14:17:29.471027] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:14.987 [2024-12-16 14:17:29.471033] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:14.987 [2024-12-16 14:17:29.471070] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:14.987 [2024-12-16 14:17:29.471171] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:14.987 [2024-12-16 14:17:29.471172] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:15.924 14:17:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:15.924 14:17:30 -- common/autotest_common.sh@862 -- # return 0 00:13:15.924 14:17:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:15.924 14:17:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:15.924 14:17:30 -- common/autotest_common.sh@10 -- # set +x 00:13:15.924 14:17:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:15.924 14:17:30 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:15.924 14:17:30 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:15.924 [2024-12-16 14:17:30.355075] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:15.924 14:17:30 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:16.183 14:17:30 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.183 [2024-12-16 14:17:30.732480] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.442 14:17:30 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:16.442 14:17:30 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:16.700 Malloc0 00:13:16.700 14:17:31 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:16.960 Delay0 00:13:16.960 14:17:31 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.219 14:17:31 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:17.219 NULL1 00:13:17.219 14:17:31 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:17.477 14:17:31 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=308459 00:13:17.477 14:17:31 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:17.477 14:17:31 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:17.477 14:17:31 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:17.477 EAL: No free 2048 kB hugepages reported on node 1 00:13:17.736 14:17:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:17.736 14:17:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:17.736 14:17:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:17.994 true 00:13:17.994 14:17:32 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:17.994 14:17:32 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.253 14:17:32 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:18.511 14:17:32 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:18.511 14:17:32 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:18.511 true 00:13:18.770 14:17:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:18.770 14:17:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:18.770 14:17:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.028 14:17:33 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:19.028 14:17:33 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:19.286 true 00:13:19.286 14:17:33 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:19.286 14:17:33 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:19.545 14:17:33 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:19.545 14:17:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:13:19.545 14:17:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:13:19.803 true 00:13:19.803 14:17:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:19.803 14:17:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.060 14:17:34 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.318 14:17:34 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:13:20.318 14:17:34 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:13:20.318 true 00:13:20.318 14:17:34 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:20.318 14:17:34 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:20.577 14:17:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:20.835 14:17:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:13:20.835 14:17:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:13:21.093 true 00:13:21.093 14:17:35 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:21.093 14:17:35 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.351 14:17:35 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:21.351 14:17:35 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:13:21.352 14:17:35 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:13:21.610 true 00:13:21.610 14:17:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:21.610 14:17:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:21.880 14:17:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:22.142 14:17:36 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:13:22.142 14:17:36 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:13:22.142 true 00:13:22.142 14:17:36 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:22.142 14:17:36 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.399 14:17:36 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:22.657 14:17:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:13:22.657 14:17:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:13:22.657 true 00:13:22.915 14:17:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:22.915 14:17:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:22.915 14:17:37 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.174 14:17:37 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:13:23.174 14:17:37 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:13:23.432 true 00:13:23.432 14:17:37 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:23.432 14:17:37 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:23.691 14:17:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:23.949 14:17:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:13:23.949 14:17:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:13:23.949 true 00:13:23.949 14:17:38 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:23.949 14:17:38 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.208 14:17:38 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:24.466 14:17:38 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:13:24.466 14:17:38 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:13:24.466 true 00:13:24.725 14:17:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:24.725 14:17:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:24.725 14:17:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:24.983 14:17:39 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:13:24.983 14:17:39 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:13:25.241 true 00:13:25.241 14:17:39 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:25.241 14:17:39 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:25.499 14:17:39 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:25.499 14:17:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:13:25.499 14:17:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:13:25.758 true 00:13:25.758 14:17:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:25.758 14:17:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.016 14:17:40 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:26.275 14:17:40 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:13:26.275 14:17:40 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:13:26.275 true 00:13:26.533 14:17:40 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:26.533 14:17:40 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:26.533 14:17:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:26.792 14:17:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:13:26.792 14:17:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:13:27.051 true 00:13:27.051 14:17:41 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:27.051 14:17:41 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.309 14:17:41 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:27.309 14:17:41 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:13:27.309 14:17:41 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:13:27.568 true 00:13:27.568 14:17:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:27.568 14:17:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:27.826 14:17:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:28.085 14:17:42 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:13:28.085 14:17:42 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:13:28.085 true 00:13:28.085 14:17:42 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:28.085 14:17:42 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:28.344 14:17:42 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:28.602 14:17:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:13:28.602 14:17:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:13:28.860 true 00:13:28.860 14:17:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:28.860 14:17:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.118 14:17:43 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:29.118 14:17:43 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:13:29.118 14:17:43 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:13:29.376 true 00:13:29.376 14:17:43 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:29.376 14:17:43 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:29.634 14:17:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:29.893 14:17:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:13:29.893 14:17:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:13:29.893 true 00:13:29.893 14:17:44 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:29.893 14:17:44 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:30.151 14:17:44 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:30.410 14:17:44 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:13:30.410 14:17:44 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:13:30.668 true 00:13:30.668 14:17:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:30.668 14:17:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:30.926 14:17:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:30.926 14:17:45 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:13:30.926 14:17:45 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:13:31.184 true 00:13:31.184 14:17:45 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:31.184 14:17:45 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.442 14:17:45 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:31.701 14:17:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:13:31.701 14:17:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:13:31.701 true 00:13:31.960 14:17:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:31.960 14:17:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.960 14:17:46 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:32.219 14:17:46 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:13:32.219 14:17:46 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:13:32.478 true 00:13:32.478 14:17:46 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:32.478 14:17:46 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:32.737 14:17:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:32.996 14:17:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:13:32.996 14:17:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:13:32.996 true 00:13:32.996 14:17:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:32.996 14:17:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.254 14:17:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:33.512 14:17:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:13:33.512 14:17:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:13:33.512 true 00:13:33.771 14:17:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:33.771 14:17:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:33.771 14:17:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:34.030 14:17:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:13:34.030 14:17:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:13:34.289 true 00:13:34.289 14:17:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:34.289 14:17:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:34.548 14:17:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:34.548 14:17:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:13:34.548 14:17:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:13:34.807 true 00:13:34.807 14:17:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:34.807 14:17:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.065 14:17:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:35.324 14:17:49 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:13:35.324 14:17:49 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:13:35.583 true 00:13:35.583 14:17:49 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:35.583 14:17:49 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:35.842 14:17:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:35.842 14:17:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1031 00:13:35.842 14:17:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1031 00:13:36.101 true 00:13:36.101 14:17:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:36.101 14:17:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.360 14:17:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:36.619 14:17:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1032 00:13:36.619 14:17:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1032 00:13:36.619 true 00:13:36.619 14:17:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:36.619 14:17:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:36.878 14:17:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.136 14:17:51 -- target/ns_hotplug_stress.sh@49 -- # null_size=1033 00:13:37.136 14:17:51 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1033 00:13:37.396 true 00:13:37.396 14:17:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:37.396 14:17:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:37.655 14:17:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:37.655 14:17:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1034 00:13:37.655 14:17:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1034 00:13:37.914 true 00:13:37.914 14:17:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:37.914 14:17:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.173 14:17:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.431 14:17:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1035 00:13:38.431 14:17:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1035 00:13:38.690 true 00:13:38.690 14:17:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:38.690 14:17:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:38.690 14:17:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:38.950 14:17:53 -- target/ns_hotplug_stress.sh@49 -- # null_size=1036 00:13:38.950 14:17:53 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1036 00:13:39.209 true 00:13:39.209 14:17:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:39.209 14:17:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:39.468 14:17:53 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:39.726 14:17:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1037 00:13:39.726 14:17:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1037 00:13:39.726 true 00:13:39.726 14:17:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:39.726 14:17:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:39.985 14:17:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:40.244 14:17:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1038 00:13:40.244 14:17:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1038 00:13:40.503 true 00:13:40.503 14:17:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:40.503 14:17:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:40.503 14:17:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:40.761 14:17:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1039 00:13:40.761 14:17:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1039 00:13:41.019 true 00:13:41.019 14:17:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:41.019 14:17:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.279 14:17:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:41.538 14:17:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1040 00:13:41.538 14:17:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1040 00:13:41.538 true 00:13:41.538 14:17:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:41.538 14:17:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:41.797 14:17:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.056 14:17:56 -- target/ns_hotplug_stress.sh@49 -- # null_size=1041 00:13:42.056 14:17:56 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1041 00:13:42.315 true 00:13:42.315 14:17:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:42.315 14:17:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:42.315 14:17:56 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:42.574 14:17:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1042 00:13:42.574 14:17:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1042 00:13:42.833 true 00:13:42.833 14:17:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:42.833 14:17:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.092 14:17:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.351 14:17:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1043 00:13:43.351 14:17:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1043 00:13:43.351 true 00:13:43.351 14:17:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:43.351 14:17:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:43.610 14:17:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:43.869 14:17:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1044 00:13:43.869 14:17:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1044 00:13:44.128 true 00:13:44.128 14:17:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:44.128 14:17:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.128 14:17:58 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:44.387 14:17:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1045 00:13:44.387 14:17:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1045 00:13:44.646 true 00:13:44.646 14:17:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:44.646 14:17:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:44.905 14:17:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.164 14:17:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1046 00:13:45.164 14:17:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1046 00:13:45.164 true 00:13:45.164 14:17:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:45.164 14:17:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.423 14:17:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:45.682 14:18:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1047 00:13:45.682 14:18:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1047 00:13:45.682 true 00:13:45.941 14:18:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:45.941 14:18:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:45.942 14:18:00 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.201 14:18:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1048 00:13:46.201 14:18:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1048 00:13:46.459 true 00:13:46.459 14:18:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:46.459 14:18:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:46.718 14:18:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:46.718 14:18:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1049 00:13:46.718 14:18:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1049 00:13:47.005 true 00:13:47.005 14:18:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:47.005 14:18:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:47.312 14:18:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:47.628 14:18:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1050 00:13:47.628 14:18:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1050 00:13:47.628 true 00:13:47.628 14:18:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:47.628 14:18:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:47.628 Initializing NVMe Controllers 00:13:47.628 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:13:47.628 Controller SPDK bdev Controller (SPDK00000000000001 ): Skipping inactive NS 1 00:13:47.628 Controller IO queue size 128, less than required. 00:13:47.628 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:13:47.628 WARNING: Some requested NVMe devices were skipped 00:13:47.628 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:13:47.628 Initialization complete. Launching workers. 00:13:47.628 ======================================================== 00:13:47.628 Latency(us) 00:13:47.628 Device Information : IOPS MiB/s Average min max 00:13:47.628 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 30562.40 14.92 4188.19 1274.69 7990.31 00:13:47.628 ======================================================== 00:13:47.628 Total : 30562.40 14.92 4188.19 1274.69 7990.31 00:13:47.628 00:13:47.888 14:18:02 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:48.146 14:18:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1051 00:13:48.146 14:18:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1051 00:13:48.146 true 00:13:48.146 14:18:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 308459 00:13:48.146 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (308459) - No such process 00:13:48.146 14:18:02 -- target/ns_hotplug_stress.sh@53 -- # wait 308459 00:13:48.146 14:18:02 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:48.405 14:18:02 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:48.664 14:18:03 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:13:48.664 14:18:03 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:13:48.664 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:13:48.664 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:48.664 14:18:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:13:48.664 null0 00:13:48.923 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:48.923 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:48.923 14:18:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:13:48.923 null1 00:13:48.923 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:48.923 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:48.923 14:18:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:13:49.182 null2 00:13:49.182 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:49.182 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:49.182 14:18:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:13:49.441 null3 00:13:49.441 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:49.441 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:49.441 14:18:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:13:49.441 null4 00:13:49.441 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:49.441 14:18:03 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:49.441 14:18:03 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:13:49.700 null5 00:13:49.700 14:18:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:49.700 14:18:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:49.700 14:18:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:13:49.959 null6 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:13:49.959 null7 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:13:49.959 14:18:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@66 -- # wait 314203 314204 314206 314208 314211 314212 314214 314216 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:49.960 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:50.219 14:18:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:50.219 14:18:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:50.219 14:18:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.219 14:18:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:50.219 14:18:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:50.219 14:18:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:50.219 14:18:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:50.219 14:18:04 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.477 14:18:04 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:50.735 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:50.735 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.736 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:50.994 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.251 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.252 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:51.252 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:51.252 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.252 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.252 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:51.252 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.252 14:18:05 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.252 14:18:05 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:51.510 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:51.510 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:51.510 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:51.510 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:51.510 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:51.510 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:51.510 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:51.510 14:18:05 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:51.510 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.510 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.510 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:51.510 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.510 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:51.768 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.027 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:52.285 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:52.285 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:52.285 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:52.285 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:52.285 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:52.285 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:52.285 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:52.285 14:18:06 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.544 14:18:06 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:52.544 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:52.544 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:52.544 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:52.544 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:52.544 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:52.544 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:52.544 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:52.544 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:52.803 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:53.062 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:53.062 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:53.062 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:53.062 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:53.062 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:53.062 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:53.062 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:53.062 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:53.322 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:53.581 14:18:07 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:53.581 14:18:08 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:13:53.840 14:18:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:53.840 14:18:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:13:53.840 14:18:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:13:53.840 14:18:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:13:53.840 14:18:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:53.840 14:18:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:13:53.840 14:18:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:13:53.840 14:18:08 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:13:54.100 14:18:08 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:13:54.100 14:18:08 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:54.100 14:18:08 -- nvmf/common.sh@116 -- # sync 00:13:54.100 14:18:08 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:54.100 14:18:08 -- nvmf/common.sh@119 -- # set +e 00:13:54.100 14:18:08 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:54.100 14:18:08 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:54.100 rmmod nvme_tcp 00:13:54.100 rmmod nvme_fabrics 00:13:54.100 rmmod nvme_keyring 00:13:54.100 14:18:08 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:54.100 14:18:08 -- nvmf/common.sh@123 -- # set -e 00:13:54.100 14:18:08 -- nvmf/common.sh@124 -- # return 0 00:13:54.100 14:18:08 -- nvmf/common.sh@477 -- # '[' -n 308003 ']' 00:13:54.100 14:18:08 -- nvmf/common.sh@478 -- # killprocess 308003 00:13:54.100 14:18:08 -- common/autotest_common.sh@936 -- # '[' -z 308003 ']' 00:13:54.100 14:18:08 -- common/autotest_common.sh@940 -- # kill -0 308003 00:13:54.100 14:18:08 -- common/autotest_common.sh@941 -- # uname 00:13:54.100 14:18:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:54.100 14:18:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 308003 00:13:54.100 14:18:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:54.100 14:18:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:54.100 14:18:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 308003' 00:13:54.100 killing process with pid 308003 00:13:54.100 14:18:08 -- common/autotest_common.sh@955 -- # kill 308003 00:13:54.100 14:18:08 -- common/autotest_common.sh@960 -- # wait 308003 00:13:54.359 14:18:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:54.359 14:18:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:54.359 14:18:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:54.359 14:18:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:54.359 14:18:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:54.359 14:18:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:54.359 14:18:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:54.359 14:18:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:56.894 14:18:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:56.894 00:13:56.894 real 0m47.184s 00:13:56.894 user 3m21.373s 00:13:56.894 sys 0m16.407s 00:13:56.894 14:18:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:56.894 14:18:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.894 ************************************ 00:13:56.894 END TEST nvmf_ns_hotplug_stress 00:13:56.894 ************************************ 00:13:56.894 14:18:10 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:56.894 14:18:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:56.894 14:18:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:56.894 14:18:10 -- common/autotest_common.sh@10 -- # set +x 00:13:56.894 ************************************ 00:13:56.894 START TEST nvmf_connect_stress 00:13:56.894 ************************************ 00:13:56.894 14:18:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:13:56.894 * Looking for test storage... 00:13:56.894 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:56.894 14:18:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:56.894 14:18:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:56.894 14:18:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:56.894 14:18:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:56.894 14:18:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:56.894 14:18:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:56.894 14:18:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:56.894 14:18:11 -- scripts/common.sh@335 -- # IFS=.-: 00:13:56.894 14:18:11 -- scripts/common.sh@335 -- # read -ra ver1 00:13:56.894 14:18:11 -- scripts/common.sh@336 -- # IFS=.-: 00:13:56.894 14:18:11 -- scripts/common.sh@336 -- # read -ra ver2 00:13:56.894 14:18:11 -- scripts/common.sh@337 -- # local 'op=<' 00:13:56.894 14:18:11 -- scripts/common.sh@339 -- # ver1_l=2 00:13:56.894 14:18:11 -- scripts/common.sh@340 -- # ver2_l=1 00:13:56.894 14:18:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:56.894 14:18:11 -- scripts/common.sh@343 -- # case "$op" in 00:13:56.894 14:18:11 -- scripts/common.sh@344 -- # : 1 00:13:56.894 14:18:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:56.894 14:18:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:56.894 14:18:11 -- scripts/common.sh@364 -- # decimal 1 00:13:56.894 14:18:11 -- scripts/common.sh@352 -- # local d=1 00:13:56.894 14:18:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:56.894 14:18:11 -- scripts/common.sh@354 -- # echo 1 00:13:56.894 14:18:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:56.894 14:18:11 -- scripts/common.sh@365 -- # decimal 2 00:13:56.894 14:18:11 -- scripts/common.sh@352 -- # local d=2 00:13:56.894 14:18:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:56.894 14:18:11 -- scripts/common.sh@354 -- # echo 2 00:13:56.894 14:18:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:56.894 14:18:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:56.894 14:18:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:56.894 14:18:11 -- scripts/common.sh@367 -- # return 0 00:13:56.894 14:18:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:56.894 14:18:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:56.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:56.894 --rc genhtml_branch_coverage=1 00:13:56.894 --rc genhtml_function_coverage=1 00:13:56.894 --rc genhtml_legend=1 00:13:56.894 --rc geninfo_all_blocks=1 00:13:56.894 --rc geninfo_unexecuted_blocks=1 00:13:56.894 00:13:56.894 ' 00:13:56.894 14:18:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:56.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:56.894 --rc genhtml_branch_coverage=1 00:13:56.894 --rc genhtml_function_coverage=1 00:13:56.894 --rc genhtml_legend=1 00:13:56.894 --rc geninfo_all_blocks=1 00:13:56.894 --rc geninfo_unexecuted_blocks=1 00:13:56.894 00:13:56.894 ' 00:13:56.894 14:18:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:56.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:56.894 --rc genhtml_branch_coverage=1 00:13:56.894 --rc genhtml_function_coverage=1 00:13:56.894 --rc genhtml_legend=1 00:13:56.894 --rc geninfo_all_blocks=1 00:13:56.894 --rc geninfo_unexecuted_blocks=1 00:13:56.894 00:13:56.894 ' 00:13:56.894 14:18:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:56.894 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:56.894 --rc genhtml_branch_coverage=1 00:13:56.894 --rc genhtml_function_coverage=1 00:13:56.894 --rc genhtml_legend=1 00:13:56.894 --rc geninfo_all_blocks=1 00:13:56.894 --rc geninfo_unexecuted_blocks=1 00:13:56.894 00:13:56.894 ' 00:13:56.894 14:18:11 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:56.894 14:18:11 -- nvmf/common.sh@7 -- # uname -s 00:13:56.894 14:18:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:56.894 14:18:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:56.894 14:18:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:56.894 14:18:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:56.894 14:18:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:56.894 14:18:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:56.894 14:18:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:56.894 14:18:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:56.894 14:18:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:56.894 14:18:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:56.894 14:18:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:13:56.894 14:18:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:13:56.894 14:18:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:56.894 14:18:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:56.894 14:18:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:56.895 14:18:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:56.895 14:18:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:56.895 14:18:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:56.895 14:18:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:56.895 14:18:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:56.895 14:18:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:56.895 14:18:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:56.895 14:18:11 -- paths/export.sh@5 -- # export PATH 00:13:56.895 14:18:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:56.895 14:18:11 -- nvmf/common.sh@46 -- # : 0 00:13:56.895 14:18:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:56.895 14:18:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:56.895 14:18:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:56.895 14:18:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:56.895 14:18:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:56.895 14:18:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:56.895 14:18:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:56.895 14:18:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:56.895 14:18:11 -- target/connect_stress.sh@12 -- # nvmftestinit 00:13:56.895 14:18:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:56.895 14:18:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:56.895 14:18:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:56.895 14:18:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:56.895 14:18:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:56.895 14:18:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:56.895 14:18:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:56.895 14:18:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:56.895 14:18:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:56.895 14:18:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:56.895 14:18:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:56.895 14:18:11 -- common/autotest_common.sh@10 -- # set +x 00:14:02.171 14:18:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:02.171 14:18:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:02.171 14:18:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:02.171 14:18:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:02.171 14:18:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:02.171 14:18:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:02.171 14:18:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:02.171 14:18:16 -- nvmf/common.sh@294 -- # net_devs=() 00:14:02.171 14:18:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:02.171 14:18:16 -- nvmf/common.sh@295 -- # e810=() 00:14:02.171 14:18:16 -- nvmf/common.sh@295 -- # local -ga e810 00:14:02.171 14:18:16 -- nvmf/common.sh@296 -- # x722=() 00:14:02.171 14:18:16 -- nvmf/common.sh@296 -- # local -ga x722 00:14:02.171 14:18:16 -- nvmf/common.sh@297 -- # mlx=() 00:14:02.171 14:18:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:02.171 14:18:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:02.171 14:18:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:02.171 14:18:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:02.171 14:18:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:02.171 14:18:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:02.171 14:18:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:14:02.171 Found 0000:af:00.0 (0x8086 - 0x159b) 00:14:02.171 14:18:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:02.171 14:18:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:14:02.171 Found 0000:af:00.1 (0x8086 - 0x159b) 00:14:02.171 14:18:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:02.171 14:18:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:02.171 14:18:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:02.171 14:18:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:02.171 14:18:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:02.171 14:18:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:02.171 14:18:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:14:02.171 Found net devices under 0000:af:00.0: cvl_0_0 00:14:02.171 14:18:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:02.171 14:18:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:02.171 14:18:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:02.171 14:18:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:02.171 14:18:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:02.172 14:18:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:14:02.172 Found net devices under 0000:af:00.1: cvl_0_1 00:14:02.172 14:18:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:02.172 14:18:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:02.172 14:18:16 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:02.172 14:18:16 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:02.172 14:18:16 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:02.172 14:18:16 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:02.172 14:18:16 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:02.172 14:18:16 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:02.172 14:18:16 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:02.172 14:18:16 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:02.172 14:18:16 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:02.172 14:18:16 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:02.172 14:18:16 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:02.172 14:18:16 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:02.172 14:18:16 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:02.172 14:18:16 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:02.172 14:18:16 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:02.172 14:18:16 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:02.172 14:18:16 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:02.172 14:18:16 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:02.172 14:18:16 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:02.172 14:18:16 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:02.172 14:18:16 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:02.172 14:18:16 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:02.172 14:18:16 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:02.172 14:18:16 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:02.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:02.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.405 ms 00:14:02.172 00:14:02.172 --- 10.0.0.2 ping statistics --- 00:14:02.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:02.172 rtt min/avg/max/mdev = 0.405/0.405/0.405/0.000 ms 00:14:02.172 14:18:16 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:02.172 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:02.172 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.248 ms 00:14:02.172 00:14:02.172 --- 10.0.0.1 ping statistics --- 00:14:02.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:02.172 rtt min/avg/max/mdev = 0.248/0.248/0.248/0.000 ms 00:14:02.172 14:18:16 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:02.172 14:18:16 -- nvmf/common.sh@410 -- # return 0 00:14:02.172 14:18:16 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:02.172 14:18:16 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:02.172 14:18:16 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:02.172 14:18:16 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:02.172 14:18:16 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:02.172 14:18:16 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:02.172 14:18:16 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:02.431 14:18:16 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:02.431 14:18:16 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:02.431 14:18:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:02.431 14:18:16 -- common/autotest_common.sh@10 -- # set +x 00:14:02.431 14:18:16 -- nvmf/common.sh@469 -- # nvmfpid=318915 00:14:02.431 14:18:16 -- nvmf/common.sh@470 -- # waitforlisten 318915 00:14:02.431 14:18:16 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:02.431 14:18:16 -- common/autotest_common.sh@829 -- # '[' -z 318915 ']' 00:14:02.431 14:18:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:02.431 14:18:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:02.431 14:18:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:02.431 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:02.431 14:18:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:02.431 14:18:16 -- common/autotest_common.sh@10 -- # set +x 00:14:02.431 [2024-12-16 14:18:16.824640] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:02.431 [2024-12-16 14:18:16.824688] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:02.431 EAL: No free 2048 kB hugepages reported on node 1 00:14:02.431 [2024-12-16 14:18:16.883540] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:02.431 [2024-12-16 14:18:16.958949] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:02.431 [2024-12-16 14:18:16.959055] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:02.431 [2024-12-16 14:18:16.959063] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:02.431 [2024-12-16 14:18:16.959069] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:02.431 [2024-12-16 14:18:16.959116] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:02.431 [2024-12-16 14:18:16.959202] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:02.431 [2024-12-16 14:18:16.959204] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:03.368 14:18:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:03.368 14:18:17 -- common/autotest_common.sh@862 -- # return 0 00:14:03.368 14:18:17 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:03.368 14:18:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:03.368 14:18:17 -- common/autotest_common.sh@10 -- # set +x 00:14:03.368 14:18:17 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:03.368 14:18:17 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:03.368 14:18:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.368 14:18:17 -- common/autotest_common.sh@10 -- # set +x 00:14:03.368 [2024-12-16 14:18:17.685661] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:03.368 14:18:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.368 14:18:17 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:03.368 14:18:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.368 14:18:17 -- common/autotest_common.sh@10 -- # set +x 00:14:03.368 14:18:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.368 14:18:17 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:03.368 14:18:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.368 14:18:17 -- common/autotest_common.sh@10 -- # set +x 00:14:03.368 [2024-12-16 14:18:17.723989] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:03.368 14:18:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.368 14:18:17 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:03.368 14:18:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.368 14:18:17 -- common/autotest_common.sh@10 -- # set +x 00:14:03.368 NULL1 00:14:03.368 14:18:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.368 14:18:17 -- target/connect_stress.sh@21 -- # PERF_PID=319163 00:14:03.368 14:18:17 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:03.368 14:18:17 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:03.368 14:18:17 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:03.368 14:18:17 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:03.368 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.368 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.368 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.368 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.368 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 EAL: No free 2048 kB hugepages reported on node 1 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:03.369 14:18:17 -- target/connect_stress.sh@28 -- # cat 00:14:03.369 14:18:17 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:03.369 14:18:17 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:03.369 14:18:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.369 14:18:17 -- common/autotest_common.sh@10 -- # set +x 00:14:03.628 14:18:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:03.628 14:18:18 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:03.628 14:18:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:03.628 14:18:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:03.628 14:18:18 -- common/autotest_common.sh@10 -- # set +x 00:14:04.195 14:18:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.195 14:18:18 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:04.195 14:18:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.195 14:18:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.195 14:18:18 -- common/autotest_common.sh@10 -- # set +x 00:14:04.453 14:18:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.454 14:18:18 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:04.454 14:18:18 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.454 14:18:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.454 14:18:18 -- common/autotest_common.sh@10 -- # set +x 00:14:04.713 14:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.713 14:18:19 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:04.713 14:18:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.713 14:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.713 14:18:19 -- common/autotest_common.sh@10 -- # set +x 00:14:04.972 14:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:04.972 14:18:19 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:04.972 14:18:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:04.972 14:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:04.972 14:18:19 -- common/autotest_common.sh@10 -- # set +x 00:14:05.231 14:18:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.231 14:18:19 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:05.231 14:18:19 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:05.231 14:18:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.231 14:18:19 -- common/autotest_common.sh@10 -- # set +x 00:14:05.799 14:18:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:05.799 14:18:20 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:05.799 14:18:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:05.799 14:18:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:05.799 14:18:20 -- common/autotest_common.sh@10 -- # set +x 00:14:06.057 14:18:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.057 14:18:20 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:06.057 14:18:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:06.057 14:18:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.057 14:18:20 -- common/autotest_common.sh@10 -- # set +x 00:14:06.316 14:18:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.316 14:18:20 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:06.316 14:18:20 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:06.316 14:18:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.316 14:18:20 -- common/autotest_common.sh@10 -- # set +x 00:14:06.575 14:18:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.575 14:18:21 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:06.575 14:18:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:06.575 14:18:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.575 14:18:21 -- common/autotest_common.sh@10 -- # set +x 00:14:06.834 14:18:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:06.834 14:18:21 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:06.834 14:18:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:06.834 14:18:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:06.834 14:18:21 -- common/autotest_common.sh@10 -- # set +x 00:14:07.402 14:18:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.402 14:18:21 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:07.402 14:18:21 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:07.402 14:18:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.402 14:18:21 -- common/autotest_common.sh@10 -- # set +x 00:14:07.660 14:18:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.660 14:18:22 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:07.660 14:18:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:07.660 14:18:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.660 14:18:22 -- common/autotest_common.sh@10 -- # set +x 00:14:07.918 14:18:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:07.918 14:18:22 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:07.918 14:18:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:07.918 14:18:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:07.918 14:18:22 -- common/autotest_common.sh@10 -- # set +x 00:14:08.177 14:18:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.177 14:18:22 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:08.177 14:18:22 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:08.177 14:18:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.177 14:18:22 -- common/autotest_common.sh@10 -- # set +x 00:14:08.436 14:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:08.436 14:18:23 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:08.436 14:18:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:08.436 14:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:08.436 14:18:23 -- common/autotest_common.sh@10 -- # set +x 00:14:09.003 14:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.003 14:18:23 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:09.003 14:18:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:09.003 14:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.003 14:18:23 -- common/autotest_common.sh@10 -- # set +x 00:14:09.262 14:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.262 14:18:23 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:09.262 14:18:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:09.262 14:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.262 14:18:23 -- common/autotest_common.sh@10 -- # set +x 00:14:09.521 14:18:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.521 14:18:23 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:09.521 14:18:23 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:09.521 14:18:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.521 14:18:23 -- common/autotest_common.sh@10 -- # set +x 00:14:09.779 14:18:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:09.779 14:18:24 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:09.779 14:18:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:09.779 14:18:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:09.779 14:18:24 -- common/autotest_common.sh@10 -- # set +x 00:14:10.347 14:18:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.347 14:18:24 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:10.347 14:18:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:10.347 14:18:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.347 14:18:24 -- common/autotest_common.sh@10 -- # set +x 00:14:10.606 14:18:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.606 14:18:24 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:10.606 14:18:24 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:10.606 14:18:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.606 14:18:24 -- common/autotest_common.sh@10 -- # set +x 00:14:10.864 14:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:10.864 14:18:25 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:10.864 14:18:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:10.864 14:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:10.864 14:18:25 -- common/autotest_common.sh@10 -- # set +x 00:14:11.122 14:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.122 14:18:25 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:11.122 14:18:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:11.122 14:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.122 14:18:25 -- common/autotest_common.sh@10 -- # set +x 00:14:11.380 14:18:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.380 14:18:25 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:11.380 14:18:25 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:11.380 14:18:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.380 14:18:25 -- common/autotest_common.sh@10 -- # set +x 00:14:11.947 14:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:11.947 14:18:26 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:11.947 14:18:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:11.947 14:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:11.947 14:18:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.205 14:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.205 14:18:26 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:12.205 14:18:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:12.206 14:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.206 14:18:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.464 14:18:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.464 14:18:26 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:12.464 14:18:26 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:12.464 14:18:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.464 14:18:26 -- common/autotest_common.sh@10 -- # set +x 00:14:12.723 14:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:12.723 14:18:27 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:12.723 14:18:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:12.723 14:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:12.723 14:18:27 -- common/autotest_common.sh@10 -- # set +x 00:14:13.291 14:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.291 14:18:27 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:13.291 14:18:27 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:13.291 14:18:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:13.291 14:18:27 -- common/autotest_common.sh@10 -- # set +x 00:14:13.291 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:13.549 14:18:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:13.549 14:18:27 -- target/connect_stress.sh@34 -- # kill -0 319163 00:14:13.549 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (319163) - No such process 00:14:13.549 14:18:27 -- target/connect_stress.sh@38 -- # wait 319163 00:14:13.549 14:18:27 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:13.549 14:18:27 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:13.549 14:18:27 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:13.549 14:18:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:13.549 14:18:27 -- nvmf/common.sh@116 -- # sync 00:14:13.549 14:18:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:13.549 14:18:27 -- nvmf/common.sh@119 -- # set +e 00:14:13.549 14:18:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:13.549 14:18:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:13.549 rmmod nvme_tcp 00:14:13.549 rmmod nvme_fabrics 00:14:13.549 rmmod nvme_keyring 00:14:13.549 14:18:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:13.549 14:18:27 -- nvmf/common.sh@123 -- # set -e 00:14:13.549 14:18:27 -- nvmf/common.sh@124 -- # return 0 00:14:13.549 14:18:27 -- nvmf/common.sh@477 -- # '[' -n 318915 ']' 00:14:13.549 14:18:27 -- nvmf/common.sh@478 -- # killprocess 318915 00:14:13.549 14:18:27 -- common/autotest_common.sh@936 -- # '[' -z 318915 ']' 00:14:13.549 14:18:27 -- common/autotest_common.sh@940 -- # kill -0 318915 00:14:13.549 14:18:27 -- common/autotest_common.sh@941 -- # uname 00:14:13.549 14:18:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:13.549 14:18:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 318915 00:14:13.549 14:18:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:13.549 14:18:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:13.549 14:18:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 318915' 00:14:13.549 killing process with pid 318915 00:14:13.549 14:18:28 -- common/autotest_common.sh@955 -- # kill 318915 00:14:13.549 14:18:28 -- common/autotest_common.sh@960 -- # wait 318915 00:14:13.807 14:18:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:13.808 14:18:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:13.808 14:18:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:13.808 14:18:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:13.808 14:18:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:13.808 14:18:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:13.808 14:18:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:13.808 14:18:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:15.713 14:18:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:15.713 00:14:15.713 real 0m19.360s 00:14:15.713 user 0m41.396s 00:14:15.713 sys 0m8.223s 00:14:15.713 14:18:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:15.713 14:18:30 -- common/autotest_common.sh@10 -- # set +x 00:14:15.713 ************************************ 00:14:15.713 END TEST nvmf_connect_stress 00:14:15.713 ************************************ 00:14:15.973 14:18:30 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:15.973 14:18:30 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:15.973 14:18:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:15.973 14:18:30 -- common/autotest_common.sh@10 -- # set +x 00:14:15.973 ************************************ 00:14:15.973 START TEST nvmf_fused_ordering 00:14:15.973 ************************************ 00:14:15.973 14:18:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:15.973 * Looking for test storage... 00:14:15.973 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:15.973 14:18:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:15.973 14:18:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:15.973 14:18:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:15.973 14:18:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:15.973 14:18:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:15.973 14:18:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:15.973 14:18:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:15.973 14:18:30 -- scripts/common.sh@335 -- # IFS=.-: 00:14:15.973 14:18:30 -- scripts/common.sh@335 -- # read -ra ver1 00:14:15.973 14:18:30 -- scripts/common.sh@336 -- # IFS=.-: 00:14:15.973 14:18:30 -- scripts/common.sh@336 -- # read -ra ver2 00:14:15.973 14:18:30 -- scripts/common.sh@337 -- # local 'op=<' 00:14:15.973 14:18:30 -- scripts/common.sh@339 -- # ver1_l=2 00:14:15.973 14:18:30 -- scripts/common.sh@340 -- # ver2_l=1 00:14:15.973 14:18:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:15.973 14:18:30 -- scripts/common.sh@343 -- # case "$op" in 00:14:15.973 14:18:30 -- scripts/common.sh@344 -- # : 1 00:14:15.973 14:18:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:15.973 14:18:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:15.973 14:18:30 -- scripts/common.sh@364 -- # decimal 1 00:14:15.973 14:18:30 -- scripts/common.sh@352 -- # local d=1 00:14:15.973 14:18:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:15.973 14:18:30 -- scripts/common.sh@354 -- # echo 1 00:14:15.973 14:18:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:15.973 14:18:30 -- scripts/common.sh@365 -- # decimal 2 00:14:15.973 14:18:30 -- scripts/common.sh@352 -- # local d=2 00:14:15.973 14:18:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:15.973 14:18:30 -- scripts/common.sh@354 -- # echo 2 00:14:15.973 14:18:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:15.973 14:18:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:15.973 14:18:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:15.973 14:18:30 -- scripts/common.sh@367 -- # return 0 00:14:15.973 14:18:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:15.973 14:18:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:15.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.973 --rc genhtml_branch_coverage=1 00:14:15.973 --rc genhtml_function_coverage=1 00:14:15.973 --rc genhtml_legend=1 00:14:15.973 --rc geninfo_all_blocks=1 00:14:15.973 --rc geninfo_unexecuted_blocks=1 00:14:15.973 00:14:15.973 ' 00:14:15.973 14:18:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:15.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.973 --rc genhtml_branch_coverage=1 00:14:15.973 --rc genhtml_function_coverage=1 00:14:15.973 --rc genhtml_legend=1 00:14:15.973 --rc geninfo_all_blocks=1 00:14:15.973 --rc geninfo_unexecuted_blocks=1 00:14:15.973 00:14:15.973 ' 00:14:15.973 14:18:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:15.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.973 --rc genhtml_branch_coverage=1 00:14:15.973 --rc genhtml_function_coverage=1 00:14:15.973 --rc genhtml_legend=1 00:14:15.973 --rc geninfo_all_blocks=1 00:14:15.973 --rc geninfo_unexecuted_blocks=1 00:14:15.973 00:14:15.973 ' 00:14:15.973 14:18:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:15.973 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:15.973 --rc genhtml_branch_coverage=1 00:14:15.973 --rc genhtml_function_coverage=1 00:14:15.973 --rc genhtml_legend=1 00:14:15.973 --rc geninfo_all_blocks=1 00:14:15.973 --rc geninfo_unexecuted_blocks=1 00:14:15.973 00:14:15.973 ' 00:14:15.973 14:18:30 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:15.973 14:18:30 -- nvmf/common.sh@7 -- # uname -s 00:14:15.973 14:18:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:15.973 14:18:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:15.973 14:18:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:15.973 14:18:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:15.973 14:18:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:15.973 14:18:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:15.973 14:18:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:15.973 14:18:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:15.973 14:18:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:15.973 14:18:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:15.973 14:18:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:14:15.973 14:18:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:14:15.973 14:18:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:15.973 14:18:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:15.973 14:18:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:15.973 14:18:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:15.973 14:18:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:15.973 14:18:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:15.973 14:18:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:15.973 14:18:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.973 14:18:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.973 14:18:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.973 14:18:30 -- paths/export.sh@5 -- # export PATH 00:14:15.973 14:18:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:15.973 14:18:30 -- nvmf/common.sh@46 -- # : 0 00:14:15.973 14:18:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:15.973 14:18:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:15.973 14:18:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:15.973 14:18:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:15.973 14:18:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:15.973 14:18:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:15.973 14:18:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:15.973 14:18:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:15.973 14:18:30 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:15.973 14:18:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:15.973 14:18:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:15.973 14:18:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:15.973 14:18:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:15.973 14:18:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:15.973 14:18:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:15.973 14:18:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:15.973 14:18:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:15.973 14:18:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:15.973 14:18:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:15.973 14:18:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:15.973 14:18:30 -- common/autotest_common.sh@10 -- # set +x 00:14:22.544 14:18:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:22.544 14:18:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:22.544 14:18:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:22.544 14:18:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:22.544 14:18:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:22.544 14:18:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:22.544 14:18:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:22.544 14:18:35 -- nvmf/common.sh@294 -- # net_devs=() 00:14:22.544 14:18:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:22.544 14:18:35 -- nvmf/common.sh@295 -- # e810=() 00:14:22.544 14:18:35 -- nvmf/common.sh@295 -- # local -ga e810 00:14:22.544 14:18:35 -- nvmf/common.sh@296 -- # x722=() 00:14:22.544 14:18:35 -- nvmf/common.sh@296 -- # local -ga x722 00:14:22.544 14:18:35 -- nvmf/common.sh@297 -- # mlx=() 00:14:22.544 14:18:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:22.544 14:18:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:22.544 14:18:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:22.544 14:18:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:22.544 14:18:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:22.544 14:18:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:22.544 14:18:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:14:22.544 Found 0000:af:00.0 (0x8086 - 0x159b) 00:14:22.544 14:18:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:22.544 14:18:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:14:22.544 Found 0000:af:00.1 (0x8086 - 0x159b) 00:14:22.544 14:18:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:22.544 14:18:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:22.544 14:18:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.544 14:18:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:22.544 14:18:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.544 14:18:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:14:22.544 Found net devices under 0000:af:00.0: cvl_0_0 00:14:22.544 14:18:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.544 14:18:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:22.544 14:18:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:22.544 14:18:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:22.544 14:18:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:22.544 14:18:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:14:22.544 Found net devices under 0000:af:00.1: cvl_0_1 00:14:22.544 14:18:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:22.544 14:18:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:22.544 14:18:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:22.544 14:18:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:22.544 14:18:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:22.544 14:18:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:22.544 14:18:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:22.544 14:18:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:22.544 14:18:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:22.544 14:18:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:22.544 14:18:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:22.544 14:18:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:22.544 14:18:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:22.544 14:18:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:22.544 14:18:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:22.544 14:18:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:22.544 14:18:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:22.544 14:18:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:22.544 14:18:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:22.544 14:18:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:22.544 14:18:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:22.544 14:18:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:22.544 14:18:36 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:22.544 14:18:36 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:22.544 14:18:36 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:22.544 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:22.544 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.340 ms 00:14:22.544 00:14:22.544 --- 10.0.0.2 ping statistics --- 00:14:22.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.544 rtt min/avg/max/mdev = 0.340/0.340/0.340/0.000 ms 00:14:22.544 14:18:36 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:22.544 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:22.544 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.192 ms 00:14:22.544 00:14:22.544 --- 10.0.0.1 ping statistics --- 00:14:22.544 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:22.544 rtt min/avg/max/mdev = 0.192/0.192/0.192/0.000 ms 00:14:22.544 14:18:36 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:22.544 14:18:36 -- nvmf/common.sh@410 -- # return 0 00:14:22.544 14:18:36 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:22.544 14:18:36 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:22.544 14:18:36 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:22.544 14:18:36 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:22.544 14:18:36 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:22.544 14:18:36 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:22.544 14:18:36 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:22.544 14:18:36 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:22.544 14:18:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:22.544 14:18:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:22.544 14:18:36 -- common/autotest_common.sh@10 -- # set +x 00:14:22.544 14:18:36 -- nvmf/common.sh@469 -- # nvmfpid=324259 00:14:22.544 14:18:36 -- nvmf/common.sh@470 -- # waitforlisten 324259 00:14:22.544 14:18:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:22.544 14:18:36 -- common/autotest_common.sh@829 -- # '[' -z 324259 ']' 00:14:22.544 14:18:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:22.544 14:18:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:22.544 14:18:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:22.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:22.544 14:18:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:22.544 14:18:36 -- common/autotest_common.sh@10 -- # set +x 00:14:22.544 [2024-12-16 14:18:36.192829] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:22.545 [2024-12-16 14:18:36.192884] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:22.545 EAL: No free 2048 kB hugepages reported on node 1 00:14:22.545 [2024-12-16 14:18:36.252462] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:22.545 [2024-12-16 14:18:36.328556] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:22.545 [2024-12-16 14:18:36.328662] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:22.545 [2024-12-16 14:18:36.328670] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:22.545 [2024-12-16 14:18:36.328676] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:22.545 [2024-12-16 14:18:36.328692] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:22.545 14:18:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:22.545 14:18:37 -- common/autotest_common.sh@862 -- # return 0 00:14:22.545 14:18:37 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:22.545 14:18:37 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:22.545 14:18:37 -- common/autotest_common.sh@10 -- # set +x 00:14:22.545 14:18:37 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:22.545 14:18:37 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:22.545 14:18:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.545 14:18:37 -- common/autotest_common.sh@10 -- # set +x 00:14:22.545 [2024-12-16 14:18:37.042947] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:22.545 14:18:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.545 14:18:37 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:22.545 14:18:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.545 14:18:37 -- common/autotest_common.sh@10 -- # set +x 00:14:22.545 14:18:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.545 14:18:37 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:22.545 14:18:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.545 14:18:37 -- common/autotest_common.sh@10 -- # set +x 00:14:22.545 [2024-12-16 14:18:37.063123] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:22.545 14:18:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.545 14:18:37 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:22.545 14:18:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.545 14:18:37 -- common/autotest_common.sh@10 -- # set +x 00:14:22.545 NULL1 00:14:22.545 14:18:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.545 14:18:37 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:22.545 14:18:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.545 14:18:37 -- common/autotest_common.sh@10 -- # set +x 00:14:22.545 14:18:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.545 14:18:37 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:22.545 14:18:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:22.545 14:18:37 -- common/autotest_common.sh@10 -- # set +x 00:14:22.545 14:18:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:22.545 14:18:37 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:22.545 [2024-12-16 14:18:37.115621] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:22.545 [2024-12-16 14:18:37.115651] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid324503 ] 00:14:22.805 EAL: No free 2048 kB hugepages reported on node 1 00:14:23.064 Attached to nqn.2016-06.io.spdk:cnode1 00:14:23.064 Namespace ID: 1 size: 1GB 00:14:23.064 fused_ordering(0) 00:14:23.064 fused_ordering(1) 00:14:23.064 fused_ordering(2) 00:14:23.064 fused_ordering(3) 00:14:23.064 fused_ordering(4) 00:14:23.064 fused_ordering(5) 00:14:23.064 fused_ordering(6) 00:14:23.064 fused_ordering(7) 00:14:23.064 fused_ordering(8) 00:14:23.064 fused_ordering(9) 00:14:23.064 fused_ordering(10) 00:14:23.064 fused_ordering(11) 00:14:23.064 fused_ordering(12) 00:14:23.064 fused_ordering(13) 00:14:23.064 fused_ordering(14) 00:14:23.064 fused_ordering(15) 00:14:23.064 fused_ordering(16) 00:14:23.064 fused_ordering(17) 00:14:23.064 fused_ordering(18) 00:14:23.064 fused_ordering(19) 00:14:23.064 fused_ordering(20) 00:14:23.064 fused_ordering(21) 00:14:23.064 fused_ordering(22) 00:14:23.064 fused_ordering(23) 00:14:23.064 fused_ordering(24) 00:14:23.064 fused_ordering(25) 00:14:23.064 fused_ordering(26) 00:14:23.064 fused_ordering(27) 00:14:23.064 fused_ordering(28) 00:14:23.064 fused_ordering(29) 00:14:23.064 fused_ordering(30) 00:14:23.064 fused_ordering(31) 00:14:23.064 fused_ordering(32) 00:14:23.064 fused_ordering(33) 00:14:23.064 fused_ordering(34) 00:14:23.064 fused_ordering(35) 00:14:23.064 fused_ordering(36) 00:14:23.064 fused_ordering(37) 00:14:23.064 fused_ordering(38) 00:14:23.064 fused_ordering(39) 00:14:23.064 fused_ordering(40) 00:14:23.064 fused_ordering(41) 00:14:23.064 fused_ordering(42) 00:14:23.064 fused_ordering(43) 00:14:23.064 fused_ordering(44) 00:14:23.064 fused_ordering(45) 00:14:23.064 fused_ordering(46) 00:14:23.064 fused_ordering(47) 00:14:23.064 fused_ordering(48) 00:14:23.064 fused_ordering(49) 00:14:23.064 fused_ordering(50) 00:14:23.064 fused_ordering(51) 00:14:23.064 fused_ordering(52) 00:14:23.064 fused_ordering(53) 00:14:23.064 fused_ordering(54) 00:14:23.064 fused_ordering(55) 00:14:23.064 fused_ordering(56) 00:14:23.064 fused_ordering(57) 00:14:23.064 fused_ordering(58) 00:14:23.064 fused_ordering(59) 00:14:23.064 fused_ordering(60) 00:14:23.064 fused_ordering(61) 00:14:23.064 fused_ordering(62) 00:14:23.064 fused_ordering(63) 00:14:23.064 fused_ordering(64) 00:14:23.064 fused_ordering(65) 00:14:23.064 fused_ordering(66) 00:14:23.064 fused_ordering(67) 00:14:23.064 fused_ordering(68) 00:14:23.064 fused_ordering(69) 00:14:23.064 fused_ordering(70) 00:14:23.064 fused_ordering(71) 00:14:23.064 fused_ordering(72) 00:14:23.064 fused_ordering(73) 00:14:23.064 fused_ordering(74) 00:14:23.064 fused_ordering(75) 00:14:23.064 fused_ordering(76) 00:14:23.064 fused_ordering(77) 00:14:23.064 fused_ordering(78) 00:14:23.064 fused_ordering(79) 00:14:23.064 fused_ordering(80) 00:14:23.064 fused_ordering(81) 00:14:23.064 fused_ordering(82) 00:14:23.064 fused_ordering(83) 00:14:23.064 fused_ordering(84) 00:14:23.064 fused_ordering(85) 00:14:23.064 fused_ordering(86) 00:14:23.064 fused_ordering(87) 00:14:23.064 fused_ordering(88) 00:14:23.064 fused_ordering(89) 00:14:23.064 fused_ordering(90) 00:14:23.064 fused_ordering(91) 00:14:23.064 fused_ordering(92) 00:14:23.064 fused_ordering(93) 00:14:23.064 fused_ordering(94) 00:14:23.065 fused_ordering(95) 00:14:23.065 fused_ordering(96) 00:14:23.065 fused_ordering(97) 00:14:23.065 fused_ordering(98) 00:14:23.065 fused_ordering(99) 00:14:23.065 fused_ordering(100) 00:14:23.065 fused_ordering(101) 00:14:23.065 fused_ordering(102) 00:14:23.065 fused_ordering(103) 00:14:23.065 fused_ordering(104) 00:14:23.065 fused_ordering(105) 00:14:23.065 fused_ordering(106) 00:14:23.065 fused_ordering(107) 00:14:23.065 fused_ordering(108) 00:14:23.065 fused_ordering(109) 00:14:23.065 fused_ordering(110) 00:14:23.065 fused_ordering(111) 00:14:23.065 fused_ordering(112) 00:14:23.065 fused_ordering(113) 00:14:23.065 fused_ordering(114) 00:14:23.065 fused_ordering(115) 00:14:23.065 fused_ordering(116) 00:14:23.065 fused_ordering(117) 00:14:23.065 fused_ordering(118) 00:14:23.065 fused_ordering(119) 00:14:23.065 fused_ordering(120) 00:14:23.065 fused_ordering(121) 00:14:23.065 fused_ordering(122) 00:14:23.065 fused_ordering(123) 00:14:23.065 fused_ordering(124) 00:14:23.065 fused_ordering(125) 00:14:23.065 fused_ordering(126) 00:14:23.065 fused_ordering(127) 00:14:23.065 fused_ordering(128) 00:14:23.065 fused_ordering(129) 00:14:23.065 fused_ordering(130) 00:14:23.065 fused_ordering(131) 00:14:23.065 fused_ordering(132) 00:14:23.065 fused_ordering(133) 00:14:23.065 fused_ordering(134) 00:14:23.065 fused_ordering(135) 00:14:23.065 fused_ordering(136) 00:14:23.065 fused_ordering(137) 00:14:23.065 fused_ordering(138) 00:14:23.065 fused_ordering(139) 00:14:23.065 fused_ordering(140) 00:14:23.065 fused_ordering(141) 00:14:23.065 fused_ordering(142) 00:14:23.065 fused_ordering(143) 00:14:23.065 fused_ordering(144) 00:14:23.065 fused_ordering(145) 00:14:23.065 fused_ordering(146) 00:14:23.065 fused_ordering(147) 00:14:23.065 fused_ordering(148) 00:14:23.065 fused_ordering(149) 00:14:23.065 fused_ordering(150) 00:14:23.065 fused_ordering(151) 00:14:23.065 fused_ordering(152) 00:14:23.065 fused_ordering(153) 00:14:23.065 fused_ordering(154) 00:14:23.065 fused_ordering(155) 00:14:23.065 fused_ordering(156) 00:14:23.065 fused_ordering(157) 00:14:23.065 fused_ordering(158) 00:14:23.065 fused_ordering(159) 00:14:23.065 fused_ordering(160) 00:14:23.065 fused_ordering(161) 00:14:23.065 fused_ordering(162) 00:14:23.065 fused_ordering(163) 00:14:23.065 fused_ordering(164) 00:14:23.065 fused_ordering(165) 00:14:23.065 fused_ordering(166) 00:14:23.065 fused_ordering(167) 00:14:23.065 fused_ordering(168) 00:14:23.065 fused_ordering(169) 00:14:23.065 fused_ordering(170) 00:14:23.065 fused_ordering(171) 00:14:23.065 fused_ordering(172) 00:14:23.065 fused_ordering(173) 00:14:23.065 fused_ordering(174) 00:14:23.065 fused_ordering(175) 00:14:23.065 fused_ordering(176) 00:14:23.065 fused_ordering(177) 00:14:23.065 fused_ordering(178) 00:14:23.065 fused_ordering(179) 00:14:23.065 fused_ordering(180) 00:14:23.065 fused_ordering(181) 00:14:23.065 fused_ordering(182) 00:14:23.065 fused_ordering(183) 00:14:23.065 fused_ordering(184) 00:14:23.065 fused_ordering(185) 00:14:23.065 fused_ordering(186) 00:14:23.065 fused_ordering(187) 00:14:23.065 fused_ordering(188) 00:14:23.065 fused_ordering(189) 00:14:23.065 fused_ordering(190) 00:14:23.065 fused_ordering(191) 00:14:23.065 fused_ordering(192) 00:14:23.065 fused_ordering(193) 00:14:23.065 fused_ordering(194) 00:14:23.065 fused_ordering(195) 00:14:23.065 fused_ordering(196) 00:14:23.065 fused_ordering(197) 00:14:23.065 fused_ordering(198) 00:14:23.065 fused_ordering(199) 00:14:23.065 fused_ordering(200) 00:14:23.065 fused_ordering(201) 00:14:23.065 fused_ordering(202) 00:14:23.065 fused_ordering(203) 00:14:23.065 fused_ordering(204) 00:14:23.065 fused_ordering(205) 00:14:23.362 fused_ordering(206) 00:14:23.362 fused_ordering(207) 00:14:23.362 fused_ordering(208) 00:14:23.362 fused_ordering(209) 00:14:23.362 fused_ordering(210) 00:14:23.362 fused_ordering(211) 00:14:23.362 fused_ordering(212) 00:14:23.362 fused_ordering(213) 00:14:23.362 fused_ordering(214) 00:14:23.362 fused_ordering(215) 00:14:23.362 fused_ordering(216) 00:14:23.362 fused_ordering(217) 00:14:23.362 fused_ordering(218) 00:14:23.362 fused_ordering(219) 00:14:23.362 fused_ordering(220) 00:14:23.362 fused_ordering(221) 00:14:23.362 fused_ordering(222) 00:14:23.362 fused_ordering(223) 00:14:23.362 fused_ordering(224) 00:14:23.362 fused_ordering(225) 00:14:23.362 fused_ordering(226) 00:14:23.362 fused_ordering(227) 00:14:23.362 fused_ordering(228) 00:14:23.362 fused_ordering(229) 00:14:23.362 fused_ordering(230) 00:14:23.362 fused_ordering(231) 00:14:23.362 fused_ordering(232) 00:14:23.362 fused_ordering(233) 00:14:23.362 fused_ordering(234) 00:14:23.362 fused_ordering(235) 00:14:23.362 fused_ordering(236) 00:14:23.362 fused_ordering(237) 00:14:23.362 fused_ordering(238) 00:14:23.362 fused_ordering(239) 00:14:23.362 fused_ordering(240) 00:14:23.362 fused_ordering(241) 00:14:23.362 fused_ordering(242) 00:14:23.362 fused_ordering(243) 00:14:23.362 fused_ordering(244) 00:14:23.362 fused_ordering(245) 00:14:23.362 fused_ordering(246) 00:14:23.362 fused_ordering(247) 00:14:23.362 fused_ordering(248) 00:14:23.362 fused_ordering(249) 00:14:23.362 fused_ordering(250) 00:14:23.362 fused_ordering(251) 00:14:23.362 fused_ordering(252) 00:14:23.362 fused_ordering(253) 00:14:23.362 fused_ordering(254) 00:14:23.362 fused_ordering(255) 00:14:23.362 fused_ordering(256) 00:14:23.362 fused_ordering(257) 00:14:23.362 fused_ordering(258) 00:14:23.362 fused_ordering(259) 00:14:23.362 fused_ordering(260) 00:14:23.362 fused_ordering(261) 00:14:23.362 fused_ordering(262) 00:14:23.362 fused_ordering(263) 00:14:23.362 fused_ordering(264) 00:14:23.362 fused_ordering(265) 00:14:23.362 fused_ordering(266) 00:14:23.362 fused_ordering(267) 00:14:23.362 fused_ordering(268) 00:14:23.362 fused_ordering(269) 00:14:23.362 fused_ordering(270) 00:14:23.362 fused_ordering(271) 00:14:23.362 fused_ordering(272) 00:14:23.362 fused_ordering(273) 00:14:23.362 fused_ordering(274) 00:14:23.362 fused_ordering(275) 00:14:23.362 fused_ordering(276) 00:14:23.362 fused_ordering(277) 00:14:23.362 fused_ordering(278) 00:14:23.362 fused_ordering(279) 00:14:23.362 fused_ordering(280) 00:14:23.362 fused_ordering(281) 00:14:23.362 fused_ordering(282) 00:14:23.362 fused_ordering(283) 00:14:23.362 fused_ordering(284) 00:14:23.362 fused_ordering(285) 00:14:23.362 fused_ordering(286) 00:14:23.362 fused_ordering(287) 00:14:23.362 fused_ordering(288) 00:14:23.362 fused_ordering(289) 00:14:23.362 fused_ordering(290) 00:14:23.362 fused_ordering(291) 00:14:23.362 fused_ordering(292) 00:14:23.362 fused_ordering(293) 00:14:23.362 fused_ordering(294) 00:14:23.362 fused_ordering(295) 00:14:23.362 fused_ordering(296) 00:14:23.362 fused_ordering(297) 00:14:23.362 fused_ordering(298) 00:14:23.362 fused_ordering(299) 00:14:23.362 fused_ordering(300) 00:14:23.362 fused_ordering(301) 00:14:23.362 fused_ordering(302) 00:14:23.362 fused_ordering(303) 00:14:23.362 fused_ordering(304) 00:14:23.362 fused_ordering(305) 00:14:23.362 fused_ordering(306) 00:14:23.362 fused_ordering(307) 00:14:23.362 fused_ordering(308) 00:14:23.362 fused_ordering(309) 00:14:23.362 fused_ordering(310) 00:14:23.362 fused_ordering(311) 00:14:23.362 fused_ordering(312) 00:14:23.362 fused_ordering(313) 00:14:23.362 fused_ordering(314) 00:14:23.362 fused_ordering(315) 00:14:23.362 fused_ordering(316) 00:14:23.362 fused_ordering(317) 00:14:23.362 fused_ordering(318) 00:14:23.362 fused_ordering(319) 00:14:23.362 fused_ordering(320) 00:14:23.362 fused_ordering(321) 00:14:23.362 fused_ordering(322) 00:14:23.362 fused_ordering(323) 00:14:23.362 fused_ordering(324) 00:14:23.362 fused_ordering(325) 00:14:23.362 fused_ordering(326) 00:14:23.362 fused_ordering(327) 00:14:23.362 fused_ordering(328) 00:14:23.362 fused_ordering(329) 00:14:23.362 fused_ordering(330) 00:14:23.362 fused_ordering(331) 00:14:23.362 fused_ordering(332) 00:14:23.362 fused_ordering(333) 00:14:23.362 fused_ordering(334) 00:14:23.362 fused_ordering(335) 00:14:23.362 fused_ordering(336) 00:14:23.362 fused_ordering(337) 00:14:23.362 fused_ordering(338) 00:14:23.362 fused_ordering(339) 00:14:23.362 fused_ordering(340) 00:14:23.362 fused_ordering(341) 00:14:23.362 fused_ordering(342) 00:14:23.362 fused_ordering(343) 00:14:23.362 fused_ordering(344) 00:14:23.362 fused_ordering(345) 00:14:23.362 fused_ordering(346) 00:14:23.362 fused_ordering(347) 00:14:23.362 fused_ordering(348) 00:14:23.362 fused_ordering(349) 00:14:23.362 fused_ordering(350) 00:14:23.362 fused_ordering(351) 00:14:23.362 fused_ordering(352) 00:14:23.362 fused_ordering(353) 00:14:23.362 fused_ordering(354) 00:14:23.362 fused_ordering(355) 00:14:23.362 fused_ordering(356) 00:14:23.362 fused_ordering(357) 00:14:23.362 fused_ordering(358) 00:14:23.362 fused_ordering(359) 00:14:23.362 fused_ordering(360) 00:14:23.362 fused_ordering(361) 00:14:23.362 fused_ordering(362) 00:14:23.362 fused_ordering(363) 00:14:23.362 fused_ordering(364) 00:14:23.362 fused_ordering(365) 00:14:23.362 fused_ordering(366) 00:14:23.362 fused_ordering(367) 00:14:23.362 fused_ordering(368) 00:14:23.362 fused_ordering(369) 00:14:23.362 fused_ordering(370) 00:14:23.362 fused_ordering(371) 00:14:23.362 fused_ordering(372) 00:14:23.362 fused_ordering(373) 00:14:23.362 fused_ordering(374) 00:14:23.362 fused_ordering(375) 00:14:23.362 fused_ordering(376) 00:14:23.362 fused_ordering(377) 00:14:23.362 fused_ordering(378) 00:14:23.362 fused_ordering(379) 00:14:23.362 fused_ordering(380) 00:14:23.362 fused_ordering(381) 00:14:23.362 fused_ordering(382) 00:14:23.362 fused_ordering(383) 00:14:23.362 fused_ordering(384) 00:14:23.362 fused_ordering(385) 00:14:23.362 fused_ordering(386) 00:14:23.362 fused_ordering(387) 00:14:23.362 fused_ordering(388) 00:14:23.362 fused_ordering(389) 00:14:23.362 fused_ordering(390) 00:14:23.362 fused_ordering(391) 00:14:23.362 fused_ordering(392) 00:14:23.362 fused_ordering(393) 00:14:23.362 fused_ordering(394) 00:14:23.362 fused_ordering(395) 00:14:23.362 fused_ordering(396) 00:14:23.362 fused_ordering(397) 00:14:23.362 fused_ordering(398) 00:14:23.362 fused_ordering(399) 00:14:23.362 fused_ordering(400) 00:14:23.362 fused_ordering(401) 00:14:23.362 fused_ordering(402) 00:14:23.362 fused_ordering(403) 00:14:23.362 fused_ordering(404) 00:14:23.362 fused_ordering(405) 00:14:23.362 fused_ordering(406) 00:14:23.362 fused_ordering(407) 00:14:23.362 fused_ordering(408) 00:14:23.362 fused_ordering(409) 00:14:23.362 fused_ordering(410) 00:14:23.697 fused_ordering(411) 00:14:23.697 fused_ordering(412) 00:14:23.697 fused_ordering(413) 00:14:23.697 fused_ordering(414) 00:14:23.697 fused_ordering(415) 00:14:23.697 fused_ordering(416) 00:14:23.697 fused_ordering(417) 00:14:23.697 fused_ordering(418) 00:14:23.697 fused_ordering(419) 00:14:23.697 fused_ordering(420) 00:14:23.697 fused_ordering(421) 00:14:23.697 fused_ordering(422) 00:14:23.697 fused_ordering(423) 00:14:23.697 fused_ordering(424) 00:14:23.697 fused_ordering(425) 00:14:23.697 fused_ordering(426) 00:14:23.697 fused_ordering(427) 00:14:23.697 fused_ordering(428) 00:14:23.697 fused_ordering(429) 00:14:23.697 fused_ordering(430) 00:14:23.697 fused_ordering(431) 00:14:23.697 fused_ordering(432) 00:14:23.697 fused_ordering(433) 00:14:23.697 fused_ordering(434) 00:14:23.697 fused_ordering(435) 00:14:23.697 fused_ordering(436) 00:14:23.697 fused_ordering(437) 00:14:23.697 fused_ordering(438) 00:14:23.697 fused_ordering(439) 00:14:23.697 fused_ordering(440) 00:14:23.697 fused_ordering(441) 00:14:23.697 fused_ordering(442) 00:14:23.697 fused_ordering(443) 00:14:23.697 fused_ordering(444) 00:14:23.697 fused_ordering(445) 00:14:23.697 fused_ordering(446) 00:14:23.697 fused_ordering(447) 00:14:23.697 fused_ordering(448) 00:14:23.697 fused_ordering(449) 00:14:23.697 fused_ordering(450) 00:14:23.697 fused_ordering(451) 00:14:23.697 fused_ordering(452) 00:14:23.697 fused_ordering(453) 00:14:23.697 fused_ordering(454) 00:14:23.697 fused_ordering(455) 00:14:23.697 fused_ordering(456) 00:14:23.697 fused_ordering(457) 00:14:23.697 fused_ordering(458) 00:14:23.697 fused_ordering(459) 00:14:23.697 fused_ordering(460) 00:14:23.697 fused_ordering(461) 00:14:23.697 fused_ordering(462) 00:14:23.697 fused_ordering(463) 00:14:23.697 fused_ordering(464) 00:14:23.697 fused_ordering(465) 00:14:23.697 fused_ordering(466) 00:14:23.697 fused_ordering(467) 00:14:23.697 fused_ordering(468) 00:14:23.697 fused_ordering(469) 00:14:23.698 fused_ordering(470) 00:14:23.698 fused_ordering(471) 00:14:23.698 fused_ordering(472) 00:14:23.698 fused_ordering(473) 00:14:23.698 fused_ordering(474) 00:14:23.698 fused_ordering(475) 00:14:23.698 fused_ordering(476) 00:14:23.698 fused_ordering(477) 00:14:23.698 fused_ordering(478) 00:14:23.698 fused_ordering(479) 00:14:23.698 fused_ordering(480) 00:14:23.698 fused_ordering(481) 00:14:23.698 fused_ordering(482) 00:14:23.698 fused_ordering(483) 00:14:23.698 fused_ordering(484) 00:14:23.698 fused_ordering(485) 00:14:23.698 fused_ordering(486) 00:14:23.698 fused_ordering(487) 00:14:23.698 fused_ordering(488) 00:14:23.698 fused_ordering(489) 00:14:23.698 fused_ordering(490) 00:14:23.698 fused_ordering(491) 00:14:23.698 fused_ordering(492) 00:14:23.698 fused_ordering(493) 00:14:23.698 fused_ordering(494) 00:14:23.698 fused_ordering(495) 00:14:23.698 fused_ordering(496) 00:14:23.698 fused_ordering(497) 00:14:23.698 fused_ordering(498) 00:14:23.698 fused_ordering(499) 00:14:23.698 fused_ordering(500) 00:14:23.698 fused_ordering(501) 00:14:23.698 fused_ordering(502) 00:14:23.698 fused_ordering(503) 00:14:23.698 fused_ordering(504) 00:14:23.698 fused_ordering(505) 00:14:23.698 fused_ordering(506) 00:14:23.698 fused_ordering(507) 00:14:23.698 fused_ordering(508) 00:14:23.698 fused_ordering(509) 00:14:23.698 fused_ordering(510) 00:14:23.698 fused_ordering(511) 00:14:23.698 fused_ordering(512) 00:14:23.698 fused_ordering(513) 00:14:23.698 fused_ordering(514) 00:14:23.698 fused_ordering(515) 00:14:23.698 fused_ordering(516) 00:14:23.698 fused_ordering(517) 00:14:23.698 fused_ordering(518) 00:14:23.698 fused_ordering(519) 00:14:23.698 fused_ordering(520) 00:14:23.698 fused_ordering(521) 00:14:23.698 fused_ordering(522) 00:14:23.698 fused_ordering(523) 00:14:23.698 fused_ordering(524) 00:14:23.698 fused_ordering(525) 00:14:23.698 fused_ordering(526) 00:14:23.698 fused_ordering(527) 00:14:23.698 fused_ordering(528) 00:14:23.698 fused_ordering(529) 00:14:23.698 fused_ordering(530) 00:14:23.698 fused_ordering(531) 00:14:23.698 fused_ordering(532) 00:14:23.698 fused_ordering(533) 00:14:23.698 fused_ordering(534) 00:14:23.698 fused_ordering(535) 00:14:23.698 fused_ordering(536) 00:14:23.698 fused_ordering(537) 00:14:23.698 fused_ordering(538) 00:14:23.698 fused_ordering(539) 00:14:23.698 fused_ordering(540) 00:14:23.698 fused_ordering(541) 00:14:23.698 fused_ordering(542) 00:14:23.698 fused_ordering(543) 00:14:23.698 fused_ordering(544) 00:14:23.698 fused_ordering(545) 00:14:23.698 fused_ordering(546) 00:14:23.698 fused_ordering(547) 00:14:23.698 fused_ordering(548) 00:14:23.698 fused_ordering(549) 00:14:23.698 fused_ordering(550) 00:14:23.698 fused_ordering(551) 00:14:23.698 fused_ordering(552) 00:14:23.698 fused_ordering(553) 00:14:23.698 fused_ordering(554) 00:14:23.698 fused_ordering(555) 00:14:23.698 fused_ordering(556) 00:14:23.698 fused_ordering(557) 00:14:23.698 fused_ordering(558) 00:14:23.698 fused_ordering(559) 00:14:23.698 fused_ordering(560) 00:14:23.698 fused_ordering(561) 00:14:23.698 fused_ordering(562) 00:14:23.698 fused_ordering(563) 00:14:23.698 fused_ordering(564) 00:14:23.698 fused_ordering(565) 00:14:23.698 fused_ordering(566) 00:14:23.698 fused_ordering(567) 00:14:23.698 fused_ordering(568) 00:14:23.698 fused_ordering(569) 00:14:23.698 fused_ordering(570) 00:14:23.698 fused_ordering(571) 00:14:23.698 fused_ordering(572) 00:14:23.698 fused_ordering(573) 00:14:23.698 fused_ordering(574) 00:14:23.698 fused_ordering(575) 00:14:23.698 fused_ordering(576) 00:14:23.698 fused_ordering(577) 00:14:23.698 fused_ordering(578) 00:14:23.698 fused_ordering(579) 00:14:23.698 fused_ordering(580) 00:14:23.698 fused_ordering(581) 00:14:23.698 fused_ordering(582) 00:14:23.698 fused_ordering(583) 00:14:23.698 fused_ordering(584) 00:14:23.698 fused_ordering(585) 00:14:23.698 fused_ordering(586) 00:14:23.698 fused_ordering(587) 00:14:23.698 fused_ordering(588) 00:14:23.698 fused_ordering(589) 00:14:23.698 fused_ordering(590) 00:14:23.698 fused_ordering(591) 00:14:23.698 fused_ordering(592) 00:14:23.698 fused_ordering(593) 00:14:23.698 fused_ordering(594) 00:14:23.698 fused_ordering(595) 00:14:23.698 fused_ordering(596) 00:14:23.698 fused_ordering(597) 00:14:23.698 fused_ordering(598) 00:14:23.698 fused_ordering(599) 00:14:23.698 fused_ordering(600) 00:14:23.698 fused_ordering(601) 00:14:23.698 fused_ordering(602) 00:14:23.698 fused_ordering(603) 00:14:23.698 fused_ordering(604) 00:14:23.698 fused_ordering(605) 00:14:23.698 fused_ordering(606) 00:14:23.698 fused_ordering(607) 00:14:23.698 fused_ordering(608) 00:14:23.698 fused_ordering(609) 00:14:23.698 fused_ordering(610) 00:14:23.698 fused_ordering(611) 00:14:23.698 fused_ordering(612) 00:14:23.698 fused_ordering(613) 00:14:23.698 fused_ordering(614) 00:14:23.698 fused_ordering(615) 00:14:23.957 fused_ordering(616) 00:14:23.957 fused_ordering(617) 00:14:23.957 fused_ordering(618) 00:14:23.957 fused_ordering(619) 00:14:23.957 fused_ordering(620) 00:14:23.957 fused_ordering(621) 00:14:23.957 fused_ordering(622) 00:14:23.957 fused_ordering(623) 00:14:23.957 fused_ordering(624) 00:14:23.957 fused_ordering(625) 00:14:23.957 fused_ordering(626) 00:14:23.957 fused_ordering(627) 00:14:23.957 fused_ordering(628) 00:14:23.957 fused_ordering(629) 00:14:23.957 fused_ordering(630) 00:14:23.957 fused_ordering(631) 00:14:23.957 fused_ordering(632) 00:14:23.957 fused_ordering(633) 00:14:23.957 fused_ordering(634) 00:14:23.957 fused_ordering(635) 00:14:23.957 fused_ordering(636) 00:14:23.957 fused_ordering(637) 00:14:23.957 fused_ordering(638) 00:14:23.957 fused_ordering(639) 00:14:23.957 fused_ordering(640) 00:14:23.957 fused_ordering(641) 00:14:23.957 fused_ordering(642) 00:14:23.957 fused_ordering(643) 00:14:23.957 fused_ordering(644) 00:14:23.957 fused_ordering(645) 00:14:23.957 fused_ordering(646) 00:14:23.957 fused_ordering(647) 00:14:23.957 fused_ordering(648) 00:14:23.957 fused_ordering(649) 00:14:23.957 fused_ordering(650) 00:14:23.957 fused_ordering(651) 00:14:23.957 fused_ordering(652) 00:14:23.957 fused_ordering(653) 00:14:23.957 fused_ordering(654) 00:14:23.957 fused_ordering(655) 00:14:23.957 fused_ordering(656) 00:14:23.957 fused_ordering(657) 00:14:23.957 fused_ordering(658) 00:14:23.957 fused_ordering(659) 00:14:23.957 fused_ordering(660) 00:14:23.957 fused_ordering(661) 00:14:23.957 fused_ordering(662) 00:14:23.957 fused_ordering(663) 00:14:23.957 fused_ordering(664) 00:14:23.957 fused_ordering(665) 00:14:23.957 fused_ordering(666) 00:14:23.957 fused_ordering(667) 00:14:23.957 fused_ordering(668) 00:14:23.957 fused_ordering(669) 00:14:23.957 fused_ordering(670) 00:14:23.957 fused_ordering(671) 00:14:23.957 fused_ordering(672) 00:14:23.957 fused_ordering(673) 00:14:23.957 fused_ordering(674) 00:14:23.957 fused_ordering(675) 00:14:23.957 fused_ordering(676) 00:14:23.957 fused_ordering(677) 00:14:23.957 fused_ordering(678) 00:14:23.957 fused_ordering(679) 00:14:23.957 fused_ordering(680) 00:14:23.957 fused_ordering(681) 00:14:23.957 fused_ordering(682) 00:14:23.957 fused_ordering(683) 00:14:23.957 fused_ordering(684) 00:14:23.957 fused_ordering(685) 00:14:23.957 fused_ordering(686) 00:14:23.957 fused_ordering(687) 00:14:23.957 fused_ordering(688) 00:14:23.957 fused_ordering(689) 00:14:23.957 fused_ordering(690) 00:14:23.957 fused_ordering(691) 00:14:23.957 fused_ordering(692) 00:14:23.957 fused_ordering(693) 00:14:23.957 fused_ordering(694) 00:14:23.957 fused_ordering(695) 00:14:23.957 fused_ordering(696) 00:14:23.957 fused_ordering(697) 00:14:23.957 fused_ordering(698) 00:14:23.957 fused_ordering(699) 00:14:23.957 fused_ordering(700) 00:14:23.957 fused_ordering(701) 00:14:23.957 fused_ordering(702) 00:14:23.957 fused_ordering(703) 00:14:23.957 fused_ordering(704) 00:14:23.957 fused_ordering(705) 00:14:23.957 fused_ordering(706) 00:14:23.957 fused_ordering(707) 00:14:23.957 fused_ordering(708) 00:14:23.957 fused_ordering(709) 00:14:23.957 fused_ordering(710) 00:14:23.957 fused_ordering(711) 00:14:23.957 fused_ordering(712) 00:14:23.957 fused_ordering(713) 00:14:23.957 fused_ordering(714) 00:14:23.957 fused_ordering(715) 00:14:23.957 fused_ordering(716) 00:14:23.957 fused_ordering(717) 00:14:23.957 fused_ordering(718) 00:14:23.957 fused_ordering(719) 00:14:23.957 fused_ordering(720) 00:14:23.957 fused_ordering(721) 00:14:23.957 fused_ordering(722) 00:14:23.957 fused_ordering(723) 00:14:23.957 fused_ordering(724) 00:14:23.957 fused_ordering(725) 00:14:23.958 fused_ordering(726) 00:14:23.958 fused_ordering(727) 00:14:23.958 fused_ordering(728) 00:14:23.958 fused_ordering(729) 00:14:23.958 fused_ordering(730) 00:14:23.958 fused_ordering(731) 00:14:23.958 fused_ordering(732) 00:14:23.958 fused_ordering(733) 00:14:23.958 fused_ordering(734) 00:14:23.958 fused_ordering(735) 00:14:23.958 fused_ordering(736) 00:14:23.958 fused_ordering(737) 00:14:23.958 fused_ordering(738) 00:14:23.958 fused_ordering(739) 00:14:23.958 fused_ordering(740) 00:14:23.958 fused_ordering(741) 00:14:23.958 fused_ordering(742) 00:14:23.958 fused_ordering(743) 00:14:23.958 fused_ordering(744) 00:14:23.958 fused_ordering(745) 00:14:23.958 fused_ordering(746) 00:14:23.958 fused_ordering(747) 00:14:23.958 fused_ordering(748) 00:14:23.958 fused_ordering(749) 00:14:23.958 fused_ordering(750) 00:14:23.958 fused_ordering(751) 00:14:23.958 fused_ordering(752) 00:14:23.958 fused_ordering(753) 00:14:23.958 fused_ordering(754) 00:14:23.958 fused_ordering(755) 00:14:23.958 fused_ordering(756) 00:14:23.958 fused_ordering(757) 00:14:23.958 fused_ordering(758) 00:14:23.958 fused_ordering(759) 00:14:23.958 fused_ordering(760) 00:14:23.958 fused_ordering(761) 00:14:23.958 fused_ordering(762) 00:14:23.958 fused_ordering(763) 00:14:23.958 fused_ordering(764) 00:14:23.958 fused_ordering(765) 00:14:23.958 fused_ordering(766) 00:14:23.958 fused_ordering(767) 00:14:23.958 fused_ordering(768) 00:14:23.958 fused_ordering(769) 00:14:23.958 fused_ordering(770) 00:14:23.958 fused_ordering(771) 00:14:23.958 fused_ordering(772) 00:14:23.958 fused_ordering(773) 00:14:23.958 fused_ordering(774) 00:14:23.958 fused_ordering(775) 00:14:23.958 fused_ordering(776) 00:14:23.958 fused_ordering(777) 00:14:23.958 fused_ordering(778) 00:14:23.958 fused_ordering(779) 00:14:23.958 fused_ordering(780) 00:14:23.958 fused_ordering(781) 00:14:23.958 fused_ordering(782) 00:14:23.958 fused_ordering(783) 00:14:23.958 fused_ordering(784) 00:14:23.958 fused_ordering(785) 00:14:23.958 fused_ordering(786) 00:14:23.958 fused_ordering(787) 00:14:23.958 fused_ordering(788) 00:14:23.958 fused_ordering(789) 00:14:23.958 fused_ordering(790) 00:14:23.958 fused_ordering(791) 00:14:23.958 fused_ordering(792) 00:14:23.958 fused_ordering(793) 00:14:23.958 fused_ordering(794) 00:14:23.958 fused_ordering(795) 00:14:23.958 fused_ordering(796) 00:14:23.958 fused_ordering(797) 00:14:23.958 fused_ordering(798) 00:14:23.958 fused_ordering(799) 00:14:23.958 fused_ordering(800) 00:14:23.958 fused_ordering(801) 00:14:23.958 fused_ordering(802) 00:14:23.958 fused_ordering(803) 00:14:23.958 fused_ordering(804) 00:14:23.958 fused_ordering(805) 00:14:23.958 fused_ordering(806) 00:14:23.958 fused_ordering(807) 00:14:23.958 fused_ordering(808) 00:14:23.958 fused_ordering(809) 00:14:23.958 fused_ordering(810) 00:14:23.958 fused_ordering(811) 00:14:23.958 fused_ordering(812) 00:14:23.958 fused_ordering(813) 00:14:23.958 fused_ordering(814) 00:14:23.958 fused_ordering(815) 00:14:23.958 fused_ordering(816) 00:14:23.958 fused_ordering(817) 00:14:23.958 fused_ordering(818) 00:14:23.958 fused_ordering(819) 00:14:23.958 fused_ordering(820) 00:14:24.527 fused_o[2024-12-16 14:18:38.948484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1647de0 is same with the state(5) to be set 00:14:24.527 rdering(821) 00:14:24.527 fused_ordering(822) 00:14:24.527 fused_ordering(823) 00:14:24.527 fused_ordering(824) 00:14:24.527 fused_ordering(825) 00:14:24.527 fused_ordering(826) 00:14:24.527 fused_ordering(827) 00:14:24.527 fused_ordering(828) 00:14:24.527 fused_ordering(829) 00:14:24.527 fused_ordering(830) 00:14:24.527 fused_ordering(831) 00:14:24.527 fused_ordering(832) 00:14:24.527 fused_ordering(833) 00:14:24.527 fused_ordering(834) 00:14:24.527 fused_ordering(835) 00:14:24.527 fused_ordering(836) 00:14:24.527 fused_ordering(837) 00:14:24.527 fused_ordering(838) 00:14:24.527 fused_ordering(839) 00:14:24.527 fused_ordering(840) 00:14:24.527 fused_ordering(841) 00:14:24.527 fused_ordering(842) 00:14:24.527 fused_ordering(843) 00:14:24.527 fused_ordering(844) 00:14:24.527 fused_ordering(845) 00:14:24.527 fused_ordering(846) 00:14:24.527 fused_ordering(847) 00:14:24.527 fused_ordering(848) 00:14:24.527 fused_ordering(849) 00:14:24.527 fused_ordering(850) 00:14:24.527 fused_ordering(851) 00:14:24.527 fused_ordering(852) 00:14:24.527 fused_ordering(853) 00:14:24.527 fused_ordering(854) 00:14:24.527 fused_ordering(855) 00:14:24.527 fused_ordering(856) 00:14:24.527 fused_ordering(857) 00:14:24.527 fused_ordering(858) 00:14:24.527 fused_ordering(859) 00:14:24.527 fused_ordering(860) 00:14:24.527 fused_ordering(861) 00:14:24.527 fused_ordering(862) 00:14:24.527 fused_ordering(863) 00:14:24.527 fused_ordering(864) 00:14:24.527 fused_ordering(865) 00:14:24.527 fused_ordering(866) 00:14:24.527 fused_ordering(867) 00:14:24.527 fused_ordering(868) 00:14:24.527 fused_ordering(869) 00:14:24.527 fused_ordering(870) 00:14:24.527 fused_ordering(871) 00:14:24.527 fused_ordering(872) 00:14:24.527 fused_ordering(873) 00:14:24.527 fused_ordering(874) 00:14:24.527 fused_ordering(875) 00:14:24.527 fused_ordering(876) 00:14:24.527 fused_ordering(877) 00:14:24.527 fused_ordering(878) 00:14:24.527 fused_ordering(879) 00:14:24.527 fused_ordering(880) 00:14:24.527 fused_ordering(881) 00:14:24.527 fused_ordering(882) 00:14:24.527 fused_ordering(883) 00:14:24.527 fused_ordering(884) 00:14:24.527 fused_ordering(885) 00:14:24.527 fused_ordering(886) 00:14:24.527 fused_ordering(887) 00:14:24.527 fused_ordering(888) 00:14:24.527 fused_ordering(889) 00:14:24.527 fused_ordering(890) 00:14:24.527 fused_ordering(891) 00:14:24.527 fused_ordering(892) 00:14:24.527 fused_ordering(893) 00:14:24.527 fused_ordering(894) 00:14:24.527 fused_ordering(895) 00:14:24.527 fused_ordering(896) 00:14:24.527 fused_ordering(897) 00:14:24.527 fused_ordering(898) 00:14:24.527 fused_ordering(899) 00:14:24.527 fused_ordering(900) 00:14:24.527 fused_ordering(901) 00:14:24.527 fused_ordering(902) 00:14:24.527 fused_ordering(903) 00:14:24.528 fused_ordering(904) 00:14:24.528 fused_ordering(905) 00:14:24.528 fused_ordering(906) 00:14:24.528 fused_ordering(907) 00:14:24.528 fused_ordering(908) 00:14:24.528 fused_ordering(909) 00:14:24.528 fused_ordering(910) 00:14:24.528 fused_ordering(911) 00:14:24.528 fused_ordering(912) 00:14:24.528 fused_ordering(913) 00:14:24.528 fused_ordering(914) 00:14:24.528 fused_ordering(915) 00:14:24.528 fused_ordering(916) 00:14:24.528 fused_ordering(917) 00:14:24.528 fused_ordering(918) 00:14:24.528 fused_ordering(919) 00:14:24.528 fused_ordering(920) 00:14:24.528 fused_ordering(921) 00:14:24.528 fused_ordering(922) 00:14:24.528 fused_ordering(923) 00:14:24.528 fused_ordering(924) 00:14:24.528 fused_ordering(925) 00:14:24.528 fused_ordering(926) 00:14:24.528 fused_ordering(927) 00:14:24.528 fused_ordering(928) 00:14:24.528 fused_ordering(929) 00:14:24.528 fused_ordering(930) 00:14:24.528 fused_ordering(931) 00:14:24.528 fused_ordering(932) 00:14:24.528 fused_ordering(933) 00:14:24.528 fused_ordering(934) 00:14:24.528 fused_ordering(935) 00:14:24.528 fused_ordering(936) 00:14:24.528 fused_ordering(937) 00:14:24.528 fused_ordering(938) 00:14:24.528 fused_ordering(939) 00:14:24.528 fused_ordering(940) 00:14:24.528 fused_ordering(941) 00:14:24.528 fused_ordering(942) 00:14:24.528 fused_ordering(943) 00:14:24.528 fused_ordering(944) 00:14:24.528 fused_ordering(945) 00:14:24.528 fused_ordering(946) 00:14:24.528 fused_ordering(947) 00:14:24.528 fused_ordering(948) 00:14:24.528 fused_ordering(949) 00:14:24.528 fused_ordering(950) 00:14:24.528 fused_ordering(951) 00:14:24.528 fused_ordering(952) 00:14:24.528 fused_ordering(953) 00:14:24.528 fused_ordering(954) 00:14:24.528 fused_ordering(955) 00:14:24.528 fused_ordering(956) 00:14:24.528 fused_ordering(957) 00:14:24.528 fused_ordering(958) 00:14:24.528 fused_ordering(959) 00:14:24.528 fused_ordering(960) 00:14:24.528 fused_ordering(961) 00:14:24.528 fused_ordering(962) 00:14:24.528 fused_ordering(963) 00:14:24.528 fused_ordering(964) 00:14:24.528 fused_ordering(965) 00:14:24.528 fused_ordering(966) 00:14:24.528 fused_ordering(967) 00:14:24.528 fused_ordering(968) 00:14:24.528 fused_ordering(969) 00:14:24.528 fused_ordering(970) 00:14:24.528 fused_ordering(971) 00:14:24.528 fused_ordering(972) 00:14:24.528 fused_ordering(973) 00:14:24.528 fused_ordering(974) 00:14:24.528 fused_ordering(975) 00:14:24.528 fused_ordering(976) 00:14:24.528 fused_ordering(977) 00:14:24.528 fused_ordering(978) 00:14:24.528 fused_ordering(979) 00:14:24.528 fused_ordering(980) 00:14:24.528 fused_ordering(981) 00:14:24.528 fused_ordering(982) 00:14:24.528 fused_ordering(983) 00:14:24.528 fused_ordering(984) 00:14:24.528 fused_ordering(985) 00:14:24.528 fused_ordering(986) 00:14:24.528 fused_ordering(987) 00:14:24.528 fused_ordering(988) 00:14:24.528 fused_ordering(989) 00:14:24.528 fused_ordering(990) 00:14:24.528 fused_ordering(991) 00:14:24.528 fused_ordering(992) 00:14:24.528 fused_ordering(993) 00:14:24.528 fused_ordering(994) 00:14:24.528 fused_ordering(995) 00:14:24.528 fused_ordering(996) 00:14:24.528 fused_ordering(997) 00:14:24.528 fused_ordering(998) 00:14:24.528 fused_ordering(999) 00:14:24.528 fused_ordering(1000) 00:14:24.528 fused_ordering(1001) 00:14:24.528 fused_ordering(1002) 00:14:24.528 fused_ordering(1003) 00:14:24.528 fused_ordering(1004) 00:14:24.528 fused_ordering(1005) 00:14:24.528 fused_ordering(1006) 00:14:24.528 fused_ordering(1007) 00:14:24.528 fused_ordering(1008) 00:14:24.528 fused_ordering(1009) 00:14:24.528 fused_ordering(1010) 00:14:24.528 fused_ordering(1011) 00:14:24.528 fused_ordering(1012) 00:14:24.528 fused_ordering(1013) 00:14:24.528 fused_ordering(1014) 00:14:24.528 fused_ordering(1015) 00:14:24.528 fused_ordering(1016) 00:14:24.528 fused_ordering(1017) 00:14:24.528 fused_ordering(1018) 00:14:24.528 fused_ordering(1019) 00:14:24.528 fused_ordering(1020) 00:14:24.528 fused_ordering(1021) 00:14:24.528 fused_ordering(1022) 00:14:24.528 fused_ordering(1023) 00:14:24.528 14:18:38 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:14:24.528 14:18:38 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:14:24.528 14:18:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:24.528 14:18:38 -- nvmf/common.sh@116 -- # sync 00:14:24.528 14:18:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:24.528 14:18:38 -- nvmf/common.sh@119 -- # set +e 00:14:24.528 14:18:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:24.528 14:18:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:24.528 rmmod nvme_tcp 00:14:24.528 rmmod nvme_fabrics 00:14:24.528 rmmod nvme_keyring 00:14:24.528 14:18:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:24.528 14:18:39 -- nvmf/common.sh@123 -- # set -e 00:14:24.528 14:18:39 -- nvmf/common.sh@124 -- # return 0 00:14:24.528 14:18:39 -- nvmf/common.sh@477 -- # '[' -n 324259 ']' 00:14:24.528 14:18:39 -- nvmf/common.sh@478 -- # killprocess 324259 00:14:24.528 14:18:39 -- common/autotest_common.sh@936 -- # '[' -z 324259 ']' 00:14:24.528 14:18:39 -- common/autotest_common.sh@940 -- # kill -0 324259 00:14:24.528 14:18:39 -- common/autotest_common.sh@941 -- # uname 00:14:24.528 14:18:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:24.528 14:18:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 324259 00:14:24.528 14:18:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:24.528 14:18:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:24.528 14:18:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 324259' 00:14:24.528 killing process with pid 324259 00:14:24.528 14:18:39 -- common/autotest_common.sh@955 -- # kill 324259 00:14:24.528 14:18:39 -- common/autotest_common.sh@960 -- # wait 324259 00:14:24.787 14:18:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:24.787 14:18:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:24.787 14:18:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:24.787 14:18:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:24.788 14:18:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:24.788 14:18:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:24.788 14:18:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:24.788 14:18:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:27.324 14:18:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:27.324 00:14:27.324 real 0m11.024s 00:14:27.324 user 0m5.735s 00:14:27.324 sys 0m5.609s 00:14:27.324 14:18:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:27.324 14:18:41 -- common/autotest_common.sh@10 -- # set +x 00:14:27.324 ************************************ 00:14:27.324 END TEST nvmf_fused_ordering 00:14:27.324 ************************************ 00:14:27.324 14:18:41 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:27.324 14:18:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:27.324 14:18:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:27.324 14:18:41 -- common/autotest_common.sh@10 -- # set +x 00:14:27.324 ************************************ 00:14:27.324 START TEST nvmf_delete_subsystem 00:14:27.324 ************************************ 00:14:27.324 14:18:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:14:27.324 * Looking for test storage... 00:14:27.324 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:27.324 14:18:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:27.324 14:18:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:27.324 14:18:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:27.324 14:18:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:27.324 14:18:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:27.324 14:18:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:27.324 14:18:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:27.324 14:18:41 -- scripts/common.sh@335 -- # IFS=.-: 00:14:27.324 14:18:41 -- scripts/common.sh@335 -- # read -ra ver1 00:14:27.324 14:18:41 -- scripts/common.sh@336 -- # IFS=.-: 00:14:27.324 14:18:41 -- scripts/common.sh@336 -- # read -ra ver2 00:14:27.324 14:18:41 -- scripts/common.sh@337 -- # local 'op=<' 00:14:27.324 14:18:41 -- scripts/common.sh@339 -- # ver1_l=2 00:14:27.324 14:18:41 -- scripts/common.sh@340 -- # ver2_l=1 00:14:27.324 14:18:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:27.324 14:18:41 -- scripts/common.sh@343 -- # case "$op" in 00:14:27.324 14:18:41 -- scripts/common.sh@344 -- # : 1 00:14:27.324 14:18:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:27.324 14:18:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:27.324 14:18:41 -- scripts/common.sh@364 -- # decimal 1 00:14:27.324 14:18:41 -- scripts/common.sh@352 -- # local d=1 00:14:27.324 14:18:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:27.324 14:18:41 -- scripts/common.sh@354 -- # echo 1 00:14:27.324 14:18:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:27.324 14:18:41 -- scripts/common.sh@365 -- # decimal 2 00:14:27.324 14:18:41 -- scripts/common.sh@352 -- # local d=2 00:14:27.324 14:18:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:27.324 14:18:41 -- scripts/common.sh@354 -- # echo 2 00:14:27.324 14:18:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:27.324 14:18:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:27.324 14:18:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:27.324 14:18:41 -- scripts/common.sh@367 -- # return 0 00:14:27.324 14:18:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:27.324 14:18:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:27.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.324 --rc genhtml_branch_coverage=1 00:14:27.324 --rc genhtml_function_coverage=1 00:14:27.324 --rc genhtml_legend=1 00:14:27.324 --rc geninfo_all_blocks=1 00:14:27.324 --rc geninfo_unexecuted_blocks=1 00:14:27.324 00:14:27.324 ' 00:14:27.324 14:18:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:27.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.324 --rc genhtml_branch_coverage=1 00:14:27.324 --rc genhtml_function_coverage=1 00:14:27.324 --rc genhtml_legend=1 00:14:27.324 --rc geninfo_all_blocks=1 00:14:27.324 --rc geninfo_unexecuted_blocks=1 00:14:27.324 00:14:27.324 ' 00:14:27.324 14:18:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:27.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.324 --rc genhtml_branch_coverage=1 00:14:27.324 --rc genhtml_function_coverage=1 00:14:27.324 --rc genhtml_legend=1 00:14:27.324 --rc geninfo_all_blocks=1 00:14:27.324 --rc geninfo_unexecuted_blocks=1 00:14:27.324 00:14:27.324 ' 00:14:27.324 14:18:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:27.324 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:27.324 --rc genhtml_branch_coverage=1 00:14:27.324 --rc genhtml_function_coverage=1 00:14:27.324 --rc genhtml_legend=1 00:14:27.324 --rc geninfo_all_blocks=1 00:14:27.324 --rc geninfo_unexecuted_blocks=1 00:14:27.324 00:14:27.324 ' 00:14:27.324 14:18:41 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:27.324 14:18:41 -- nvmf/common.sh@7 -- # uname -s 00:14:27.324 14:18:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:27.324 14:18:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:27.324 14:18:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:27.324 14:18:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:27.324 14:18:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:27.324 14:18:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:27.324 14:18:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:27.324 14:18:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:27.324 14:18:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:27.325 14:18:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:27.325 14:18:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:14:27.325 14:18:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:14:27.325 14:18:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:27.325 14:18:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:27.325 14:18:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:27.325 14:18:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:27.325 14:18:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:27.325 14:18:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:27.325 14:18:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:27.325 14:18:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.325 14:18:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.325 14:18:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.325 14:18:41 -- paths/export.sh@5 -- # export PATH 00:14:27.325 14:18:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:27.325 14:18:41 -- nvmf/common.sh@46 -- # : 0 00:14:27.325 14:18:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:27.325 14:18:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:27.325 14:18:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:27.325 14:18:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:27.325 14:18:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:27.325 14:18:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:27.325 14:18:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:27.325 14:18:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:27.325 14:18:41 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:14:27.325 14:18:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:27.325 14:18:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:27.325 14:18:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:27.325 14:18:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:27.325 14:18:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:27.325 14:18:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:27.325 14:18:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:27.325 14:18:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:27.325 14:18:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:27.325 14:18:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:27.325 14:18:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:27.325 14:18:41 -- common/autotest_common.sh@10 -- # set +x 00:14:32.599 14:18:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:32.599 14:18:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:32.599 14:18:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:32.599 14:18:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:32.599 14:18:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:32.599 14:18:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:32.599 14:18:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:32.599 14:18:46 -- nvmf/common.sh@294 -- # net_devs=() 00:14:32.599 14:18:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:32.599 14:18:46 -- nvmf/common.sh@295 -- # e810=() 00:14:32.599 14:18:46 -- nvmf/common.sh@295 -- # local -ga e810 00:14:32.599 14:18:46 -- nvmf/common.sh@296 -- # x722=() 00:14:32.599 14:18:46 -- nvmf/common.sh@296 -- # local -ga x722 00:14:32.599 14:18:46 -- nvmf/common.sh@297 -- # mlx=() 00:14:32.599 14:18:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:32.599 14:18:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:32.599 14:18:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:32.600 14:18:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:32.600 14:18:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:32.600 14:18:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:32.600 14:18:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:32.600 14:18:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:32.600 14:18:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:14:32.600 Found 0000:af:00.0 (0x8086 - 0x159b) 00:14:32.600 14:18:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:32.600 14:18:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:14:32.600 Found 0000:af:00.1 (0x8086 - 0x159b) 00:14:32.600 14:18:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:32.600 14:18:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:32.600 14:18:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.600 14:18:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:32.600 14:18:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.600 14:18:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:14:32.600 Found net devices under 0000:af:00.0: cvl_0_0 00:14:32.600 14:18:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.600 14:18:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:32.600 14:18:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:32.600 14:18:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:32.600 14:18:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:32.600 14:18:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:14:32.600 Found net devices under 0000:af:00.1: cvl_0_1 00:14:32.600 14:18:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:32.600 14:18:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:32.600 14:18:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:32.600 14:18:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:32.600 14:18:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:32.600 14:18:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:32.600 14:18:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:32.600 14:18:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:32.600 14:18:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:32.600 14:18:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:32.600 14:18:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:32.600 14:18:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:32.600 14:18:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:32.600 14:18:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:32.600 14:18:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:32.600 14:18:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:32.600 14:18:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:32.600 14:18:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:32.600 14:18:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:32.600 14:18:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:32.600 14:18:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:32.600 14:18:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:32.600 14:18:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:32.600 14:18:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:32.600 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:32.600 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.382 ms 00:14:32.600 00:14:32.600 --- 10.0.0.2 ping statistics --- 00:14:32.600 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:32.600 rtt min/avg/max/mdev = 0.382/0.382/0.382/0.000 ms 00:14:32.600 14:18:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:32.600 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:32.600 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.198 ms 00:14:32.600 00:14:32.600 --- 10.0.0.1 ping statistics --- 00:14:32.600 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:32.600 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:14:32.600 14:18:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:32.600 14:18:46 -- nvmf/common.sh@410 -- # return 0 00:14:32.600 14:18:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:32.600 14:18:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:32.600 14:18:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:32.600 14:18:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:32.600 14:18:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:32.600 14:18:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:32.600 14:18:46 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:14:32.600 14:18:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:32.600 14:18:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:32.600 14:18:46 -- common/autotest_common.sh@10 -- # set +x 00:14:32.600 14:18:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:14:32.600 14:18:47 -- nvmf/common.sh@469 -- # nvmfpid=328213 00:14:32.600 14:18:47 -- nvmf/common.sh@470 -- # waitforlisten 328213 00:14:32.600 14:18:47 -- common/autotest_common.sh@829 -- # '[' -z 328213 ']' 00:14:32.600 14:18:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:32.600 14:18:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:32.600 14:18:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:32.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:32.600 14:18:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:32.600 14:18:47 -- common/autotest_common.sh@10 -- # set +x 00:14:32.600 [2024-12-16 14:18:47.028618] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:32.600 [2024-12-16 14:18:47.028659] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:32.600 EAL: No free 2048 kB hugepages reported on node 1 00:14:32.600 [2024-12-16 14:18:47.086877] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:14:32.600 [2024-12-16 14:18:47.161636] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:32.600 [2024-12-16 14:18:47.161743] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:32.600 [2024-12-16 14:18:47.161751] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:32.600 [2024-12-16 14:18:47.161757] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:32.600 [2024-12-16 14:18:47.161800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:32.600 [2024-12-16 14:18:47.161803] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:33.537 14:18:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:33.537 14:18:47 -- common/autotest_common.sh@862 -- # return 0 00:14:33.537 14:18:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:33.537 14:18:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:33.537 14:18:47 -- common/autotest_common.sh@10 -- # set +x 00:14:33.537 14:18:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:33.537 14:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.537 14:18:47 -- common/autotest_common.sh@10 -- # set +x 00:14:33.537 [2024-12-16 14:18:47.898875] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:33.537 14:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:33.537 14:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.537 14:18:47 -- common/autotest_common.sh@10 -- # set +x 00:14:33.537 14:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:33.537 14:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.537 14:18:47 -- common/autotest_common.sh@10 -- # set +x 00:14:33.537 [2024-12-16 14:18:47.919034] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:33.537 14:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:33.537 14:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.537 14:18:47 -- common/autotest_common.sh@10 -- # set +x 00:14:33.537 NULL1 00:14:33.537 14:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:14:33.537 14:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.537 14:18:47 -- common/autotest_common.sh@10 -- # set +x 00:14:33.537 Delay0 00:14:33.537 14:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:33.537 14:18:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:33.537 14:18:47 -- common/autotest_common.sh@10 -- # set +x 00:14:33.537 14:18:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@28 -- # perf_pid=328460 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@30 -- # sleep 2 00:14:33.537 14:18:47 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:33.537 EAL: No free 2048 kB hugepages reported on node 1 00:14:33.537 [2024-12-16 14:18:48.000574] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:35.442 14:18:49 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:35.442 14:18:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:35.442 14:18:49 -- common/autotest_common.sh@10 -- # set +x 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 [2024-12-16 14:18:50.120586] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff97c00bf20 is same with the state(5) to be set 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 [2024-12-16 14:18:50.120933] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff97c000c00 is same with the state(5) to be set 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 [2024-12-16 14:18:50.121295] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff97c00c480 is same with the state(5) to be set 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 starting I/O failed: -6 00:14:35.701 Read completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.701 Write completed with error (sct=0, sc=8) 00:14:35.702 starting I/O failed: -6 00:14:35.702 Read completed with error (sct=0, sc=8) 00:14:35.702 Write completed with error (sct=0, sc=8) 00:14:35.702 Read completed with error (sct=0, sc=8) 00:14:35.702 Read completed with error (sct=0, sc=8) 00:14:35.702 starting I/O failed: -6 00:14:35.702 Read completed with error (sct=0, sc=8) 00:14:35.702 Read completed with error (sct=0, sc=8) 00:14:35.702 Write completed with error (sct=0, sc=8) 00:14:35.702 Write completed with error (sct=0, sc=8) 00:14:35.702 starting I/O failed: -6 00:14:35.702 Read completed with error (sct=0, sc=8) 00:14:36.638 [2024-12-16 14:18:51.097514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf0fb90 is same with the state(5) to be set 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.638 Write completed with error (sct=0, sc=8) 00:14:36.638 Read completed with error (sct=0, sc=8) 00:14:36.639 [2024-12-16 14:18:51.123144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf09de0 is same with the state(5) to be set 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 [2024-12-16 14:18:51.123358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff97c00c1d0 is same with the state(5) to be set 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 [2024-12-16 14:18:51.123691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef5930 is same with the state(5) to be set 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Write completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 Read completed with error (sct=0, sc=8) 00:14:36.639 [2024-12-16 14:18:51.123843] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xef5ab0 is same with the state(5) to be set 00:14:36.639 [2024-12-16 14:18:51.124493] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xf0fb90 (9): Bad file descriptor 00:14:36.639 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:14:36.639 14:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:36.639 14:18:51 -- target/delete_subsystem.sh@34 -- # delay=0 00:14:36.639 Initializing NVMe Controllers 00:14:36.639 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:36.639 Controller IO queue size 128, less than required. 00:14:36.639 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:36.639 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:36.639 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:36.639 Initialization complete. Launching workers. 00:14:36.639 ======================================================== 00:14:36.639 Latency(us) 00:14:36.639 Device Information : IOPS MiB/s Average min max 00:14:36.639 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 195.59 0.10 943581.60 505.04 1011983.47 00:14:36.639 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 152.90 0.07 885458.01 355.73 1011853.83 00:14:36.639 ======================================================== 00:14:36.639 Total : 348.49 0.17 918080.08 355.73 1011983.47 00:14:36.639 00:14:36.639 14:18:51 -- target/delete_subsystem.sh@35 -- # kill -0 328460 00:14:36.639 14:18:51 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@35 -- # kill -0 328460 00:14:37.207 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (328460) - No such process 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@45 -- # NOT wait 328460 00:14:37.207 14:18:51 -- common/autotest_common.sh@650 -- # local es=0 00:14:37.207 14:18:51 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 328460 00:14:37.207 14:18:51 -- common/autotest_common.sh@638 -- # local arg=wait 00:14:37.207 14:18:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:37.207 14:18:51 -- common/autotest_common.sh@642 -- # type -t wait 00:14:37.207 14:18:51 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:14:37.207 14:18:51 -- common/autotest_common.sh@653 -- # wait 328460 00:14:37.207 14:18:51 -- common/autotest_common.sh@653 -- # es=1 00:14:37.207 14:18:51 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:14:37.207 14:18:51 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:14:37.207 14:18:51 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:37.207 14:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.207 14:18:51 -- common/autotest_common.sh@10 -- # set +x 00:14:37.207 14:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:37.207 14:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.207 14:18:51 -- common/autotest_common.sh@10 -- # set +x 00:14:37.207 [2024-12-16 14:18:51.657495] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:37.207 14:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:37.207 14:18:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:37.207 14:18:51 -- common/autotest_common.sh@10 -- # set +x 00:14:37.207 14:18:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@54 -- # perf_pid=328932 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@56 -- # delay=0 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@57 -- # kill -0 328932 00:14:37.207 14:18:51 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:37.207 EAL: No free 2048 kB hugepages reported on node 1 00:14:37.207 [2024-12-16 14:18:51.712504] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:14:37.775 14:18:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:37.775 14:18:52 -- target/delete_subsystem.sh@57 -- # kill -0 328932 00:14:37.775 14:18:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:38.343 14:18:52 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:38.343 14:18:52 -- target/delete_subsystem.sh@57 -- # kill -0 328932 00:14:38.343 14:18:52 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:38.910 14:18:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:38.911 14:18:53 -- target/delete_subsystem.sh@57 -- # kill -0 328932 00:14:38.911 14:18:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:39.169 14:18:53 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:39.169 14:18:53 -- target/delete_subsystem.sh@57 -- # kill -0 328932 00:14:39.169 14:18:53 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:39.737 14:18:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:39.737 14:18:54 -- target/delete_subsystem.sh@57 -- # kill -0 328932 00:14:39.737 14:18:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:40.304 14:18:54 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:40.304 14:18:54 -- target/delete_subsystem.sh@57 -- # kill -0 328932 00:14:40.304 14:18:54 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:14:40.562 Initializing NVMe Controllers 00:14:40.562 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:40.562 Controller IO queue size 128, less than required. 00:14:40.562 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:40.562 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:14:40.562 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:14:40.562 Initialization complete. Launching workers. 00:14:40.562 ======================================================== 00:14:40.562 Latency(us) 00:14:40.563 Device Information : IOPS MiB/s Average min max 00:14:40.563 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004170.48 1000136.88 1045042.68 00:14:40.563 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004889.02 1000119.63 1010390.29 00:14:40.563 ======================================================== 00:14:40.563 Total : 256.00 0.12 1004529.75 1000119.63 1045042.68 00:14:40.563 00:14:40.825 14:18:55 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:14:40.825 14:18:55 -- target/delete_subsystem.sh@57 -- # kill -0 328932 00:14:40.825 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (328932) - No such process 00:14:40.825 14:18:55 -- target/delete_subsystem.sh@67 -- # wait 328932 00:14:40.825 14:18:55 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:14:40.825 14:18:55 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:14:40.825 14:18:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:40.825 14:18:55 -- nvmf/common.sh@116 -- # sync 00:14:40.825 14:18:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:40.825 14:18:55 -- nvmf/common.sh@119 -- # set +e 00:14:40.825 14:18:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:40.825 14:18:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:40.825 rmmod nvme_tcp 00:14:40.825 rmmod nvme_fabrics 00:14:40.825 rmmod nvme_keyring 00:14:40.825 14:18:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:40.825 14:18:55 -- nvmf/common.sh@123 -- # set -e 00:14:40.825 14:18:55 -- nvmf/common.sh@124 -- # return 0 00:14:40.825 14:18:55 -- nvmf/common.sh@477 -- # '[' -n 328213 ']' 00:14:40.825 14:18:55 -- nvmf/common.sh@478 -- # killprocess 328213 00:14:40.825 14:18:55 -- common/autotest_common.sh@936 -- # '[' -z 328213 ']' 00:14:40.825 14:18:55 -- common/autotest_common.sh@940 -- # kill -0 328213 00:14:40.825 14:18:55 -- common/autotest_common.sh@941 -- # uname 00:14:40.825 14:18:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:40.825 14:18:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 328213 00:14:40.825 14:18:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:40.825 14:18:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:40.825 14:18:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 328213' 00:14:40.825 killing process with pid 328213 00:14:40.825 14:18:55 -- common/autotest_common.sh@955 -- # kill 328213 00:14:40.825 14:18:55 -- common/autotest_common.sh@960 -- # wait 328213 00:14:41.089 14:18:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:41.089 14:18:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:41.089 14:18:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:41.089 14:18:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:41.089 14:18:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:41.089 14:18:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:41.089 14:18:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:41.089 14:18:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:43.624 14:18:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:43.624 00:14:43.624 real 0m16.204s 00:14:43.624 user 0m30.351s 00:14:43.624 sys 0m5.010s 00:14:43.624 14:18:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:43.624 14:18:57 -- common/autotest_common.sh@10 -- # set +x 00:14:43.624 ************************************ 00:14:43.624 END TEST nvmf_delete_subsystem 00:14:43.624 ************************************ 00:14:43.624 14:18:57 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:14:43.624 14:18:57 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:43.624 14:18:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:43.624 14:18:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:43.624 14:18:57 -- common/autotest_common.sh@10 -- # set +x 00:14:43.624 ************************************ 00:14:43.624 START TEST nvmf_nvme_cli 00:14:43.624 ************************************ 00:14:43.624 14:18:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:14:43.624 * Looking for test storage... 00:14:43.624 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:43.624 14:18:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:43.624 14:18:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:43.624 14:18:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:43.624 14:18:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:43.624 14:18:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:43.624 14:18:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:43.624 14:18:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:43.624 14:18:57 -- scripts/common.sh@335 -- # IFS=.-: 00:14:43.624 14:18:57 -- scripts/common.sh@335 -- # read -ra ver1 00:14:43.624 14:18:57 -- scripts/common.sh@336 -- # IFS=.-: 00:14:43.624 14:18:57 -- scripts/common.sh@336 -- # read -ra ver2 00:14:43.624 14:18:57 -- scripts/common.sh@337 -- # local 'op=<' 00:14:43.624 14:18:57 -- scripts/common.sh@339 -- # ver1_l=2 00:14:43.624 14:18:57 -- scripts/common.sh@340 -- # ver2_l=1 00:14:43.624 14:18:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:43.624 14:18:57 -- scripts/common.sh@343 -- # case "$op" in 00:14:43.624 14:18:57 -- scripts/common.sh@344 -- # : 1 00:14:43.624 14:18:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:43.624 14:18:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:43.624 14:18:57 -- scripts/common.sh@364 -- # decimal 1 00:14:43.624 14:18:57 -- scripts/common.sh@352 -- # local d=1 00:14:43.624 14:18:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:43.624 14:18:57 -- scripts/common.sh@354 -- # echo 1 00:14:43.624 14:18:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:43.624 14:18:57 -- scripts/common.sh@365 -- # decimal 2 00:14:43.624 14:18:57 -- scripts/common.sh@352 -- # local d=2 00:14:43.624 14:18:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:43.624 14:18:57 -- scripts/common.sh@354 -- # echo 2 00:14:43.624 14:18:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:43.624 14:18:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:43.624 14:18:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:43.624 14:18:57 -- scripts/common.sh@367 -- # return 0 00:14:43.624 14:18:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:43.624 14:18:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:43.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:43.624 --rc genhtml_branch_coverage=1 00:14:43.624 --rc genhtml_function_coverage=1 00:14:43.624 --rc genhtml_legend=1 00:14:43.624 --rc geninfo_all_blocks=1 00:14:43.624 --rc geninfo_unexecuted_blocks=1 00:14:43.624 00:14:43.624 ' 00:14:43.624 14:18:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:43.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:43.624 --rc genhtml_branch_coverage=1 00:14:43.624 --rc genhtml_function_coverage=1 00:14:43.624 --rc genhtml_legend=1 00:14:43.624 --rc geninfo_all_blocks=1 00:14:43.624 --rc geninfo_unexecuted_blocks=1 00:14:43.624 00:14:43.624 ' 00:14:43.624 14:18:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:43.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:43.624 --rc genhtml_branch_coverage=1 00:14:43.624 --rc genhtml_function_coverage=1 00:14:43.624 --rc genhtml_legend=1 00:14:43.624 --rc geninfo_all_blocks=1 00:14:43.624 --rc geninfo_unexecuted_blocks=1 00:14:43.624 00:14:43.624 ' 00:14:43.624 14:18:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:43.624 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:43.624 --rc genhtml_branch_coverage=1 00:14:43.624 --rc genhtml_function_coverage=1 00:14:43.624 --rc genhtml_legend=1 00:14:43.624 --rc geninfo_all_blocks=1 00:14:43.624 --rc geninfo_unexecuted_blocks=1 00:14:43.624 00:14:43.624 ' 00:14:43.624 14:18:57 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:43.624 14:18:57 -- nvmf/common.sh@7 -- # uname -s 00:14:43.624 14:18:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:43.624 14:18:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:43.624 14:18:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:43.624 14:18:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:43.624 14:18:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:43.624 14:18:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:43.624 14:18:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:43.624 14:18:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:43.624 14:18:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:43.624 14:18:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:43.624 14:18:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:14:43.624 14:18:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:14:43.624 14:18:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:43.624 14:18:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:43.624 14:18:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:43.624 14:18:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:43.624 14:18:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:43.624 14:18:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:43.625 14:18:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:43.625 14:18:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:43.625 14:18:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:43.625 14:18:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:43.625 14:18:57 -- paths/export.sh@5 -- # export PATH 00:14:43.625 14:18:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:43.625 14:18:57 -- nvmf/common.sh@46 -- # : 0 00:14:43.625 14:18:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:43.625 14:18:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:43.625 14:18:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:43.625 14:18:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:43.625 14:18:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:43.625 14:18:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:43.625 14:18:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:43.625 14:18:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:43.625 14:18:57 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:43.625 14:18:57 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:43.625 14:18:57 -- target/nvme_cli.sh@14 -- # devs=() 00:14:43.625 14:18:57 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:14:43.625 14:18:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:43.625 14:18:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:43.625 14:18:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:43.625 14:18:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:43.625 14:18:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:43.625 14:18:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:43.625 14:18:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:43.625 14:18:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:43.625 14:18:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:43.625 14:18:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:43.625 14:18:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:43.625 14:18:57 -- common/autotest_common.sh@10 -- # set +x 00:14:48.899 14:19:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:48.899 14:19:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:48.899 14:19:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:48.899 14:19:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:48.899 14:19:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:48.899 14:19:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:48.899 14:19:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:48.899 14:19:02 -- nvmf/common.sh@294 -- # net_devs=() 00:14:48.899 14:19:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:48.899 14:19:02 -- nvmf/common.sh@295 -- # e810=() 00:14:48.899 14:19:02 -- nvmf/common.sh@295 -- # local -ga e810 00:14:48.899 14:19:02 -- nvmf/common.sh@296 -- # x722=() 00:14:48.899 14:19:02 -- nvmf/common.sh@296 -- # local -ga x722 00:14:48.899 14:19:02 -- nvmf/common.sh@297 -- # mlx=() 00:14:48.899 14:19:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:48.899 14:19:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:48.899 14:19:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:48.899 14:19:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:48.899 14:19:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:48.899 14:19:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:48.899 14:19:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:14:48.899 Found 0000:af:00.0 (0x8086 - 0x159b) 00:14:48.899 14:19:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:48.899 14:19:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:14:48.899 Found 0000:af:00.1 (0x8086 - 0x159b) 00:14:48.899 14:19:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:48.899 14:19:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:48.899 14:19:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.899 14:19:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:48.899 14:19:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.899 14:19:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:14:48.899 Found net devices under 0000:af:00.0: cvl_0_0 00:14:48.899 14:19:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.899 14:19:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:48.899 14:19:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:48.899 14:19:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:48.899 14:19:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:48.899 14:19:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:14:48.899 Found net devices under 0000:af:00.1: cvl_0_1 00:14:48.899 14:19:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:48.899 14:19:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:48.899 14:19:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:48.899 14:19:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:48.899 14:19:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:48.899 14:19:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:48.899 14:19:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:48.899 14:19:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:48.899 14:19:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:48.899 14:19:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:48.899 14:19:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:48.899 14:19:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:48.899 14:19:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:48.899 14:19:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:48.899 14:19:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:48.899 14:19:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:48.899 14:19:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:48.899 14:19:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:48.899 14:19:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:48.899 14:19:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:48.899 14:19:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:48.899 14:19:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:48.899 14:19:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:48.899 14:19:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:48.899 14:19:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:48.899 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:48.899 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.440 ms 00:14:48.899 00:14:48.899 --- 10.0.0.2 ping statistics --- 00:14:48.899 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:48.899 rtt min/avg/max/mdev = 0.440/0.440/0.440/0.000 ms 00:14:48.899 14:19:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:48.899 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:48.899 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.220 ms 00:14:48.899 00:14:48.899 --- 10.0.0.1 ping statistics --- 00:14:48.899 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:48.899 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:14:48.899 14:19:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:48.899 14:19:03 -- nvmf/common.sh@410 -- # return 0 00:14:48.899 14:19:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:48.899 14:19:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:48.899 14:19:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:48.899 14:19:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:48.899 14:19:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:48.899 14:19:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:48.899 14:19:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:48.899 14:19:03 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:14:48.899 14:19:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:48.899 14:19:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:48.899 14:19:03 -- common/autotest_common.sh@10 -- # set +x 00:14:48.899 14:19:03 -- nvmf/common.sh@469 -- # nvmfpid=333091 00:14:48.899 14:19:03 -- nvmf/common.sh@470 -- # waitforlisten 333091 00:14:48.899 14:19:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:14:48.899 14:19:03 -- common/autotest_common.sh@829 -- # '[' -z 333091 ']' 00:14:48.899 14:19:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:48.899 14:19:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:48.899 14:19:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:48.899 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:48.899 14:19:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:48.899 14:19:03 -- common/autotest_common.sh@10 -- # set +x 00:14:48.900 [2024-12-16 14:19:03.264956] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:48.900 [2024-12-16 14:19:03.265003] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:48.900 EAL: No free 2048 kB hugepages reported on node 1 00:14:48.900 [2024-12-16 14:19:03.323140] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:14:48.900 [2024-12-16 14:19:03.401541] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:48.900 [2024-12-16 14:19:03.401646] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:48.900 [2024-12-16 14:19:03.401654] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:48.900 [2024-12-16 14:19:03.401661] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:48.900 [2024-12-16 14:19:03.401699] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:48.900 [2024-12-16 14:19:03.401797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:48.900 [2024-12-16 14:19:03.401883] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:48.900 [2024-12-16 14:19:03.401885] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:14:49.837 14:19:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:49.837 14:19:04 -- common/autotest_common.sh@862 -- # return 0 00:14:49.837 14:19:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:49.837 14:19:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 14:19:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:49.837 14:19:04 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:49.837 14:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 [2024-12-16 14:19:04.131208] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:49.837 14:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.837 14:19:04 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:14:49.837 14:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 Malloc0 00:14:49.837 14:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.837 14:19:04 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:14:49.837 14:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 Malloc1 00:14:49.837 14:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.837 14:19:04 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:14:49.837 14:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 14:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.837 14:19:04 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:14:49.837 14:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 14:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.837 14:19:04 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:14:49.837 14:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 14:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.837 14:19:04 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:49.837 14:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 [2024-12-16 14:19:04.199736] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:49.837 14:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.837 14:19:04 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:14:49.837 14:19:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.837 14:19:04 -- common/autotest_common.sh@10 -- # set +x 00:14:49.837 14:19:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.837 14:19:04 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -a 10.0.0.2 -s 4420 00:14:49.837 00:14:49.837 Discovery Log Number of Records 2, Generation counter 2 00:14:49.837 =====Discovery Log Entry 0====== 00:14:49.837 trtype: tcp 00:14:49.837 adrfam: ipv4 00:14:49.837 subtype: current discovery subsystem 00:14:49.837 treq: not required 00:14:49.837 portid: 0 00:14:49.837 trsvcid: 4420 00:14:49.837 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:14:49.837 traddr: 10.0.0.2 00:14:49.837 eflags: explicit discovery connections, duplicate discovery information 00:14:49.837 sectype: none 00:14:49.837 =====Discovery Log Entry 1====== 00:14:49.837 trtype: tcp 00:14:49.837 adrfam: ipv4 00:14:49.837 subtype: nvme subsystem 00:14:49.837 treq: not required 00:14:49.837 portid: 0 00:14:49.837 trsvcid: 4420 00:14:49.837 subnqn: nqn.2016-06.io.spdk:cnode1 00:14:49.837 traddr: 10.0.0.2 00:14:49.837 eflags: none 00:14:49.837 sectype: none 00:14:49.837 14:19:04 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:14:49.837 14:19:04 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:14:49.837 14:19:04 -- nvmf/common.sh@510 -- # local dev _ 00:14:49.837 14:19:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:49.837 14:19:04 -- nvmf/common.sh@509 -- # nvme list 00:14:49.837 14:19:04 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:49.837 14:19:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:49.837 14:19:04 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:49.837 14:19:04 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:49.837 14:19:04 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:14:49.837 14:19:04 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:14:51.212 14:19:05 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:14:51.213 14:19:05 -- common/autotest_common.sh@1187 -- # local i=0 00:14:51.213 14:19:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:14:51.213 14:19:05 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:14:51.213 14:19:05 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:14:51.213 14:19:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:14:53.118 14:19:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:14:53.118 14:19:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:14:53.118 14:19:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:14:53.118 14:19:07 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:14:53.118 14:19:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:14:53.118 14:19:07 -- common/autotest_common.sh@1197 -- # return 0 00:14:53.118 14:19:07 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:14:53.118 14:19:07 -- nvmf/common.sh@510 -- # local dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@509 -- # nvme list 00:14:53.118 14:19:07 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:53.118 14:19:07 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:53.118 14:19:07 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:14:53.118 /dev/nvme0n2 ]] 00:14:53.118 14:19:07 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:14:53.118 14:19:07 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:14:53.118 14:19:07 -- nvmf/common.sh@510 -- # local dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@509 -- # nvme list 00:14:53.118 14:19:07 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:14:53.118 14:19:07 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:14:53.118 14:19:07 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:14:53.118 14:19:07 -- nvmf/common.sh@512 -- # read -r dev _ 00:14:53.118 14:19:07 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:14:53.118 14:19:07 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:14:53.377 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:14:53.378 14:19:07 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:14:53.378 14:19:07 -- common/autotest_common.sh@1208 -- # local i=0 00:14:53.378 14:19:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:14:53.378 14:19:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:53.378 14:19:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:14:53.378 14:19:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:14:53.378 14:19:07 -- common/autotest_common.sh@1220 -- # return 0 00:14:53.378 14:19:07 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:14:53.378 14:19:07 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:14:53.378 14:19:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:53.378 14:19:07 -- common/autotest_common.sh@10 -- # set +x 00:14:53.378 14:19:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:53.378 14:19:07 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:53.378 14:19:07 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:14:53.378 14:19:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:53.378 14:19:07 -- nvmf/common.sh@116 -- # sync 00:14:53.378 14:19:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:53.378 14:19:07 -- nvmf/common.sh@119 -- # set +e 00:14:53.378 14:19:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:53.378 14:19:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:53.378 rmmod nvme_tcp 00:14:53.378 rmmod nvme_fabrics 00:14:53.378 rmmod nvme_keyring 00:14:53.378 14:19:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:53.378 14:19:07 -- nvmf/common.sh@123 -- # set -e 00:14:53.378 14:19:07 -- nvmf/common.sh@124 -- # return 0 00:14:53.378 14:19:07 -- nvmf/common.sh@477 -- # '[' -n 333091 ']' 00:14:53.378 14:19:07 -- nvmf/common.sh@478 -- # killprocess 333091 00:14:53.378 14:19:07 -- common/autotest_common.sh@936 -- # '[' -z 333091 ']' 00:14:53.378 14:19:07 -- common/autotest_common.sh@940 -- # kill -0 333091 00:14:53.378 14:19:07 -- common/autotest_common.sh@941 -- # uname 00:14:53.378 14:19:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:53.378 14:19:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 333091 00:14:53.378 14:19:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:14:53.378 14:19:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:14:53.378 14:19:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 333091' 00:14:53.378 killing process with pid 333091 00:14:53.378 14:19:07 -- common/autotest_common.sh@955 -- # kill 333091 00:14:53.378 14:19:07 -- common/autotest_common.sh@960 -- # wait 333091 00:14:53.637 14:19:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:53.637 14:19:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:53.637 14:19:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:53.637 14:19:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:53.637 14:19:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:53.637 14:19:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:53.637 14:19:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:53.637 14:19:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:56.172 14:19:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:56.172 00:14:56.172 real 0m12.588s 00:14:56.172 user 0m20.535s 00:14:56.172 sys 0m4.638s 00:14:56.172 14:19:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:56.172 14:19:10 -- common/autotest_common.sh@10 -- # set +x 00:14:56.172 ************************************ 00:14:56.172 END TEST nvmf_nvme_cli 00:14:56.172 ************************************ 00:14:56.172 14:19:10 -- nvmf/nvmf.sh@39 -- # [[ 0 -eq 1 ]] 00:14:56.172 14:19:10 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:56.172 14:19:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:56.172 14:19:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:56.172 14:19:10 -- common/autotest_common.sh@10 -- # set +x 00:14:56.172 ************************************ 00:14:56.172 START TEST nvmf_host_management 00:14:56.172 ************************************ 00:14:56.172 14:19:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:14:56.172 * Looking for test storage... 00:14:56.172 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:56.172 14:19:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:56.172 14:19:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:56.172 14:19:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:56.172 14:19:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:56.172 14:19:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:56.172 14:19:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:56.172 14:19:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:56.172 14:19:10 -- scripts/common.sh@335 -- # IFS=.-: 00:14:56.172 14:19:10 -- scripts/common.sh@335 -- # read -ra ver1 00:14:56.172 14:19:10 -- scripts/common.sh@336 -- # IFS=.-: 00:14:56.172 14:19:10 -- scripts/common.sh@336 -- # read -ra ver2 00:14:56.172 14:19:10 -- scripts/common.sh@337 -- # local 'op=<' 00:14:56.172 14:19:10 -- scripts/common.sh@339 -- # ver1_l=2 00:14:56.172 14:19:10 -- scripts/common.sh@340 -- # ver2_l=1 00:14:56.172 14:19:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:56.172 14:19:10 -- scripts/common.sh@343 -- # case "$op" in 00:14:56.172 14:19:10 -- scripts/common.sh@344 -- # : 1 00:14:56.172 14:19:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:56.172 14:19:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:56.172 14:19:10 -- scripts/common.sh@364 -- # decimal 1 00:14:56.172 14:19:10 -- scripts/common.sh@352 -- # local d=1 00:14:56.172 14:19:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:56.172 14:19:10 -- scripts/common.sh@354 -- # echo 1 00:14:56.172 14:19:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:56.172 14:19:10 -- scripts/common.sh@365 -- # decimal 2 00:14:56.172 14:19:10 -- scripts/common.sh@352 -- # local d=2 00:14:56.172 14:19:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:56.172 14:19:10 -- scripts/common.sh@354 -- # echo 2 00:14:56.172 14:19:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:56.172 14:19:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:56.172 14:19:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:56.172 14:19:10 -- scripts/common.sh@367 -- # return 0 00:14:56.172 14:19:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:56.172 14:19:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:56.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:56.172 --rc genhtml_branch_coverage=1 00:14:56.172 --rc genhtml_function_coverage=1 00:14:56.172 --rc genhtml_legend=1 00:14:56.172 --rc geninfo_all_blocks=1 00:14:56.172 --rc geninfo_unexecuted_blocks=1 00:14:56.172 00:14:56.172 ' 00:14:56.172 14:19:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:56.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:56.172 --rc genhtml_branch_coverage=1 00:14:56.172 --rc genhtml_function_coverage=1 00:14:56.172 --rc genhtml_legend=1 00:14:56.172 --rc geninfo_all_blocks=1 00:14:56.172 --rc geninfo_unexecuted_blocks=1 00:14:56.172 00:14:56.172 ' 00:14:56.172 14:19:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:56.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:56.172 --rc genhtml_branch_coverage=1 00:14:56.172 --rc genhtml_function_coverage=1 00:14:56.172 --rc genhtml_legend=1 00:14:56.172 --rc geninfo_all_blocks=1 00:14:56.172 --rc geninfo_unexecuted_blocks=1 00:14:56.172 00:14:56.172 ' 00:14:56.172 14:19:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:56.172 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:56.172 --rc genhtml_branch_coverage=1 00:14:56.172 --rc genhtml_function_coverage=1 00:14:56.172 --rc genhtml_legend=1 00:14:56.172 --rc geninfo_all_blocks=1 00:14:56.172 --rc geninfo_unexecuted_blocks=1 00:14:56.172 00:14:56.172 ' 00:14:56.172 14:19:10 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:56.172 14:19:10 -- nvmf/common.sh@7 -- # uname -s 00:14:56.172 14:19:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:56.172 14:19:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:56.172 14:19:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:56.173 14:19:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:56.173 14:19:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:56.173 14:19:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:56.173 14:19:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:56.173 14:19:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:56.173 14:19:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:56.173 14:19:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:56.173 14:19:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:14:56.173 14:19:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:14:56.173 14:19:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:56.173 14:19:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:56.173 14:19:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:56.173 14:19:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:56.173 14:19:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:56.173 14:19:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:56.173 14:19:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:56.173 14:19:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:56.173 14:19:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:56.173 14:19:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:56.173 14:19:10 -- paths/export.sh@5 -- # export PATH 00:14:56.173 14:19:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:56.173 14:19:10 -- nvmf/common.sh@46 -- # : 0 00:14:56.173 14:19:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:56.173 14:19:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:56.173 14:19:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:56.173 14:19:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:56.173 14:19:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:56.173 14:19:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:56.173 14:19:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:56.173 14:19:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:56.173 14:19:10 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:14:56.173 14:19:10 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:14:56.173 14:19:10 -- target/host_management.sh@104 -- # nvmftestinit 00:14:56.173 14:19:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:56.173 14:19:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:56.173 14:19:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:56.173 14:19:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:56.173 14:19:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:56.173 14:19:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:56.173 14:19:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:56.173 14:19:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:56.173 14:19:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:56.173 14:19:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:56.173 14:19:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:56.173 14:19:10 -- common/autotest_common.sh@10 -- # set +x 00:15:01.447 14:19:15 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:01.447 14:19:15 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:01.447 14:19:15 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:01.447 14:19:15 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:01.447 14:19:15 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:01.447 14:19:15 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:01.447 14:19:15 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:01.447 14:19:15 -- nvmf/common.sh@294 -- # net_devs=() 00:15:01.447 14:19:15 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:01.447 14:19:15 -- nvmf/common.sh@295 -- # e810=() 00:15:01.447 14:19:15 -- nvmf/common.sh@295 -- # local -ga e810 00:15:01.447 14:19:15 -- nvmf/common.sh@296 -- # x722=() 00:15:01.447 14:19:15 -- nvmf/common.sh@296 -- # local -ga x722 00:15:01.447 14:19:15 -- nvmf/common.sh@297 -- # mlx=() 00:15:01.447 14:19:15 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:01.447 14:19:15 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:01.447 14:19:15 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:01.447 14:19:15 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:01.447 14:19:15 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:01.447 14:19:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:01.447 14:19:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:15:01.447 Found 0000:af:00.0 (0x8086 - 0x159b) 00:15:01.447 14:19:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:01.447 14:19:15 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:15:01.447 Found 0000:af:00.1 (0x8086 - 0x159b) 00:15:01.447 14:19:15 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:01.447 14:19:15 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:01.447 14:19:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:01.447 14:19:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:01.447 14:19:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:01.447 14:19:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:01.447 14:19:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:15:01.447 Found net devices under 0000:af:00.0: cvl_0_0 00:15:01.447 14:19:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:01.447 14:19:15 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:01.447 14:19:15 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:01.448 14:19:15 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:01.448 14:19:15 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:01.448 14:19:15 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:15:01.448 Found net devices under 0000:af:00.1: cvl_0_1 00:15:01.448 14:19:15 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:01.448 14:19:15 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:01.448 14:19:15 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:01.448 14:19:15 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:01.448 14:19:15 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:01.448 14:19:15 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:01.448 14:19:15 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:01.448 14:19:15 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:01.448 14:19:15 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:01.448 14:19:15 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:01.448 14:19:15 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:01.448 14:19:15 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:01.448 14:19:15 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:01.448 14:19:15 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:01.448 14:19:15 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:01.448 14:19:15 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:01.448 14:19:15 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:01.448 14:19:15 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:01.448 14:19:15 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:01.448 14:19:15 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:01.448 14:19:15 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:01.448 14:19:15 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:01.448 14:19:15 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:01.448 14:19:15 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:01.448 14:19:15 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:01.448 14:19:15 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:01.448 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:01.448 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.322 ms 00:15:01.448 00:15:01.448 --- 10.0.0.2 ping statistics --- 00:15:01.448 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:01.448 rtt min/avg/max/mdev = 0.322/0.322/0.322/0.000 ms 00:15:01.448 14:19:15 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:01.448 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:01.448 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.212 ms 00:15:01.448 00:15:01.448 --- 10.0.0.1 ping statistics --- 00:15:01.448 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:01.448 rtt min/avg/max/mdev = 0.212/0.212/0.212/0.000 ms 00:15:01.448 14:19:15 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:01.448 14:19:15 -- nvmf/common.sh@410 -- # return 0 00:15:01.448 14:19:15 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:01.448 14:19:15 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:01.448 14:19:15 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:01.448 14:19:15 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:01.448 14:19:15 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:01.448 14:19:15 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:01.448 14:19:15 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:01.448 14:19:15 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:15:01.448 14:19:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:15:01.448 14:19:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:01.448 14:19:15 -- common/autotest_common.sh@10 -- # set +x 00:15:01.448 ************************************ 00:15:01.448 START TEST nvmf_host_management 00:15:01.448 ************************************ 00:15:01.448 14:19:15 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:15:01.448 14:19:15 -- target/host_management.sh@69 -- # starttarget 00:15:01.448 14:19:15 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:15:01.448 14:19:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:01.448 14:19:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:01.448 14:19:15 -- common/autotest_common.sh@10 -- # set +x 00:15:01.448 14:19:15 -- nvmf/common.sh@469 -- # nvmfpid=337314 00:15:01.448 14:19:15 -- nvmf/common.sh@470 -- # waitforlisten 337314 00:15:01.448 14:19:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:15:01.448 14:19:15 -- common/autotest_common.sh@829 -- # '[' -z 337314 ']' 00:15:01.448 14:19:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:01.448 14:19:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:01.448 14:19:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:01.448 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:01.448 14:19:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:01.448 14:19:15 -- common/autotest_common.sh@10 -- # set +x 00:15:01.448 [2024-12-16 14:19:16.017552] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:01.448 [2024-12-16 14:19:16.017594] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:01.707 EAL: No free 2048 kB hugepages reported on node 1 00:15:01.707 [2024-12-16 14:19:16.075715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:01.707 [2024-12-16 14:19:16.143269] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:01.707 [2024-12-16 14:19:16.143379] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:01.707 [2024-12-16 14:19:16.143388] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:01.707 [2024-12-16 14:19:16.143395] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:01.707 [2024-12-16 14:19:16.143497] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:01.707 [2024-12-16 14:19:16.143582] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:01.707 [2024-12-16 14:19:16.143694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:01.707 [2024-12-16 14:19:16.143696] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:15:02.274 14:19:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:02.274 14:19:16 -- common/autotest_common.sh@862 -- # return 0 00:15:02.274 14:19:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:02.274 14:19:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:02.274 14:19:16 -- common/autotest_common.sh@10 -- # set +x 00:15:02.533 14:19:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:02.534 14:19:16 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:02.534 14:19:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.534 14:19:16 -- common/autotest_common.sh@10 -- # set +x 00:15:02.534 [2024-12-16 14:19:16.884205] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:02.534 14:19:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.534 14:19:16 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:15:02.534 14:19:16 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:02.534 14:19:16 -- common/autotest_common.sh@10 -- # set +x 00:15:02.534 14:19:16 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:15:02.534 14:19:16 -- target/host_management.sh@23 -- # cat 00:15:02.534 14:19:16 -- target/host_management.sh@30 -- # rpc_cmd 00:15:02.534 14:19:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:02.534 14:19:16 -- common/autotest_common.sh@10 -- # set +x 00:15:02.534 Malloc0 00:15:02.534 [2024-12-16 14:19:16.943891] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:02.534 14:19:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:02.534 14:19:16 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:15:02.534 14:19:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:02.534 14:19:16 -- common/autotest_common.sh@10 -- # set +x 00:15:02.534 14:19:16 -- target/host_management.sh@73 -- # perfpid=337579 00:15:02.534 14:19:16 -- target/host_management.sh@74 -- # waitforlisten 337579 /var/tmp/bdevperf.sock 00:15:02.534 14:19:16 -- common/autotest_common.sh@829 -- # '[' -z 337579 ']' 00:15:02.534 14:19:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:02.534 14:19:16 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:15:02.534 14:19:16 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:15:02.534 14:19:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:02.534 14:19:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:02.534 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:02.534 14:19:16 -- nvmf/common.sh@520 -- # config=() 00:15:02.534 14:19:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:02.534 14:19:16 -- nvmf/common.sh@520 -- # local subsystem config 00:15:02.534 14:19:16 -- common/autotest_common.sh@10 -- # set +x 00:15:02.534 14:19:16 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:02.534 14:19:16 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:02.534 { 00:15:02.534 "params": { 00:15:02.534 "name": "Nvme$subsystem", 00:15:02.534 "trtype": "$TEST_TRANSPORT", 00:15:02.534 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:02.534 "adrfam": "ipv4", 00:15:02.534 "trsvcid": "$NVMF_PORT", 00:15:02.534 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:02.534 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:02.534 "hdgst": ${hdgst:-false}, 00:15:02.534 "ddgst": ${ddgst:-false} 00:15:02.534 }, 00:15:02.534 "method": "bdev_nvme_attach_controller" 00:15:02.534 } 00:15:02.534 EOF 00:15:02.534 )") 00:15:02.534 14:19:16 -- nvmf/common.sh@542 -- # cat 00:15:02.534 14:19:16 -- nvmf/common.sh@544 -- # jq . 00:15:02.534 14:19:17 -- nvmf/common.sh@545 -- # IFS=, 00:15:02.534 14:19:17 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:02.534 "params": { 00:15:02.534 "name": "Nvme0", 00:15:02.534 "trtype": "tcp", 00:15:02.534 "traddr": "10.0.0.2", 00:15:02.534 "adrfam": "ipv4", 00:15:02.534 "trsvcid": "4420", 00:15:02.534 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:02.534 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:15:02.534 "hdgst": false, 00:15:02.534 "ddgst": false 00:15:02.534 }, 00:15:02.534 "method": "bdev_nvme_attach_controller" 00:15:02.534 }' 00:15:02.534 [2024-12-16 14:19:17.034136] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:02.534 [2024-12-16 14:19:17.034182] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid337579 ] 00:15:02.534 EAL: No free 2048 kB hugepages reported on node 1 00:15:02.534 [2024-12-16 14:19:17.090889] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:02.792 [2024-12-16 14:19:17.160251] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:02.792 Running I/O for 10 seconds... 00:15:03.361 14:19:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:03.361 14:19:17 -- common/autotest_common.sh@862 -- # return 0 00:15:03.361 14:19:17 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:15:03.361 14:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.361 14:19:17 -- common/autotest_common.sh@10 -- # set +x 00:15:03.361 14:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.361 14:19:17 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:03.361 14:19:17 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:15:03.361 14:19:17 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:15:03.361 14:19:17 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:15:03.361 14:19:17 -- target/host_management.sh@52 -- # local ret=1 00:15:03.361 14:19:17 -- target/host_management.sh@53 -- # local i 00:15:03.361 14:19:17 -- target/host_management.sh@54 -- # (( i = 10 )) 00:15:03.361 14:19:17 -- target/host_management.sh@54 -- # (( i != 0 )) 00:15:03.361 14:19:17 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:15:03.361 14:19:17 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:15:03.361 14:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.361 14:19:17 -- common/autotest_common.sh@10 -- # set +x 00:15:03.361 14:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.361 14:19:17 -- target/host_management.sh@55 -- # read_io_count=2464 00:15:03.361 14:19:17 -- target/host_management.sh@58 -- # '[' 2464 -ge 100 ']' 00:15:03.361 14:19:17 -- target/host_management.sh@59 -- # ret=0 00:15:03.361 14:19:17 -- target/host_management.sh@60 -- # break 00:15:03.361 14:19:17 -- target/host_management.sh@64 -- # return 0 00:15:03.361 14:19:17 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:15:03.361 14:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.361 14:19:17 -- common/autotest_common.sh@10 -- # set +x 00:15:03.361 [2024-12-16 14:19:17.927190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927257] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927264] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927271] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927302] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927319] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927343] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927353] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927376] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.361 [2024-12-16 14:19:17.927407] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927431] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927455] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927468] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927474] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1512a30 is same with the state(5) to be set 00:15:03.362 [2024-12-16 14:19:17.927774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:81664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:81920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:82048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:82176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:82304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:82432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:82560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:82688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:77056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:77184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:77440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:77568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.927986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.927994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:77696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:82816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:82944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:83072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:83200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:83328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:83456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:83584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:83712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:83840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:83968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:84096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:84224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:84352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:78080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:84480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:84608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:78336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:78464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:84736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:78720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.362 [2024-12-16 14:19:17.928288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.362 [2024-12-16 14:19:17.928296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:84864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:84992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:85120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:85248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:85376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:85504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:78848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:85632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:85760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:78976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:85888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:86016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:86144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:79104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:86272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:79232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:79360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:86400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:86528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:86656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:79616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:86784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:86912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:87040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:79744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:80000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:80256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:80512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:80768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:81024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:81152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:15:03.363 [2024-12-16 14:19:17.928736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.363 [2024-12-16 14:19:17.928812] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15c2e10 was disconnected and freed. reset controller. 00:15:03.363 [2024-12-16 14:19:17.929700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:15:03.363 task offset: 81664 on job bdev=Nvme0n1 fails 00:15:03.363 00:15:03.363 Latency(us) 00:15:03.363 [2024-12-16T13:19:17.937Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:03.363 [2024-12-16T13:19:17.937Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:15:03.363 [2024-12-16T13:19:17.937Z] Job: Nvme0n1 ended in about 0.58 seconds with error 00:15:03.363 Verification LBA range: start 0x0 length 0x400 00:15:03.363 Nvme0n1 : 0.58 4588.20 286.76 110.19 0.00 13416.71 1451.15 19598.38 00:15:03.363 [2024-12-16T13:19:17.937Z] =================================================================================================================== 00:15:03.363 [2024-12-16T13:19:17.937Z] Total : 4588.20 286.76 110.19 0.00 13416.71 1451.15 19598.38 00:15:03.363 [2024-12-16 14:19:17.931249] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:15:03.363 [2024-12-16 14:19:17.931263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15c52a0 (9): Bad file descriptor 00:15:03.363 14:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.363 14:19:17 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:15:03.363 14:19:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:03.622 14:19:17 -- common/autotest_common.sh@10 -- # set +x 00:15:03.622 [2024-12-16 14:19:17.936823] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode0' does not allow host 'nqn.2016-06.io.spdk:host0' 00:15:03.622 [2024-12-16 14:19:17.936920] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:15:03.622 [2024-12-16 14:19:17.936943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND SPECIFIC (01/84) qid:0 cid:3 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:03.622 [2024-12-16 14:19:17.936954] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode0 00:15:03.622 [2024-12-16 14:19:17.936963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 132 00:15:03.622 [2024-12-16 14:19:17.936971] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:15:03.622 [2024-12-16 14:19:17.936978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x15c52a0 00:15:03.622 [2024-12-16 14:19:17.936995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15c52a0 (9): Bad file descriptor 00:15:03.622 [2024-12-16 14:19:17.937007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:15:03.622 [2024-12-16 14:19:17.937014] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:15:03.622 [2024-12-16 14:19:17.937021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:15:03.622 [2024-12-16 14:19:17.937033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:15:03.622 14:19:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:03.622 14:19:17 -- target/host_management.sh@87 -- # sleep 1 00:15:04.559 14:19:18 -- target/host_management.sh@91 -- # kill -9 337579 00:15:04.559 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (337579) - No such process 00:15:04.559 14:19:18 -- target/host_management.sh@91 -- # true 00:15:04.559 14:19:18 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:15:04.559 14:19:18 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:15:04.559 14:19:18 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:15:04.559 14:19:18 -- nvmf/common.sh@520 -- # config=() 00:15:04.559 14:19:18 -- nvmf/common.sh@520 -- # local subsystem config 00:15:04.559 14:19:18 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:15:04.559 14:19:18 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:15:04.559 { 00:15:04.559 "params": { 00:15:04.559 "name": "Nvme$subsystem", 00:15:04.559 "trtype": "$TEST_TRANSPORT", 00:15:04.559 "traddr": "$NVMF_FIRST_TARGET_IP", 00:15:04.559 "adrfam": "ipv4", 00:15:04.559 "trsvcid": "$NVMF_PORT", 00:15:04.559 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:15:04.559 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:15:04.559 "hdgst": ${hdgst:-false}, 00:15:04.559 "ddgst": ${ddgst:-false} 00:15:04.559 }, 00:15:04.559 "method": "bdev_nvme_attach_controller" 00:15:04.559 } 00:15:04.559 EOF 00:15:04.559 )") 00:15:04.559 14:19:18 -- nvmf/common.sh@542 -- # cat 00:15:04.559 14:19:18 -- nvmf/common.sh@544 -- # jq . 00:15:04.559 14:19:18 -- nvmf/common.sh@545 -- # IFS=, 00:15:04.559 14:19:18 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:15:04.559 "params": { 00:15:04.559 "name": "Nvme0", 00:15:04.559 "trtype": "tcp", 00:15:04.559 "traddr": "10.0.0.2", 00:15:04.559 "adrfam": "ipv4", 00:15:04.559 "trsvcid": "4420", 00:15:04.559 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:04.559 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:15:04.559 "hdgst": false, 00:15:04.559 "ddgst": false 00:15:04.559 }, 00:15:04.559 "method": "bdev_nvme_attach_controller" 00:15:04.559 }' 00:15:04.560 [2024-12-16 14:19:18.991426] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:04.560 [2024-12-16 14:19:18.991474] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid337830 ] 00:15:04.560 EAL: No free 2048 kB hugepages reported on node 1 00:15:04.560 [2024-12-16 14:19:19.047046] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:04.560 [2024-12-16 14:19:19.113316] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:05.127 Running I/O for 1 seconds... 00:15:06.064 00:15:06.064 Latency(us) 00:15:06.064 [2024-12-16T13:19:20.638Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:06.064 [2024-12-16T13:19:20.638Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:15:06.064 Verification LBA range: start 0x0 length 0x400 00:15:06.064 Nvme0n1 : 1.01 4678.07 292.38 0.00 0.00 13483.63 873.81 18350.08 00:15:06.064 [2024-12-16T13:19:20.638Z] =================================================================================================================== 00:15:06.064 [2024-12-16T13:19:20.638Z] Total : 4678.07 292.38 0.00 0.00 13483.63 873.81 18350.08 00:15:06.064 14:19:20 -- target/host_management.sh@101 -- # stoptarget 00:15:06.064 14:19:20 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:15:06.323 14:19:20 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:15:06.323 14:19:20 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:15:06.323 14:19:20 -- target/host_management.sh@40 -- # nvmftestfini 00:15:06.323 14:19:20 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:06.323 14:19:20 -- nvmf/common.sh@116 -- # sync 00:15:06.323 14:19:20 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:06.323 14:19:20 -- nvmf/common.sh@119 -- # set +e 00:15:06.323 14:19:20 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:06.323 14:19:20 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:06.323 rmmod nvme_tcp 00:15:06.323 rmmod nvme_fabrics 00:15:06.323 rmmod nvme_keyring 00:15:06.323 14:19:20 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:06.323 14:19:20 -- nvmf/common.sh@123 -- # set -e 00:15:06.323 14:19:20 -- nvmf/common.sh@124 -- # return 0 00:15:06.323 14:19:20 -- nvmf/common.sh@477 -- # '[' -n 337314 ']' 00:15:06.323 14:19:20 -- nvmf/common.sh@478 -- # killprocess 337314 00:15:06.323 14:19:20 -- common/autotest_common.sh@936 -- # '[' -z 337314 ']' 00:15:06.324 14:19:20 -- common/autotest_common.sh@940 -- # kill -0 337314 00:15:06.324 14:19:20 -- common/autotest_common.sh@941 -- # uname 00:15:06.324 14:19:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:06.324 14:19:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 337314 00:15:06.324 14:19:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:06.324 14:19:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:06.324 14:19:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 337314' 00:15:06.324 killing process with pid 337314 00:15:06.324 14:19:20 -- common/autotest_common.sh@955 -- # kill 337314 00:15:06.324 14:19:20 -- common/autotest_common.sh@960 -- # wait 337314 00:15:06.583 [2024-12-16 14:19:20.957402] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:15:06.583 14:19:20 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:06.583 14:19:20 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:06.583 14:19:20 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:06.583 14:19:20 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:06.583 14:19:20 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:06.583 14:19:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:06.583 14:19:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:06.583 14:19:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:08.488 14:19:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:08.488 00:15:08.488 real 0m7.083s 00:15:08.488 user 0m21.686s 00:15:08.489 sys 0m1.314s 00:15:08.489 14:19:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:08.489 14:19:23 -- common/autotest_common.sh@10 -- # set +x 00:15:08.489 ************************************ 00:15:08.489 END TEST nvmf_host_management 00:15:08.489 ************************************ 00:15:08.748 14:19:23 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:15:08.748 00:15:08.748 real 0m12.834s 00:15:08.748 user 0m23.368s 00:15:08.748 sys 0m5.413s 00:15:08.748 14:19:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:08.748 14:19:23 -- common/autotest_common.sh@10 -- # set +x 00:15:08.748 ************************************ 00:15:08.748 END TEST nvmf_host_management 00:15:08.748 ************************************ 00:15:08.748 14:19:23 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:15:08.748 14:19:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:08.748 14:19:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:08.748 14:19:23 -- common/autotest_common.sh@10 -- # set +x 00:15:08.748 ************************************ 00:15:08.748 START TEST nvmf_lvol 00:15:08.748 ************************************ 00:15:08.749 14:19:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:15:08.749 * Looking for test storage... 00:15:08.749 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:08.749 14:19:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:08.749 14:19:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:08.749 14:19:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:08.749 14:19:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:08.749 14:19:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:08.749 14:19:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:08.749 14:19:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:08.749 14:19:23 -- scripts/common.sh@335 -- # IFS=.-: 00:15:08.749 14:19:23 -- scripts/common.sh@335 -- # read -ra ver1 00:15:08.749 14:19:23 -- scripts/common.sh@336 -- # IFS=.-: 00:15:08.749 14:19:23 -- scripts/common.sh@336 -- # read -ra ver2 00:15:08.749 14:19:23 -- scripts/common.sh@337 -- # local 'op=<' 00:15:08.749 14:19:23 -- scripts/common.sh@339 -- # ver1_l=2 00:15:08.749 14:19:23 -- scripts/common.sh@340 -- # ver2_l=1 00:15:08.749 14:19:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:08.749 14:19:23 -- scripts/common.sh@343 -- # case "$op" in 00:15:08.749 14:19:23 -- scripts/common.sh@344 -- # : 1 00:15:08.749 14:19:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:08.749 14:19:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:08.749 14:19:23 -- scripts/common.sh@364 -- # decimal 1 00:15:08.749 14:19:23 -- scripts/common.sh@352 -- # local d=1 00:15:08.749 14:19:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:08.749 14:19:23 -- scripts/common.sh@354 -- # echo 1 00:15:08.749 14:19:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:08.749 14:19:23 -- scripts/common.sh@365 -- # decimal 2 00:15:08.749 14:19:23 -- scripts/common.sh@352 -- # local d=2 00:15:08.749 14:19:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:08.749 14:19:23 -- scripts/common.sh@354 -- # echo 2 00:15:08.749 14:19:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:08.749 14:19:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:08.749 14:19:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:08.749 14:19:23 -- scripts/common.sh@367 -- # return 0 00:15:08.749 14:19:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:08.749 14:19:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:08.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:08.749 --rc genhtml_branch_coverage=1 00:15:08.749 --rc genhtml_function_coverage=1 00:15:08.749 --rc genhtml_legend=1 00:15:08.749 --rc geninfo_all_blocks=1 00:15:08.749 --rc geninfo_unexecuted_blocks=1 00:15:08.749 00:15:08.749 ' 00:15:08.749 14:19:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:08.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:08.749 --rc genhtml_branch_coverage=1 00:15:08.749 --rc genhtml_function_coverage=1 00:15:08.749 --rc genhtml_legend=1 00:15:08.749 --rc geninfo_all_blocks=1 00:15:08.749 --rc geninfo_unexecuted_blocks=1 00:15:08.749 00:15:08.749 ' 00:15:08.749 14:19:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:08.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:08.749 --rc genhtml_branch_coverage=1 00:15:08.749 --rc genhtml_function_coverage=1 00:15:08.749 --rc genhtml_legend=1 00:15:08.749 --rc geninfo_all_blocks=1 00:15:08.749 --rc geninfo_unexecuted_blocks=1 00:15:08.749 00:15:08.749 ' 00:15:08.749 14:19:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:08.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:08.749 --rc genhtml_branch_coverage=1 00:15:08.749 --rc genhtml_function_coverage=1 00:15:08.749 --rc genhtml_legend=1 00:15:08.749 --rc geninfo_all_blocks=1 00:15:08.749 --rc geninfo_unexecuted_blocks=1 00:15:08.749 00:15:08.749 ' 00:15:08.749 14:19:23 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:08.749 14:19:23 -- nvmf/common.sh@7 -- # uname -s 00:15:08.749 14:19:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:08.749 14:19:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:08.749 14:19:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:08.749 14:19:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:08.749 14:19:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:08.749 14:19:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:08.749 14:19:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:08.749 14:19:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:08.749 14:19:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:08.749 14:19:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:08.749 14:19:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:15:08.749 14:19:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:15:08.749 14:19:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:08.749 14:19:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:08.749 14:19:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:08.749 14:19:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:08.749 14:19:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:08.749 14:19:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:08.749 14:19:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:08.749 14:19:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.749 14:19:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.749 14:19:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.749 14:19:23 -- paths/export.sh@5 -- # export PATH 00:15:08.749 14:19:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:08.749 14:19:23 -- nvmf/common.sh@46 -- # : 0 00:15:08.749 14:19:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:08.749 14:19:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:08.749 14:19:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:08.749 14:19:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:08.749 14:19:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:08.749 14:19:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:08.749 14:19:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:08.749 14:19:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:08.749 14:19:23 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:08.749 14:19:23 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:08.749 14:19:23 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:15:08.749 14:19:23 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:15:08.749 14:19:23 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:08.749 14:19:23 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:15:08.749 14:19:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:08.749 14:19:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:08.749 14:19:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:08.749 14:19:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:08.749 14:19:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:08.749 14:19:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:08.749 14:19:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:08.749 14:19:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:08.749 14:19:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:08.749 14:19:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:08.749 14:19:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:08.749 14:19:23 -- common/autotest_common.sh@10 -- # set +x 00:15:14.024 14:19:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:14.024 14:19:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:14.024 14:19:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:14.024 14:19:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:14.024 14:19:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:14.024 14:19:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:14.024 14:19:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:14.024 14:19:28 -- nvmf/common.sh@294 -- # net_devs=() 00:15:14.024 14:19:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:14.024 14:19:28 -- nvmf/common.sh@295 -- # e810=() 00:15:14.024 14:19:28 -- nvmf/common.sh@295 -- # local -ga e810 00:15:14.024 14:19:28 -- nvmf/common.sh@296 -- # x722=() 00:15:14.024 14:19:28 -- nvmf/common.sh@296 -- # local -ga x722 00:15:14.024 14:19:28 -- nvmf/common.sh@297 -- # mlx=() 00:15:14.024 14:19:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:14.024 14:19:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:14.024 14:19:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:14.025 14:19:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:14.025 14:19:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:14.025 14:19:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:14.025 14:19:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:15:14.025 Found 0000:af:00.0 (0x8086 - 0x159b) 00:15:14.025 14:19:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:14.025 14:19:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:15:14.025 Found 0000:af:00.1 (0x8086 - 0x159b) 00:15:14.025 14:19:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:14.025 14:19:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:14.025 14:19:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:14.025 14:19:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:14.025 14:19:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:14.025 14:19:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:15:14.025 Found net devices under 0000:af:00.0: cvl_0_0 00:15:14.025 14:19:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:14.025 14:19:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:14.025 14:19:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:14.025 14:19:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:14.025 14:19:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:14.025 14:19:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:15:14.025 Found net devices under 0000:af:00.1: cvl_0_1 00:15:14.025 14:19:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:14.025 14:19:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:14.025 14:19:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:14.025 14:19:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:14.025 14:19:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:14.025 14:19:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:14.025 14:19:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:14.025 14:19:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:14.025 14:19:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:14.025 14:19:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:14.025 14:19:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:14.025 14:19:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:14.025 14:19:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:14.025 14:19:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:14.025 14:19:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:14.025 14:19:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:14.025 14:19:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:14.025 14:19:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:14.284 14:19:28 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:14.284 14:19:28 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:14.284 14:19:28 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:14.284 14:19:28 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:14.284 14:19:28 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:14.284 14:19:28 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:14.284 14:19:28 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:14.284 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:14.284 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.374 ms 00:15:14.284 00:15:14.284 --- 10.0.0.2 ping statistics --- 00:15:14.284 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:14.284 rtt min/avg/max/mdev = 0.374/0.374/0.374/0.000 ms 00:15:14.284 14:19:28 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:14.284 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:14.284 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.191 ms 00:15:14.284 00:15:14.284 --- 10.0.0.1 ping statistics --- 00:15:14.284 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:14.284 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:15:14.284 14:19:28 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:14.284 14:19:28 -- nvmf/common.sh@410 -- # return 0 00:15:14.284 14:19:28 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:14.284 14:19:28 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:14.284 14:19:28 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:14.284 14:19:28 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:14.284 14:19:28 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:14.284 14:19:28 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:14.284 14:19:28 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:14.284 14:19:28 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:15:14.284 14:19:28 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:14.284 14:19:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:14.284 14:19:28 -- common/autotest_common.sh@10 -- # set +x 00:15:14.284 14:19:28 -- nvmf/common.sh@469 -- # nvmfpid=341558 00:15:14.284 14:19:28 -- nvmf/common.sh@470 -- # waitforlisten 341558 00:15:14.284 14:19:28 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:15:14.284 14:19:28 -- common/autotest_common.sh@829 -- # '[' -z 341558 ']' 00:15:14.284 14:19:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:14.284 14:19:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:14.284 14:19:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:14.284 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:14.284 14:19:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:14.284 14:19:28 -- common/autotest_common.sh@10 -- # set +x 00:15:14.284 [2024-12-16 14:19:28.822542] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:14.284 [2024-12-16 14:19:28.822583] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:14.284 EAL: No free 2048 kB hugepages reported on node 1 00:15:14.544 [2024-12-16 14:19:28.882230] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:15:14.544 [2024-12-16 14:19:28.956266] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:14.544 [2024-12-16 14:19:28.956379] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:14.544 [2024-12-16 14:19:28.956388] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:14.544 [2024-12-16 14:19:28.956395] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:14.544 [2024-12-16 14:19:28.956434] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:14.544 [2024-12-16 14:19:28.956532] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:14.544 [2024-12-16 14:19:28.956534] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:15.112 14:19:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:15.112 14:19:29 -- common/autotest_common.sh@862 -- # return 0 00:15:15.112 14:19:29 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:15.112 14:19:29 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:15.112 14:19:29 -- common/autotest_common.sh@10 -- # set +x 00:15:15.112 14:19:29 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:15.112 14:19:29 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:15:15.371 [2024-12-16 14:19:29.817482] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:15.371 14:19:29 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:15.630 14:19:30 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:15:15.630 14:19:30 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:15:15.889 14:19:30 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:15:15.889 14:19:30 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:15:15.889 14:19:30 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:15:16.148 14:19:30 -- target/nvmf_lvol.sh@29 -- # lvs=c08787eb-7614-40c2-826e-de59bb651d89 00:15:16.148 14:19:30 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u c08787eb-7614-40c2-826e-de59bb651d89 lvol 20 00:15:16.407 14:19:30 -- target/nvmf_lvol.sh@32 -- # lvol=eab7292c-4244-4743-9b2b-9a8100a5ada6 00:15:16.407 14:19:30 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:16.665 14:19:30 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 eab7292c-4244-4743-9b2b-9a8100a5ada6 00:15:16.665 14:19:31 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:16.924 [2024-12-16 14:19:31.332581] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:16.924 14:19:31 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:17.183 14:19:31 -- target/nvmf_lvol.sh@42 -- # perf_pid=342046 00:15:17.183 14:19:31 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:15:17.183 14:19:31 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:15:17.183 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.116 14:19:32 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot eab7292c-4244-4743-9b2b-9a8100a5ada6 MY_SNAPSHOT 00:15:18.375 14:19:32 -- target/nvmf_lvol.sh@47 -- # snapshot=e892b728-d88c-47de-9cb6-946819662142 00:15:18.375 14:19:32 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize eab7292c-4244-4743-9b2b-9a8100a5ada6 30 00:15:18.634 14:19:32 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone e892b728-d88c-47de-9cb6-946819662142 MY_CLONE 00:15:18.893 14:19:33 -- target/nvmf_lvol.sh@49 -- # clone=0444bcdc-cc13-4399-9441-9d9341196167 00:15:18.893 14:19:33 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 0444bcdc-cc13-4399-9441-9d9341196167 00:15:19.459 14:19:33 -- target/nvmf_lvol.sh@53 -- # wait 342046 00:15:27.574 Initializing NVMe Controllers 00:15:27.574 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:15:27.574 Controller IO queue size 128, less than required. 00:15:27.574 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:27.574 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:15:27.574 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:15:27.574 Initialization complete. Launching workers. 00:15:27.574 ======================================================== 00:15:27.574 Latency(us) 00:15:27.574 Device Information : IOPS MiB/s Average min max 00:15:27.574 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 12434.50 48.57 10295.42 2105.94 60193.02 00:15:27.574 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 12291.50 48.01 10415.16 3376.98 57861.29 00:15:27.574 ======================================================== 00:15:27.574 Total : 24726.00 96.59 10354.94 2105.94 60193.02 00:15:27.574 00:15:27.574 14:19:41 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:27.574 14:19:42 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete eab7292c-4244-4743-9b2b-9a8100a5ada6 00:15:27.911 14:19:42 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u c08787eb-7614-40c2-826e-de59bb651d89 00:15:27.911 14:19:42 -- target/nvmf_lvol.sh@60 -- # rm -f 00:15:27.911 14:19:42 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:15:27.911 14:19:42 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:15:27.911 14:19:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:27.911 14:19:42 -- nvmf/common.sh@116 -- # sync 00:15:27.911 14:19:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:27.911 14:19:42 -- nvmf/common.sh@119 -- # set +e 00:15:27.911 14:19:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:27.911 14:19:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:27.911 rmmod nvme_tcp 00:15:27.911 rmmod nvme_fabrics 00:15:27.911 rmmod nvme_keyring 00:15:28.206 14:19:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:28.206 14:19:42 -- nvmf/common.sh@123 -- # set -e 00:15:28.206 14:19:42 -- nvmf/common.sh@124 -- # return 0 00:15:28.206 14:19:42 -- nvmf/common.sh@477 -- # '[' -n 341558 ']' 00:15:28.206 14:19:42 -- nvmf/common.sh@478 -- # killprocess 341558 00:15:28.206 14:19:42 -- common/autotest_common.sh@936 -- # '[' -z 341558 ']' 00:15:28.206 14:19:42 -- common/autotest_common.sh@940 -- # kill -0 341558 00:15:28.206 14:19:42 -- common/autotest_common.sh@941 -- # uname 00:15:28.206 14:19:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:28.206 14:19:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 341558 00:15:28.206 14:19:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:28.206 14:19:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:28.206 14:19:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 341558' 00:15:28.206 killing process with pid 341558 00:15:28.206 14:19:42 -- common/autotest_common.sh@955 -- # kill 341558 00:15:28.206 14:19:42 -- common/autotest_common.sh@960 -- # wait 341558 00:15:28.206 14:19:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:28.206 14:19:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:28.206 14:19:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:28.206 14:19:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:28.206 14:19:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:28.206 14:19:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:28.206 14:19:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:28.206 14:19:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:30.768 14:19:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:30.768 00:15:30.768 real 0m21.690s 00:15:30.768 user 1m3.709s 00:15:30.768 sys 0m7.134s 00:15:30.768 14:19:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:30.768 14:19:44 -- common/autotest_common.sh@10 -- # set +x 00:15:30.768 ************************************ 00:15:30.768 END TEST nvmf_lvol 00:15:30.768 ************************************ 00:15:30.768 14:19:44 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:15:30.768 14:19:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:30.768 14:19:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:30.768 14:19:44 -- common/autotest_common.sh@10 -- # set +x 00:15:30.768 ************************************ 00:15:30.768 START TEST nvmf_lvs_grow 00:15:30.768 ************************************ 00:15:30.768 14:19:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:15:30.768 * Looking for test storage... 00:15:30.768 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:30.768 14:19:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:30.768 14:19:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:30.768 14:19:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:30.768 14:19:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:30.768 14:19:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:30.768 14:19:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:30.768 14:19:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:30.768 14:19:45 -- scripts/common.sh@335 -- # IFS=.-: 00:15:30.768 14:19:45 -- scripts/common.sh@335 -- # read -ra ver1 00:15:30.768 14:19:45 -- scripts/common.sh@336 -- # IFS=.-: 00:15:30.768 14:19:45 -- scripts/common.sh@336 -- # read -ra ver2 00:15:30.768 14:19:45 -- scripts/common.sh@337 -- # local 'op=<' 00:15:30.768 14:19:45 -- scripts/common.sh@339 -- # ver1_l=2 00:15:30.768 14:19:45 -- scripts/common.sh@340 -- # ver2_l=1 00:15:30.768 14:19:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:30.768 14:19:45 -- scripts/common.sh@343 -- # case "$op" in 00:15:30.768 14:19:45 -- scripts/common.sh@344 -- # : 1 00:15:30.768 14:19:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:30.768 14:19:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:30.768 14:19:45 -- scripts/common.sh@364 -- # decimal 1 00:15:30.768 14:19:45 -- scripts/common.sh@352 -- # local d=1 00:15:30.768 14:19:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:30.768 14:19:45 -- scripts/common.sh@354 -- # echo 1 00:15:30.768 14:19:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:30.768 14:19:45 -- scripts/common.sh@365 -- # decimal 2 00:15:30.768 14:19:45 -- scripts/common.sh@352 -- # local d=2 00:15:30.768 14:19:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:30.768 14:19:45 -- scripts/common.sh@354 -- # echo 2 00:15:30.768 14:19:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:30.768 14:19:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:30.768 14:19:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:30.768 14:19:45 -- scripts/common.sh@367 -- # return 0 00:15:30.768 14:19:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:30.768 14:19:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:30.768 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.768 --rc genhtml_branch_coverage=1 00:15:30.768 --rc genhtml_function_coverage=1 00:15:30.768 --rc genhtml_legend=1 00:15:30.768 --rc geninfo_all_blocks=1 00:15:30.768 --rc geninfo_unexecuted_blocks=1 00:15:30.768 00:15:30.768 ' 00:15:30.768 14:19:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:30.768 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.768 --rc genhtml_branch_coverage=1 00:15:30.768 --rc genhtml_function_coverage=1 00:15:30.768 --rc genhtml_legend=1 00:15:30.768 --rc geninfo_all_blocks=1 00:15:30.768 --rc geninfo_unexecuted_blocks=1 00:15:30.768 00:15:30.768 ' 00:15:30.768 14:19:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:30.768 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.768 --rc genhtml_branch_coverage=1 00:15:30.768 --rc genhtml_function_coverage=1 00:15:30.768 --rc genhtml_legend=1 00:15:30.768 --rc geninfo_all_blocks=1 00:15:30.768 --rc geninfo_unexecuted_blocks=1 00:15:30.768 00:15:30.768 ' 00:15:30.768 14:19:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:30.768 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:30.768 --rc genhtml_branch_coverage=1 00:15:30.768 --rc genhtml_function_coverage=1 00:15:30.768 --rc genhtml_legend=1 00:15:30.768 --rc geninfo_all_blocks=1 00:15:30.768 --rc geninfo_unexecuted_blocks=1 00:15:30.768 00:15:30.768 ' 00:15:30.768 14:19:45 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:30.768 14:19:45 -- nvmf/common.sh@7 -- # uname -s 00:15:30.768 14:19:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:30.768 14:19:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:30.768 14:19:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:30.768 14:19:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:30.768 14:19:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:30.768 14:19:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:30.768 14:19:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:30.768 14:19:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:30.768 14:19:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:30.768 14:19:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:30.768 14:19:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:15:30.768 14:19:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:15:30.768 14:19:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:30.768 14:19:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:30.768 14:19:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:30.768 14:19:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:30.768 14:19:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:30.768 14:19:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:30.768 14:19:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:30.768 14:19:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.769 14:19:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.769 14:19:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.769 14:19:45 -- paths/export.sh@5 -- # export PATH 00:15:30.769 14:19:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:30.769 14:19:45 -- nvmf/common.sh@46 -- # : 0 00:15:30.769 14:19:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:30.769 14:19:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:30.769 14:19:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:30.769 14:19:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:30.769 14:19:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:30.769 14:19:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:30.769 14:19:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:30.769 14:19:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:30.769 14:19:45 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:30.769 14:19:45 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:15:30.769 14:19:45 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:15:30.769 14:19:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:30.769 14:19:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:30.769 14:19:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:30.769 14:19:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:30.769 14:19:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:30.769 14:19:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:30.769 14:19:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:30.769 14:19:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:30.769 14:19:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:30.769 14:19:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:30.769 14:19:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:30.769 14:19:45 -- common/autotest_common.sh@10 -- # set +x 00:15:36.041 14:19:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:36.041 14:19:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:36.041 14:19:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:36.041 14:19:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:36.041 14:19:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:36.041 14:19:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:36.041 14:19:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:36.041 14:19:50 -- nvmf/common.sh@294 -- # net_devs=() 00:15:36.041 14:19:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:36.041 14:19:50 -- nvmf/common.sh@295 -- # e810=() 00:15:36.041 14:19:50 -- nvmf/common.sh@295 -- # local -ga e810 00:15:36.041 14:19:50 -- nvmf/common.sh@296 -- # x722=() 00:15:36.041 14:19:50 -- nvmf/common.sh@296 -- # local -ga x722 00:15:36.041 14:19:50 -- nvmf/common.sh@297 -- # mlx=() 00:15:36.041 14:19:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:36.041 14:19:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:36.041 14:19:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:36.041 14:19:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:36.041 14:19:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:36.041 14:19:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:36.041 14:19:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:36.041 14:19:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:36.041 14:19:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:36.041 14:19:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:15:36.042 Found 0000:af:00.0 (0x8086 - 0x159b) 00:15:36.042 14:19:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:36.042 14:19:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:15:36.042 Found 0000:af:00.1 (0x8086 - 0x159b) 00:15:36.042 14:19:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:36.042 14:19:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:36.042 14:19:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:36.042 14:19:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:36.042 14:19:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:36.042 14:19:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:15:36.042 Found net devices under 0000:af:00.0: cvl_0_0 00:15:36.042 14:19:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:36.042 14:19:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:36.042 14:19:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:36.042 14:19:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:36.042 14:19:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:36.042 14:19:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:15:36.042 Found net devices under 0000:af:00.1: cvl_0_1 00:15:36.042 14:19:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:36.042 14:19:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:36.042 14:19:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:36.042 14:19:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:36.042 14:19:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:36.042 14:19:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:36.042 14:19:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:36.042 14:19:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:36.042 14:19:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:36.042 14:19:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:36.042 14:19:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:36.042 14:19:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:36.042 14:19:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:36.042 14:19:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:36.042 14:19:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:36.042 14:19:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:36.042 14:19:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:36.042 14:19:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:36.042 14:19:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:36.042 14:19:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:36.042 14:19:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:36.042 14:19:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:36.042 14:19:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:36.042 14:19:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:36.042 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:36.042 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.283 ms 00:15:36.042 00:15:36.042 --- 10.0.0.2 ping statistics --- 00:15:36.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:36.042 rtt min/avg/max/mdev = 0.283/0.283/0.283/0.000 ms 00:15:36.042 14:19:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:36.042 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:36.042 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.110 ms 00:15:36.042 00:15:36.042 --- 10.0.0.1 ping statistics --- 00:15:36.042 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:36.042 rtt min/avg/max/mdev = 0.110/0.110/0.110/0.000 ms 00:15:36.042 14:19:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:36.042 14:19:50 -- nvmf/common.sh@410 -- # return 0 00:15:36.042 14:19:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:36.042 14:19:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:36.042 14:19:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:36.042 14:19:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:36.042 14:19:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:36.042 14:19:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:36.042 14:19:50 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:15:36.042 14:19:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:36.042 14:19:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:36.042 14:19:50 -- common/autotest_common.sh@10 -- # set +x 00:15:36.042 14:19:50 -- nvmf/common.sh@469 -- # nvmfpid=347354 00:15:36.042 14:19:50 -- nvmf/common.sh@470 -- # waitforlisten 347354 00:15:36.042 14:19:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:15:36.042 14:19:50 -- common/autotest_common.sh@829 -- # '[' -z 347354 ']' 00:15:36.042 14:19:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:36.042 14:19:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:36.042 14:19:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:36.042 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:36.042 14:19:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:36.042 14:19:50 -- common/autotest_common.sh@10 -- # set +x 00:15:36.042 [2024-12-16 14:19:50.609575] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:36.042 [2024-12-16 14:19:50.609619] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:36.301 EAL: No free 2048 kB hugepages reported on node 1 00:15:36.301 [2024-12-16 14:19:50.668027] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:36.301 [2024-12-16 14:19:50.743387] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:36.301 [2024-12-16 14:19:50.743495] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:36.301 [2024-12-16 14:19:50.743502] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:36.301 [2024-12-16 14:19:50.743509] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:36.301 [2024-12-16 14:19:50.743527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:36.868 14:19:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:36.868 14:19:51 -- common/autotest_common.sh@862 -- # return 0 00:15:36.868 14:19:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:36.868 14:19:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:36.868 14:19:51 -- common/autotest_common.sh@10 -- # set +x 00:15:37.128 14:19:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:15:37.128 [2024-12-16 14:19:51.621925] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:15:37.128 14:19:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:15:37.128 14:19:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:37.128 14:19:51 -- common/autotest_common.sh@10 -- # set +x 00:15:37.128 ************************************ 00:15:37.128 START TEST lvs_grow_clean 00:15:37.128 ************************************ 00:15:37.128 14:19:51 -- common/autotest_common.sh@1114 -- # lvs_grow 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:37.128 14:19:51 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:37.386 14:19:51 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:37.386 14:19:51 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:37.645 14:19:52 -- target/nvmf_lvs_grow.sh@28 -- # lvs=930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:37.645 14:19:52 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:37.645 14:19:52 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:37.645 14:19:52 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:37.645 14:19:52 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:37.645 14:19:52 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 930b4b1c-f12a-4e49-a813-527fd141fdbc lvol 150 00:15:37.904 14:19:52 -- target/nvmf_lvs_grow.sh@33 -- # lvol=4d2ae560-7d0a-46b3-a4fb-a0c24de19951 00:15:37.904 14:19:52 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:37.904 14:19:52 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:38.162 [2024-12-16 14:19:52.531429] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:38.162 [2024-12-16 14:19:52.531479] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:38.162 true 00:15:38.162 14:19:52 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:38.162 14:19:52 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:38.162 14:19:52 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:38.162 14:19:52 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:38.421 14:19:52 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 4d2ae560-7d0a-46b3-a4fb-a0c24de19951 00:15:38.679 14:19:53 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:38.679 [2024-12-16 14:19:53.217530] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:38.679 14:19:53 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:38.938 14:19:53 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=347849 00:15:38.938 14:19:53 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:38.938 14:19:53 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:38.938 14:19:53 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 347849 /var/tmp/bdevperf.sock 00:15:38.938 14:19:53 -- common/autotest_common.sh@829 -- # '[' -z 347849 ']' 00:15:38.938 14:19:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:38.938 14:19:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:38.938 14:19:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:38.938 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:38.938 14:19:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:38.938 14:19:53 -- common/autotest_common.sh@10 -- # set +x 00:15:38.938 [2024-12-16 14:19:53.446549] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:38.938 [2024-12-16 14:19:53.446594] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid347849 ] 00:15:38.938 EAL: No free 2048 kB hugepages reported on node 1 00:15:38.938 [2024-12-16 14:19:53.499792] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:39.196 [2024-12-16 14:19:53.573255] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:39.764 14:19:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:39.764 14:19:54 -- common/autotest_common.sh@862 -- # return 0 00:15:39.764 14:19:54 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:40.023 Nvme0n1 00:15:40.282 14:19:54 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:40.282 [ 00:15:40.282 { 00:15:40.282 "name": "Nvme0n1", 00:15:40.282 "aliases": [ 00:15:40.282 "4d2ae560-7d0a-46b3-a4fb-a0c24de19951" 00:15:40.282 ], 00:15:40.282 "product_name": "NVMe disk", 00:15:40.282 "block_size": 4096, 00:15:40.282 "num_blocks": 38912, 00:15:40.282 "uuid": "4d2ae560-7d0a-46b3-a4fb-a0c24de19951", 00:15:40.282 "assigned_rate_limits": { 00:15:40.282 "rw_ios_per_sec": 0, 00:15:40.282 "rw_mbytes_per_sec": 0, 00:15:40.282 "r_mbytes_per_sec": 0, 00:15:40.282 "w_mbytes_per_sec": 0 00:15:40.282 }, 00:15:40.282 "claimed": false, 00:15:40.282 "zoned": false, 00:15:40.282 "supported_io_types": { 00:15:40.282 "read": true, 00:15:40.282 "write": true, 00:15:40.282 "unmap": true, 00:15:40.282 "write_zeroes": true, 00:15:40.282 "flush": true, 00:15:40.282 "reset": true, 00:15:40.282 "compare": true, 00:15:40.282 "compare_and_write": true, 00:15:40.282 "abort": true, 00:15:40.282 "nvme_admin": true, 00:15:40.282 "nvme_io": true 00:15:40.282 }, 00:15:40.282 "driver_specific": { 00:15:40.282 "nvme": [ 00:15:40.282 { 00:15:40.282 "trid": { 00:15:40.282 "trtype": "TCP", 00:15:40.282 "adrfam": "IPv4", 00:15:40.282 "traddr": "10.0.0.2", 00:15:40.282 "trsvcid": "4420", 00:15:40.282 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:40.282 }, 00:15:40.282 "ctrlr_data": { 00:15:40.282 "cntlid": 1, 00:15:40.282 "vendor_id": "0x8086", 00:15:40.282 "model_number": "SPDK bdev Controller", 00:15:40.282 "serial_number": "SPDK0", 00:15:40.282 "firmware_revision": "24.01.1", 00:15:40.282 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:40.282 "oacs": { 00:15:40.282 "security": 0, 00:15:40.282 "format": 0, 00:15:40.282 "firmware": 0, 00:15:40.282 "ns_manage": 0 00:15:40.282 }, 00:15:40.282 "multi_ctrlr": true, 00:15:40.282 "ana_reporting": false 00:15:40.282 }, 00:15:40.282 "vs": { 00:15:40.282 "nvme_version": "1.3" 00:15:40.282 }, 00:15:40.282 "ns_data": { 00:15:40.282 "id": 1, 00:15:40.282 "can_share": true 00:15:40.282 } 00:15:40.282 } 00:15:40.282 ], 00:15:40.282 "mp_policy": "active_passive" 00:15:40.283 } 00:15:40.283 } 00:15:40.283 ] 00:15:40.283 14:19:54 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=348087 00:15:40.283 14:19:54 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:40.283 14:19:54 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:40.541 Running I/O for 10 seconds... 00:15:41.478 Latency(us) 00:15:41.478 [2024-12-16T13:19:56.052Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:41.478 [2024-12-16T13:19:56.052Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:41.478 Nvme0n1 : 1.00 23190.00 90.59 0.00 0.00 0.00 0.00 0.00 00:15:41.478 [2024-12-16T13:19:56.052Z] =================================================================================================================== 00:15:41.478 [2024-12-16T13:19:56.052Z] Total : 23190.00 90.59 0.00 0.00 0.00 0.00 0.00 00:15:41.478 00:15:42.414 14:19:56 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:42.414 [2024-12-16T13:19:56.988Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:42.414 Nvme0n1 : 2.00 23383.00 91.34 0.00 0.00 0.00 0.00 0.00 00:15:42.414 [2024-12-16T13:19:56.988Z] =================================================================================================================== 00:15:42.414 [2024-12-16T13:19:56.988Z] Total : 23383.00 91.34 0.00 0.00 0.00 0.00 0.00 00:15:42.414 00:15:42.414 true 00:15:42.414 14:19:56 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:42.414 14:19:56 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:42.672 14:19:57 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:42.672 14:19:57 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:42.672 14:19:57 -- target/nvmf_lvs_grow.sh@65 -- # wait 348087 00:15:43.608 [2024-12-16T13:19:58.182Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:43.608 Nvme0n1 : 3.00 23447.33 91.59 0.00 0.00 0.00 0.00 0.00 00:15:43.608 [2024-12-16T13:19:58.182Z] =================================================================================================================== 00:15:43.608 [2024-12-16T13:19:58.182Z] Total : 23447.33 91.59 0.00 0.00 0.00 0.00 0.00 00:15:43.608 00:15:44.545 [2024-12-16T13:19:59.119Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:44.545 Nvme0n1 : 4.00 23521.50 91.88 0.00 0.00 0.00 0.00 0.00 00:15:44.545 [2024-12-16T13:19:59.119Z] =================================================================================================================== 00:15:44.545 [2024-12-16T13:19:59.119Z] Total : 23521.50 91.88 0.00 0.00 0.00 0.00 0.00 00:15:44.545 00:15:45.483 [2024-12-16T13:20:00.057Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:45.483 Nvme0n1 : 5.00 23574.00 92.09 0.00 0.00 0.00 0.00 0.00 00:15:45.483 [2024-12-16T13:20:00.057Z] =================================================================================================================== 00:15:45.483 [2024-12-16T13:20:00.057Z] Total : 23574.00 92.09 0.00 0.00 0.00 0.00 0.00 00:15:45.483 00:15:46.419 [2024-12-16T13:20:00.993Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:46.419 Nvme0n1 : 6.00 23515.67 91.86 0.00 0.00 0.00 0.00 0.00 00:15:46.419 [2024-12-16T13:20:00.993Z] =================================================================================================================== 00:15:46.419 [2024-12-16T13:20:00.993Z] Total : 23515.67 91.86 0.00 0.00 0.00 0.00 0.00 00:15:46.419 00:15:47.354 [2024-12-16T13:20:01.928Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:47.354 Nvme0n1 : 7.00 23559.71 92.03 0.00 0.00 0.00 0.00 0.00 00:15:47.354 [2024-12-16T13:20:01.928Z] =================================================================================================================== 00:15:47.354 [2024-12-16T13:20:01.929Z] Total : 23559.71 92.03 0.00 0.00 0.00 0.00 0.00 00:15:47.355 00:15:48.730 [2024-12-16T13:20:03.304Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:48.730 Nvme0n1 : 8.00 23593.75 92.16 0.00 0.00 0.00 0.00 0.00 00:15:48.730 [2024-12-16T13:20:03.304Z] =================================================================================================================== 00:15:48.730 [2024-12-16T13:20:03.304Z] Total : 23593.75 92.16 0.00 0.00 0.00 0.00 0.00 00:15:48.730 00:15:49.666 [2024-12-16T13:20:04.240Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:49.666 Nvme0n1 : 9.00 23624.67 92.28 0.00 0.00 0.00 0.00 0.00 00:15:49.666 [2024-12-16T13:20:04.240Z] =================================================================================================================== 00:15:49.666 [2024-12-16T13:20:04.240Z] Total : 23624.67 92.28 0.00 0.00 0.00 0.00 0.00 00:15:49.666 00:15:50.613 [2024-12-16T13:20:05.187Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:50.613 Nvme0n1 : 10.00 23651.00 92.39 0.00 0.00 0.00 0.00 0.00 00:15:50.613 [2024-12-16T13:20:05.187Z] =================================================================================================================== 00:15:50.613 [2024-12-16T13:20:05.187Z] Total : 23651.00 92.39 0.00 0.00 0.00 0.00 0.00 00:15:50.613 00:15:50.613 00:15:50.613 Latency(us) 00:15:50.613 [2024-12-16T13:20:05.187Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:50.613 [2024-12-16T13:20:05.187Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:50.613 Nvme0n1 : 10.01 23650.68 92.39 0.00 0.00 5408.25 4150.61 14480.34 00:15:50.613 [2024-12-16T13:20:05.187Z] =================================================================================================================== 00:15:50.613 [2024-12-16T13:20:05.187Z] Total : 23650.68 92.39 0.00 0.00 5408.25 4150.61 14480.34 00:15:50.613 0 00:15:50.613 14:20:04 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 347849 00:15:50.613 14:20:04 -- common/autotest_common.sh@936 -- # '[' -z 347849 ']' 00:15:50.613 14:20:04 -- common/autotest_common.sh@940 -- # kill -0 347849 00:15:50.613 14:20:04 -- common/autotest_common.sh@941 -- # uname 00:15:50.613 14:20:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:50.613 14:20:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 347849 00:15:50.613 14:20:04 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:50.613 14:20:04 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:50.613 14:20:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 347849' 00:15:50.613 killing process with pid 347849 00:15:50.613 14:20:04 -- common/autotest_common.sh@955 -- # kill 347849 00:15:50.613 Received shutdown signal, test time was about 10.000000 seconds 00:15:50.613 00:15:50.613 Latency(us) 00:15:50.613 [2024-12-16T13:20:05.187Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:50.613 [2024-12-16T13:20:05.187Z] =================================================================================================================== 00:15:50.613 [2024-12-16T13:20:05.187Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:15:50.613 14:20:04 -- common/autotest_common.sh@960 -- # wait 347849 00:15:50.613 14:20:05 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:15:50.873 14:20:05 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:50.873 14:20:05 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:15:51.132 14:20:05 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:15:51.132 14:20:05 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:15:51.132 14:20:05 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:51.132 [2024-12-16 14:20:05.700223] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:15:51.390 14:20:05 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:51.390 14:20:05 -- common/autotest_common.sh@650 -- # local es=0 00:15:51.390 14:20:05 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:51.390 14:20:05 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.390 14:20:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:51.390 14:20:05 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.390 14:20:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:51.390 14:20:05 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.390 14:20:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:51.390 14:20:05 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:51.390 14:20:05 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:15:51.390 14:20:05 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:51.390 request: 00:15:51.390 { 00:15:51.390 "uuid": "930b4b1c-f12a-4e49-a813-527fd141fdbc", 00:15:51.390 "method": "bdev_lvol_get_lvstores", 00:15:51.390 "req_id": 1 00:15:51.390 } 00:15:51.390 Got JSON-RPC error response 00:15:51.390 response: 00:15:51.390 { 00:15:51.390 "code": -19, 00:15:51.390 "message": "No such device" 00:15:51.390 } 00:15:51.390 14:20:05 -- common/autotest_common.sh@653 -- # es=1 00:15:51.390 14:20:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:51.390 14:20:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:51.390 14:20:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:51.390 14:20:05 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:51.649 aio_bdev 00:15:51.649 14:20:06 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 4d2ae560-7d0a-46b3-a4fb-a0c24de19951 00:15:51.649 14:20:06 -- common/autotest_common.sh@897 -- # local bdev_name=4d2ae560-7d0a-46b3-a4fb-a0c24de19951 00:15:51.649 14:20:06 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:15:51.649 14:20:06 -- common/autotest_common.sh@899 -- # local i 00:15:51.649 14:20:06 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:15:51.649 14:20:06 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:15:51.649 14:20:06 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:15:51.907 14:20:06 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 4d2ae560-7d0a-46b3-a4fb-a0c24de19951 -t 2000 00:15:51.907 [ 00:15:51.907 { 00:15:51.907 "name": "4d2ae560-7d0a-46b3-a4fb-a0c24de19951", 00:15:51.907 "aliases": [ 00:15:51.907 "lvs/lvol" 00:15:51.907 ], 00:15:51.907 "product_name": "Logical Volume", 00:15:51.907 "block_size": 4096, 00:15:51.907 "num_blocks": 38912, 00:15:51.907 "uuid": "4d2ae560-7d0a-46b3-a4fb-a0c24de19951", 00:15:51.907 "assigned_rate_limits": { 00:15:51.907 "rw_ios_per_sec": 0, 00:15:51.907 "rw_mbytes_per_sec": 0, 00:15:51.907 "r_mbytes_per_sec": 0, 00:15:51.907 "w_mbytes_per_sec": 0 00:15:51.907 }, 00:15:51.907 "claimed": false, 00:15:51.907 "zoned": false, 00:15:51.907 "supported_io_types": { 00:15:51.907 "read": true, 00:15:51.907 "write": true, 00:15:51.907 "unmap": true, 00:15:51.907 "write_zeroes": true, 00:15:51.907 "flush": false, 00:15:51.907 "reset": true, 00:15:51.907 "compare": false, 00:15:51.907 "compare_and_write": false, 00:15:51.907 "abort": false, 00:15:51.907 "nvme_admin": false, 00:15:51.907 "nvme_io": false 00:15:51.907 }, 00:15:51.907 "driver_specific": { 00:15:51.907 "lvol": { 00:15:51.907 "lvol_store_uuid": "930b4b1c-f12a-4e49-a813-527fd141fdbc", 00:15:51.907 "base_bdev": "aio_bdev", 00:15:51.907 "thin_provision": false, 00:15:51.907 "snapshot": false, 00:15:51.907 "clone": false, 00:15:51.907 "esnap_clone": false 00:15:51.907 } 00:15:51.907 } 00:15:51.907 } 00:15:51.907 ] 00:15:51.907 14:20:06 -- common/autotest_common.sh@905 -- # return 0 00:15:51.907 14:20:06 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:51.907 14:20:06 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:15:52.166 14:20:06 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:15:52.166 14:20:06 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:52.166 14:20:06 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:15:52.432 14:20:06 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:15:52.432 14:20:06 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 4d2ae560-7d0a-46b3-a4fb-a0c24de19951 00:15:52.432 14:20:06 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 930b4b1c-f12a-4e49-a813-527fd141fdbc 00:15:52.692 14:20:07 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:52.950 00:15:52.950 real 0m15.717s 00:15:52.950 user 0m15.388s 00:15:52.950 sys 0m1.485s 00:15:52.950 14:20:07 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:52.950 14:20:07 -- common/autotest_common.sh@10 -- # set +x 00:15:52.950 ************************************ 00:15:52.950 END TEST lvs_grow_clean 00:15:52.950 ************************************ 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:15:52.950 14:20:07 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:52.950 14:20:07 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:52.950 14:20:07 -- common/autotest_common.sh@10 -- # set +x 00:15:52.950 ************************************ 00:15:52.950 START TEST lvs_grow_dirty 00:15:52.950 ************************************ 00:15:52.950 14:20:07 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:52.950 14:20:07 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:15:53.209 14:20:07 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:15:53.209 14:20:07 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:15:53.209 14:20:07 -- target/nvmf_lvs_grow.sh@28 -- # lvs=0d80992d-7838-4345-b5a1-2435ab824b71 00:15:53.467 14:20:07 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:15:53.467 14:20:07 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:15:53.467 14:20:07 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:15:53.467 14:20:07 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:15:53.467 14:20:07 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 0d80992d-7838-4345-b5a1-2435ab824b71 lvol 150 00:15:53.726 14:20:08 -- target/nvmf_lvs_grow.sh@33 -- # lvol=72542b6f-e9ba-4b46-9361-3fe20b992fd4 00:15:53.726 14:20:08 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:15:53.726 14:20:08 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:15:53.726 [2024-12-16 14:20:08.290611] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:15:53.726 [2024-12-16 14:20:08.290664] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:15:53.726 true 00:15:53.985 14:20:08 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:15:53.985 14:20:08 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:15:53.985 14:20:08 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:15:53.985 14:20:08 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:15:54.243 14:20:08 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 72542b6f-e9ba-4b46-9361-3fe20b992fd4 00:15:54.243 14:20:08 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:15:54.501 14:20:08 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:54.760 14:20:09 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=350484 00:15:54.760 14:20:09 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:15:54.760 14:20:09 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:15:54.760 14:20:09 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 350484 /var/tmp/bdevperf.sock 00:15:54.760 14:20:09 -- common/autotest_common.sh@829 -- # '[' -z 350484 ']' 00:15:54.760 14:20:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:15:54.760 14:20:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:54.760 14:20:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:15:54.760 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:15:54.760 14:20:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:54.760 14:20:09 -- common/autotest_common.sh@10 -- # set +x 00:15:54.760 [2024-12-16 14:20:09.173477] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:54.760 [2024-12-16 14:20:09.173526] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid350484 ] 00:15:54.760 EAL: No free 2048 kB hugepages reported on node 1 00:15:54.760 [2024-12-16 14:20:09.227975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:15:54.760 [2024-12-16 14:20:09.301980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:55.696 14:20:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:55.696 14:20:09 -- common/autotest_common.sh@862 -- # return 0 00:15:55.696 14:20:09 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:15:55.696 Nvme0n1 00:15:55.696 14:20:10 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:15:55.955 [ 00:15:55.955 { 00:15:55.955 "name": "Nvme0n1", 00:15:55.955 "aliases": [ 00:15:55.955 "72542b6f-e9ba-4b46-9361-3fe20b992fd4" 00:15:55.955 ], 00:15:55.955 "product_name": "NVMe disk", 00:15:55.955 "block_size": 4096, 00:15:55.955 "num_blocks": 38912, 00:15:55.955 "uuid": "72542b6f-e9ba-4b46-9361-3fe20b992fd4", 00:15:55.955 "assigned_rate_limits": { 00:15:55.955 "rw_ios_per_sec": 0, 00:15:55.955 "rw_mbytes_per_sec": 0, 00:15:55.955 "r_mbytes_per_sec": 0, 00:15:55.955 "w_mbytes_per_sec": 0 00:15:55.955 }, 00:15:55.955 "claimed": false, 00:15:55.955 "zoned": false, 00:15:55.955 "supported_io_types": { 00:15:55.955 "read": true, 00:15:55.955 "write": true, 00:15:55.955 "unmap": true, 00:15:55.955 "write_zeroes": true, 00:15:55.955 "flush": true, 00:15:55.955 "reset": true, 00:15:55.955 "compare": true, 00:15:55.955 "compare_and_write": true, 00:15:55.955 "abort": true, 00:15:55.955 "nvme_admin": true, 00:15:55.955 "nvme_io": true 00:15:55.955 }, 00:15:55.955 "driver_specific": { 00:15:55.955 "nvme": [ 00:15:55.955 { 00:15:55.955 "trid": { 00:15:55.955 "trtype": "TCP", 00:15:55.955 "adrfam": "IPv4", 00:15:55.955 "traddr": "10.0.0.2", 00:15:55.955 "trsvcid": "4420", 00:15:55.955 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:15:55.955 }, 00:15:55.955 "ctrlr_data": { 00:15:55.955 "cntlid": 1, 00:15:55.955 "vendor_id": "0x8086", 00:15:55.955 "model_number": "SPDK bdev Controller", 00:15:55.955 "serial_number": "SPDK0", 00:15:55.955 "firmware_revision": "24.01.1", 00:15:55.955 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:15:55.955 "oacs": { 00:15:55.955 "security": 0, 00:15:55.955 "format": 0, 00:15:55.955 "firmware": 0, 00:15:55.955 "ns_manage": 0 00:15:55.955 }, 00:15:55.955 "multi_ctrlr": true, 00:15:55.955 "ana_reporting": false 00:15:55.955 }, 00:15:55.955 "vs": { 00:15:55.955 "nvme_version": "1.3" 00:15:55.955 }, 00:15:55.955 "ns_data": { 00:15:55.955 "id": 1, 00:15:55.955 "can_share": true 00:15:55.955 } 00:15:55.955 } 00:15:55.955 ], 00:15:55.955 "mp_policy": "active_passive" 00:15:55.955 } 00:15:55.955 } 00:15:55.955 ] 00:15:55.955 14:20:10 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=350661 00:15:55.955 14:20:10 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:15:55.955 14:20:10 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:15:55.955 Running I/O for 10 seconds... 00:15:57.333 Latency(us) 00:15:57.333 [2024-12-16T13:20:11.907Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:15:57.333 [2024-12-16T13:20:11.907Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:57.333 Nvme0n1 : 1.00 24012.00 93.80 0.00 0.00 0.00 0.00 0.00 00:15:57.333 [2024-12-16T13:20:11.907Z] =================================================================================================================== 00:15:57.333 [2024-12-16T13:20:11.907Z] Total : 24012.00 93.80 0.00 0.00 0.00 0.00 0.00 00:15:57.333 00:15:57.899 14:20:12 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:15:58.157 [2024-12-16T13:20:12.731Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:58.157 Nvme0n1 : 2.00 24231.00 94.65 0.00 0.00 0.00 0.00 0.00 00:15:58.157 [2024-12-16T13:20:12.731Z] =================================================================================================================== 00:15:58.157 [2024-12-16T13:20:12.731Z] Total : 24231.00 94.65 0.00 0.00 0.00 0.00 0.00 00:15:58.157 00:15:58.157 true 00:15:58.157 14:20:12 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:15:58.157 14:20:12 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:15:58.416 14:20:12 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:15:58.416 14:20:12 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:15:58.416 14:20:12 -- target/nvmf_lvs_grow.sh@65 -- # wait 350661 00:15:58.984 [2024-12-16T13:20:13.558Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:58.984 Nvme0n1 : 3.00 24323.33 95.01 0.00 0.00 0.00 0.00 0.00 00:15:58.984 [2024-12-16T13:20:13.558Z] =================================================================================================================== 00:15:58.984 [2024-12-16T13:20:13.558Z] Total : 24323.33 95.01 0.00 0.00 0.00 0.00 0.00 00:15:58.984 00:15:59.920 [2024-12-16T13:20:14.494Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:15:59.920 Nvme0n1 : 4.00 24402.50 95.32 0.00 0.00 0.00 0.00 0.00 00:15:59.920 [2024-12-16T13:20:14.494Z] =================================================================================================================== 00:15:59.920 [2024-12-16T13:20:14.494Z] Total : 24402.50 95.32 0.00 0.00 0.00 0.00 0.00 00:15:59.920 00:16:01.297 [2024-12-16T13:20:15.871Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:01.297 Nvme0n1 : 5.00 24449.80 95.51 0.00 0.00 0.00 0.00 0.00 00:16:01.297 [2024-12-16T13:20:15.871Z] =================================================================================================================== 00:16:01.297 [2024-12-16T13:20:15.871Z] Total : 24449.80 95.51 0.00 0.00 0.00 0.00 0.00 00:16:01.297 00:16:02.233 [2024-12-16T13:20:16.807Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:02.233 Nvme0n1 : 6.00 24481.67 95.63 0.00 0.00 0.00 0.00 0.00 00:16:02.233 [2024-12-16T13:20:16.807Z] =================================================================================================================== 00:16:02.233 [2024-12-16T13:20:16.807Z] Total : 24481.67 95.63 0.00 0.00 0.00 0.00 0.00 00:16:02.233 00:16:03.170 [2024-12-16T13:20:17.744Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:03.170 Nvme0n1 : 7.00 24513.29 95.76 0.00 0.00 0.00 0.00 0.00 00:16:03.170 [2024-12-16T13:20:17.744Z] =================================================================================================================== 00:16:03.170 [2024-12-16T13:20:17.744Z] Total : 24513.29 95.76 0.00 0.00 0.00 0.00 0.00 00:16:03.170 00:16:04.107 [2024-12-16T13:20:18.681Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:04.107 Nvme0n1 : 8.00 24537.12 95.85 0.00 0.00 0.00 0.00 0.00 00:16:04.107 [2024-12-16T13:20:18.682Z] =================================================================================================================== 00:16:04.108 [2024-12-16T13:20:18.682Z] Total : 24537.12 95.85 0.00 0.00 0.00 0.00 0.00 00:16:04.108 00:16:05.045 [2024-12-16T13:20:19.619Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:05.045 Nvme0n1 : 9.00 24548.67 95.89 0.00 0.00 0.00 0.00 0.00 00:16:05.045 [2024-12-16T13:20:19.619Z] =================================================================================================================== 00:16:05.045 [2024-12-16T13:20:19.619Z] Total : 24548.67 95.89 0.00 0.00 0.00 0.00 0.00 00:16:05.045 00:16:05.982 [2024-12-16T13:20:20.556Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:05.982 Nvme0n1 : 10.00 24522.00 95.79 0.00 0.00 0.00 0.00 0.00 00:16:05.982 [2024-12-16T13:20:20.556Z] =================================================================================================================== 00:16:05.982 [2024-12-16T13:20:20.556Z] Total : 24522.00 95.79 0.00 0.00 0.00 0.00 0.00 00:16:05.982 00:16:05.982 00:16:05.982 Latency(us) 00:16:05.982 [2024-12-16T13:20:20.556Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:05.982 [2024-12-16T13:20:20.556Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:16:05.982 Nvme0n1 : 10.00 24521.58 95.79 0.00 0.00 5216.77 3136.37 13918.60 00:16:05.982 [2024-12-16T13:20:20.556Z] =================================================================================================================== 00:16:05.982 [2024-12-16T13:20:20.556Z] Total : 24521.58 95.79 0.00 0.00 5216.77 3136.37 13918.60 00:16:05.982 0 00:16:05.982 14:20:20 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 350484 00:16:05.982 14:20:20 -- common/autotest_common.sh@936 -- # '[' -z 350484 ']' 00:16:05.982 14:20:20 -- common/autotest_common.sh@940 -- # kill -0 350484 00:16:05.982 14:20:20 -- common/autotest_common.sh@941 -- # uname 00:16:05.982 14:20:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:05.982 14:20:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 350484 00:16:06.241 14:20:20 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:06.241 14:20:20 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:06.241 14:20:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 350484' 00:16:06.241 killing process with pid 350484 00:16:06.241 14:20:20 -- common/autotest_common.sh@955 -- # kill 350484 00:16:06.241 Received shutdown signal, test time was about 10.000000 seconds 00:16:06.241 00:16:06.241 Latency(us) 00:16:06.241 [2024-12-16T13:20:20.815Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:06.241 [2024-12-16T13:20:20.815Z] =================================================================================================================== 00:16:06.241 [2024-12-16T13:20:20.815Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:06.241 14:20:20 -- common/autotest_common.sh@960 -- # wait 350484 00:16:06.241 14:20:20 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:16:06.500 14:20:20 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:06.500 14:20:20 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:16:06.759 14:20:21 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:16:06.759 14:20:21 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:16:06.759 14:20:21 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 347354 00:16:06.759 14:20:21 -- target/nvmf_lvs_grow.sh@74 -- # wait 347354 00:16:06.759 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 347354 Killed "${NVMF_APP[@]}" "$@" 00:16:06.759 14:20:21 -- target/nvmf_lvs_grow.sh@74 -- # true 00:16:06.759 14:20:21 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:16:06.759 14:20:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:06.759 14:20:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:06.759 14:20:21 -- common/autotest_common.sh@10 -- # set +x 00:16:06.759 14:20:21 -- nvmf/common.sh@469 -- # nvmfpid=352473 00:16:06.759 14:20:21 -- nvmf/common.sh@470 -- # waitforlisten 352473 00:16:06.759 14:20:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:06.759 14:20:21 -- common/autotest_common.sh@829 -- # '[' -z 352473 ']' 00:16:06.759 14:20:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:06.759 14:20:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:06.759 14:20:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:06.759 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:06.759 14:20:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:06.759 14:20:21 -- common/autotest_common.sh@10 -- # set +x 00:16:06.759 [2024-12-16 14:20:21.241276] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:06.759 [2024-12-16 14:20:21.241322] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:06.759 EAL: No free 2048 kB hugepages reported on node 1 00:16:06.759 [2024-12-16 14:20:21.300369] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:07.018 [2024-12-16 14:20:21.374862] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:07.018 [2024-12-16 14:20:21.374966] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:07.018 [2024-12-16 14:20:21.374975] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:07.018 [2024-12-16 14:20:21.374981] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:07.018 [2024-12-16 14:20:21.374996] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:07.585 14:20:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:07.585 14:20:22 -- common/autotest_common.sh@862 -- # return 0 00:16:07.585 14:20:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:07.585 14:20:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:07.585 14:20:22 -- common/autotest_common.sh@10 -- # set +x 00:16:07.585 14:20:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:07.585 14:20:22 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:07.843 [2024-12-16 14:20:22.247721] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:16:07.843 [2024-12-16 14:20:22.247800] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:16:07.843 [2024-12-16 14:20:22.247823] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:16:07.843 14:20:22 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:16:07.843 14:20:22 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev 72542b6f-e9ba-4b46-9361-3fe20b992fd4 00:16:07.843 14:20:22 -- common/autotest_common.sh@897 -- # local bdev_name=72542b6f-e9ba-4b46-9361-3fe20b992fd4 00:16:07.843 14:20:22 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:16:07.843 14:20:22 -- common/autotest_common.sh@899 -- # local i 00:16:07.843 14:20:22 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:16:07.843 14:20:22 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:16:07.843 14:20:22 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:16:08.102 14:20:22 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 72542b6f-e9ba-4b46-9361-3fe20b992fd4 -t 2000 00:16:08.102 [ 00:16:08.102 { 00:16:08.102 "name": "72542b6f-e9ba-4b46-9361-3fe20b992fd4", 00:16:08.102 "aliases": [ 00:16:08.102 "lvs/lvol" 00:16:08.102 ], 00:16:08.102 "product_name": "Logical Volume", 00:16:08.102 "block_size": 4096, 00:16:08.102 "num_blocks": 38912, 00:16:08.102 "uuid": "72542b6f-e9ba-4b46-9361-3fe20b992fd4", 00:16:08.102 "assigned_rate_limits": { 00:16:08.102 "rw_ios_per_sec": 0, 00:16:08.102 "rw_mbytes_per_sec": 0, 00:16:08.102 "r_mbytes_per_sec": 0, 00:16:08.102 "w_mbytes_per_sec": 0 00:16:08.102 }, 00:16:08.102 "claimed": false, 00:16:08.102 "zoned": false, 00:16:08.103 "supported_io_types": { 00:16:08.103 "read": true, 00:16:08.103 "write": true, 00:16:08.103 "unmap": true, 00:16:08.103 "write_zeroes": true, 00:16:08.103 "flush": false, 00:16:08.103 "reset": true, 00:16:08.103 "compare": false, 00:16:08.103 "compare_and_write": false, 00:16:08.103 "abort": false, 00:16:08.103 "nvme_admin": false, 00:16:08.103 "nvme_io": false 00:16:08.103 }, 00:16:08.103 "driver_specific": { 00:16:08.103 "lvol": { 00:16:08.103 "lvol_store_uuid": "0d80992d-7838-4345-b5a1-2435ab824b71", 00:16:08.103 "base_bdev": "aio_bdev", 00:16:08.103 "thin_provision": false, 00:16:08.103 "snapshot": false, 00:16:08.103 "clone": false, 00:16:08.103 "esnap_clone": false 00:16:08.103 } 00:16:08.103 } 00:16:08.103 } 00:16:08.103 ] 00:16:08.103 14:20:22 -- common/autotest_common.sh@905 -- # return 0 00:16:08.103 14:20:22 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:08.103 14:20:22 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:16:08.361 14:20:22 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:16:08.361 14:20:22 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:08.361 14:20:22 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:16:08.620 14:20:22 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:16:08.620 14:20:22 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:16:08.620 [2024-12-16 14:20:23.120292] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:16:08.620 14:20:23 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:08.620 14:20:23 -- common/autotest_common.sh@650 -- # local es=0 00:16:08.620 14:20:23 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:08.620 14:20:23 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:08.620 14:20:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:08.620 14:20:23 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:08.620 14:20:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:08.620 14:20:23 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:08.620 14:20:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:16:08.620 14:20:23 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:08.620 14:20:23 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:16:08.620 14:20:23 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:08.879 request: 00:16:08.879 { 00:16:08.879 "uuid": "0d80992d-7838-4345-b5a1-2435ab824b71", 00:16:08.879 "method": "bdev_lvol_get_lvstores", 00:16:08.879 "req_id": 1 00:16:08.879 } 00:16:08.879 Got JSON-RPC error response 00:16:08.879 response: 00:16:08.879 { 00:16:08.879 "code": -19, 00:16:08.879 "message": "No such device" 00:16:08.879 } 00:16:08.879 14:20:23 -- common/autotest_common.sh@653 -- # es=1 00:16:08.879 14:20:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:16:08.879 14:20:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:16:08.879 14:20:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:16:08.879 14:20:23 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:16:09.137 aio_bdev 00:16:09.137 14:20:23 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 72542b6f-e9ba-4b46-9361-3fe20b992fd4 00:16:09.137 14:20:23 -- common/autotest_common.sh@897 -- # local bdev_name=72542b6f-e9ba-4b46-9361-3fe20b992fd4 00:16:09.137 14:20:23 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:16:09.137 14:20:23 -- common/autotest_common.sh@899 -- # local i 00:16:09.137 14:20:23 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:16:09.137 14:20:23 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:16:09.138 14:20:23 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:16:09.138 14:20:23 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 72542b6f-e9ba-4b46-9361-3fe20b992fd4 -t 2000 00:16:09.396 [ 00:16:09.396 { 00:16:09.396 "name": "72542b6f-e9ba-4b46-9361-3fe20b992fd4", 00:16:09.396 "aliases": [ 00:16:09.396 "lvs/lvol" 00:16:09.396 ], 00:16:09.396 "product_name": "Logical Volume", 00:16:09.396 "block_size": 4096, 00:16:09.396 "num_blocks": 38912, 00:16:09.396 "uuid": "72542b6f-e9ba-4b46-9361-3fe20b992fd4", 00:16:09.396 "assigned_rate_limits": { 00:16:09.396 "rw_ios_per_sec": 0, 00:16:09.396 "rw_mbytes_per_sec": 0, 00:16:09.396 "r_mbytes_per_sec": 0, 00:16:09.396 "w_mbytes_per_sec": 0 00:16:09.396 }, 00:16:09.396 "claimed": false, 00:16:09.396 "zoned": false, 00:16:09.396 "supported_io_types": { 00:16:09.396 "read": true, 00:16:09.396 "write": true, 00:16:09.396 "unmap": true, 00:16:09.396 "write_zeroes": true, 00:16:09.396 "flush": false, 00:16:09.396 "reset": true, 00:16:09.396 "compare": false, 00:16:09.396 "compare_and_write": false, 00:16:09.396 "abort": false, 00:16:09.396 "nvme_admin": false, 00:16:09.396 "nvme_io": false 00:16:09.396 }, 00:16:09.396 "driver_specific": { 00:16:09.396 "lvol": { 00:16:09.396 "lvol_store_uuid": "0d80992d-7838-4345-b5a1-2435ab824b71", 00:16:09.396 "base_bdev": "aio_bdev", 00:16:09.396 "thin_provision": false, 00:16:09.396 "snapshot": false, 00:16:09.396 "clone": false, 00:16:09.396 "esnap_clone": false 00:16:09.396 } 00:16:09.396 } 00:16:09.396 } 00:16:09.396 ] 00:16:09.396 14:20:23 -- common/autotest_common.sh@905 -- # return 0 00:16:09.396 14:20:23 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:09.396 14:20:23 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:16:09.655 14:20:24 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:16:09.655 14:20:24 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:09.655 14:20:24 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:16:09.913 14:20:24 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:16:09.913 14:20:24 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 72542b6f-e9ba-4b46-9361-3fe20b992fd4 00:16:09.913 14:20:24 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u 0d80992d-7838-4345-b5a1-2435ab824b71 00:16:10.172 14:20:24 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:16:10.431 14:20:24 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:16:10.431 00:16:10.431 real 0m17.400s 00:16:10.431 user 0m44.369s 00:16:10.431 sys 0m3.977s 00:16:10.431 14:20:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:10.431 14:20:24 -- common/autotest_common.sh@10 -- # set +x 00:16:10.431 ************************************ 00:16:10.431 END TEST lvs_grow_dirty 00:16:10.431 ************************************ 00:16:10.431 14:20:24 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:16:10.431 14:20:24 -- common/autotest_common.sh@806 -- # type=--id 00:16:10.431 14:20:24 -- common/autotest_common.sh@807 -- # id=0 00:16:10.431 14:20:24 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:16:10.431 14:20:24 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:16:10.431 14:20:24 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:16:10.431 14:20:24 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:16:10.431 14:20:24 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:16:10.431 14:20:24 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:16:10.431 nvmf_trace.0 00:16:10.431 14:20:24 -- common/autotest_common.sh@821 -- # return 0 00:16:10.431 14:20:24 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:16:10.431 14:20:24 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:10.431 14:20:24 -- nvmf/common.sh@116 -- # sync 00:16:10.431 14:20:24 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:10.431 14:20:24 -- nvmf/common.sh@119 -- # set +e 00:16:10.431 14:20:24 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:10.431 14:20:24 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:10.431 rmmod nvme_tcp 00:16:10.431 rmmod nvme_fabrics 00:16:10.431 rmmod nvme_keyring 00:16:10.431 14:20:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:10.431 14:20:24 -- nvmf/common.sh@123 -- # set -e 00:16:10.431 14:20:24 -- nvmf/common.sh@124 -- # return 0 00:16:10.431 14:20:24 -- nvmf/common.sh@477 -- # '[' -n 352473 ']' 00:16:10.431 14:20:24 -- nvmf/common.sh@478 -- # killprocess 352473 00:16:10.431 14:20:24 -- common/autotest_common.sh@936 -- # '[' -z 352473 ']' 00:16:10.431 14:20:24 -- common/autotest_common.sh@940 -- # kill -0 352473 00:16:10.431 14:20:24 -- common/autotest_common.sh@941 -- # uname 00:16:10.431 14:20:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:10.431 14:20:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 352473 00:16:10.431 14:20:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:10.431 14:20:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:10.431 14:20:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 352473' 00:16:10.431 killing process with pid 352473 00:16:10.431 14:20:24 -- common/autotest_common.sh@955 -- # kill 352473 00:16:10.431 14:20:24 -- common/autotest_common.sh@960 -- # wait 352473 00:16:10.688 14:20:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:10.688 14:20:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:10.688 14:20:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:10.688 14:20:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:10.688 14:20:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:10.688 14:20:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:10.688 14:20:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:10.688 14:20:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:12.696 14:20:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:12.696 00:16:12.696 real 0m42.385s 00:16:12.696 user 1m5.723s 00:16:12.696 sys 0m9.926s 00:16:12.696 14:20:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:12.696 14:20:27 -- common/autotest_common.sh@10 -- # set +x 00:16:12.696 ************************************ 00:16:12.696 END TEST nvmf_lvs_grow 00:16:12.696 ************************************ 00:16:12.955 14:20:27 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:16:12.955 14:20:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:12.955 14:20:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:12.955 14:20:27 -- common/autotest_common.sh@10 -- # set +x 00:16:12.955 ************************************ 00:16:12.955 START TEST nvmf_bdev_io_wait 00:16:12.955 ************************************ 00:16:12.955 14:20:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:16:12.955 * Looking for test storage... 00:16:12.955 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:12.955 14:20:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:12.955 14:20:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:12.955 14:20:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:12.955 14:20:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:12.955 14:20:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:12.955 14:20:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:12.955 14:20:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:12.955 14:20:27 -- scripts/common.sh@335 -- # IFS=.-: 00:16:12.955 14:20:27 -- scripts/common.sh@335 -- # read -ra ver1 00:16:12.955 14:20:27 -- scripts/common.sh@336 -- # IFS=.-: 00:16:12.955 14:20:27 -- scripts/common.sh@336 -- # read -ra ver2 00:16:12.955 14:20:27 -- scripts/common.sh@337 -- # local 'op=<' 00:16:12.955 14:20:27 -- scripts/common.sh@339 -- # ver1_l=2 00:16:12.955 14:20:27 -- scripts/common.sh@340 -- # ver2_l=1 00:16:12.955 14:20:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:12.955 14:20:27 -- scripts/common.sh@343 -- # case "$op" in 00:16:12.955 14:20:27 -- scripts/common.sh@344 -- # : 1 00:16:12.955 14:20:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:12.955 14:20:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:12.955 14:20:27 -- scripts/common.sh@364 -- # decimal 1 00:16:12.955 14:20:27 -- scripts/common.sh@352 -- # local d=1 00:16:12.955 14:20:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:12.955 14:20:27 -- scripts/common.sh@354 -- # echo 1 00:16:12.955 14:20:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:12.955 14:20:27 -- scripts/common.sh@365 -- # decimal 2 00:16:12.955 14:20:27 -- scripts/common.sh@352 -- # local d=2 00:16:12.955 14:20:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:12.955 14:20:27 -- scripts/common.sh@354 -- # echo 2 00:16:12.955 14:20:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:12.955 14:20:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:12.955 14:20:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:12.955 14:20:27 -- scripts/common.sh@367 -- # return 0 00:16:12.955 14:20:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:12.955 14:20:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:12.955 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.955 --rc genhtml_branch_coverage=1 00:16:12.955 --rc genhtml_function_coverage=1 00:16:12.955 --rc genhtml_legend=1 00:16:12.955 --rc geninfo_all_blocks=1 00:16:12.955 --rc geninfo_unexecuted_blocks=1 00:16:12.955 00:16:12.955 ' 00:16:12.955 14:20:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:12.955 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.955 --rc genhtml_branch_coverage=1 00:16:12.955 --rc genhtml_function_coverage=1 00:16:12.955 --rc genhtml_legend=1 00:16:12.955 --rc geninfo_all_blocks=1 00:16:12.955 --rc geninfo_unexecuted_blocks=1 00:16:12.955 00:16:12.955 ' 00:16:12.955 14:20:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:12.955 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.955 --rc genhtml_branch_coverage=1 00:16:12.955 --rc genhtml_function_coverage=1 00:16:12.955 --rc genhtml_legend=1 00:16:12.955 --rc geninfo_all_blocks=1 00:16:12.955 --rc geninfo_unexecuted_blocks=1 00:16:12.955 00:16:12.955 ' 00:16:12.955 14:20:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:12.955 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:12.955 --rc genhtml_branch_coverage=1 00:16:12.955 --rc genhtml_function_coverage=1 00:16:12.955 --rc genhtml_legend=1 00:16:12.955 --rc geninfo_all_blocks=1 00:16:12.955 --rc geninfo_unexecuted_blocks=1 00:16:12.955 00:16:12.955 ' 00:16:12.955 14:20:27 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:12.955 14:20:27 -- nvmf/common.sh@7 -- # uname -s 00:16:12.955 14:20:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:12.955 14:20:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:12.955 14:20:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:12.955 14:20:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:12.955 14:20:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:12.955 14:20:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:12.955 14:20:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:12.955 14:20:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:12.955 14:20:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:12.955 14:20:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:12.955 14:20:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:16:12.955 14:20:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:16:12.955 14:20:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:12.955 14:20:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:12.955 14:20:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:12.955 14:20:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:12.955 14:20:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:12.955 14:20:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:12.955 14:20:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:12.955 14:20:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.955 14:20:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.955 14:20:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.955 14:20:27 -- paths/export.sh@5 -- # export PATH 00:16:12.955 14:20:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:12.955 14:20:27 -- nvmf/common.sh@46 -- # : 0 00:16:12.955 14:20:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:12.955 14:20:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:12.955 14:20:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:12.955 14:20:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:12.955 14:20:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:12.955 14:20:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:12.955 14:20:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:12.955 14:20:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:12.955 14:20:27 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:12.955 14:20:27 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:12.955 14:20:27 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:16:12.955 14:20:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:12.955 14:20:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:12.955 14:20:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:12.955 14:20:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:12.955 14:20:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:12.955 14:20:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:12.955 14:20:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:12.955 14:20:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:12.955 14:20:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:12.955 14:20:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:12.956 14:20:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:12.956 14:20:27 -- common/autotest_common.sh@10 -- # set +x 00:16:19.523 14:20:32 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:19.523 14:20:32 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:19.523 14:20:32 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:19.523 14:20:32 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:19.523 14:20:32 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:19.523 14:20:32 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:19.523 14:20:32 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:19.523 14:20:32 -- nvmf/common.sh@294 -- # net_devs=() 00:16:19.523 14:20:32 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:19.523 14:20:32 -- nvmf/common.sh@295 -- # e810=() 00:16:19.523 14:20:32 -- nvmf/common.sh@295 -- # local -ga e810 00:16:19.523 14:20:32 -- nvmf/common.sh@296 -- # x722=() 00:16:19.523 14:20:32 -- nvmf/common.sh@296 -- # local -ga x722 00:16:19.523 14:20:32 -- nvmf/common.sh@297 -- # mlx=() 00:16:19.523 14:20:32 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:19.523 14:20:32 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:19.523 14:20:32 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:19.523 14:20:32 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:19.523 14:20:32 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:19.523 14:20:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:19.523 14:20:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:19.523 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:19.523 14:20:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:19.523 14:20:32 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:19.523 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:19.523 14:20:32 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:19.523 14:20:32 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:19.523 14:20:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:19.523 14:20:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:19.523 14:20:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:19.523 14:20:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:19.523 14:20:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:19.524 Found net devices under 0000:af:00.0: cvl_0_0 00:16:19.524 14:20:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:19.524 14:20:32 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:19.524 14:20:32 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:19.524 14:20:32 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:19.524 14:20:32 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:19.524 14:20:32 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:19.524 Found net devices under 0000:af:00.1: cvl_0_1 00:16:19.524 14:20:32 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:19.524 14:20:32 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:19.524 14:20:32 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:19.524 14:20:32 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:19.524 14:20:32 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:19.524 14:20:32 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:19.524 14:20:32 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:19.524 14:20:32 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:19.524 14:20:32 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:19.524 14:20:32 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:19.524 14:20:32 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:19.524 14:20:32 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:19.524 14:20:32 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:19.524 14:20:32 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:19.524 14:20:32 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:19.524 14:20:32 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:19.524 14:20:32 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:19.524 14:20:32 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:19.524 14:20:32 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:19.524 14:20:32 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:19.524 14:20:32 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:19.524 14:20:32 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:19.524 14:20:32 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:19.524 14:20:33 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:19.524 14:20:33 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:19.524 14:20:33 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:19.524 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:19.524 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.367 ms 00:16:19.524 00:16:19.524 --- 10.0.0.2 ping statistics --- 00:16:19.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:19.524 rtt min/avg/max/mdev = 0.367/0.367/0.367/0.000 ms 00:16:19.524 14:20:33 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:19.524 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:19.524 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.194 ms 00:16:19.524 00:16:19.524 --- 10.0.0.1 ping statistics --- 00:16:19.524 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:19.524 rtt min/avg/max/mdev = 0.194/0.194/0.194/0.000 ms 00:16:19.524 14:20:33 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:19.524 14:20:33 -- nvmf/common.sh@410 -- # return 0 00:16:19.524 14:20:33 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:19.524 14:20:33 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:19.524 14:20:33 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:19.524 14:20:33 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:19.524 14:20:33 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:19.524 14:20:33 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:19.524 14:20:33 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:19.524 14:20:33 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:16:19.524 14:20:33 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:19.524 14:20:33 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:19.524 14:20:33 -- common/autotest_common.sh@10 -- # set +x 00:16:19.524 14:20:33 -- nvmf/common.sh@469 -- # nvmfpid=356697 00:16:19.524 14:20:33 -- nvmf/common.sh@470 -- # waitforlisten 356697 00:16:19.524 14:20:33 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:16:19.524 14:20:33 -- common/autotest_common.sh@829 -- # '[' -z 356697 ']' 00:16:19.524 14:20:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:19.524 14:20:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:19.524 14:20:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:19.524 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:19.524 14:20:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:19.524 14:20:33 -- common/autotest_common.sh@10 -- # set +x 00:16:19.524 [2024-12-16 14:20:33.144896] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:19.524 [2024-12-16 14:20:33.144950] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:19.524 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.524 [2024-12-16 14:20:33.203033] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:19.524 [2024-12-16 14:20:33.276224] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:19.524 [2024-12-16 14:20:33.276336] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:19.524 [2024-12-16 14:20:33.276344] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:19.524 [2024-12-16 14:20:33.276351] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:19.524 [2024-12-16 14:20:33.276406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:19.524 [2024-12-16 14:20:33.276500] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:19.524 [2024-12-16 14:20:33.276527] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:19.524 [2024-12-16 14:20:33.276526] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:19.524 14:20:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:19.524 14:20:33 -- common/autotest_common.sh@862 -- # return 0 00:16:19.524 14:20:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:19.524 14:20:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:19.524 14:20:33 -- common/autotest_common.sh@10 -- # set +x 00:16:19.524 14:20:34 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:19.524 14:20:34 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:16:19.524 14:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.524 14:20:34 -- common/autotest_common.sh@10 -- # set +x 00:16:19.524 14:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.524 14:20:34 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:16:19.524 14:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.524 14:20:34 -- common/autotest_common.sh@10 -- # set +x 00:16:19.524 14:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.524 14:20:34 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:19.524 14:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.524 14:20:34 -- common/autotest_common.sh@10 -- # set +x 00:16:19.524 [2024-12-16 14:20:34.081946] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:19.524 14:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.524 14:20:34 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:19.524 14:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.524 14:20:34 -- common/autotest_common.sh@10 -- # set +x 00:16:19.784 Malloc0 00:16:19.784 14:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:19.784 14:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.784 14:20:34 -- common/autotest_common.sh@10 -- # set +x 00:16:19.784 14:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:19.784 14:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.784 14:20:34 -- common/autotest_common.sh@10 -- # set +x 00:16:19.784 14:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:19.784 14:20:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:19.784 14:20:34 -- common/autotest_common.sh@10 -- # set +x 00:16:19.784 [2024-12-16 14:20:34.145698] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:19.784 14:20:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=356941 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@30 -- # READ_PID=356944 00:16:19.784 14:20:34 -- nvmf/common.sh@520 -- # config=() 00:16:19.784 14:20:34 -- nvmf/common.sh@520 -- # local subsystem config 00:16:19.784 14:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:19.784 14:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:19.784 { 00:16:19.784 "params": { 00:16:19.784 "name": "Nvme$subsystem", 00:16:19.784 "trtype": "$TEST_TRANSPORT", 00:16:19.784 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:19.784 "adrfam": "ipv4", 00:16:19.784 "trsvcid": "$NVMF_PORT", 00:16:19.784 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:19.784 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:19.784 "hdgst": ${hdgst:-false}, 00:16:19.784 "ddgst": ${ddgst:-false} 00:16:19.784 }, 00:16:19.784 "method": "bdev_nvme_attach_controller" 00:16:19.784 } 00:16:19.784 EOF 00:16:19.784 )") 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=356946 00:16:19.784 14:20:34 -- nvmf/common.sh@520 -- # config=() 00:16:19.784 14:20:34 -- nvmf/common.sh@520 -- # local subsystem config 00:16:19.784 14:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:19.784 14:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:19.784 { 00:16:19.784 "params": { 00:16:19.784 "name": "Nvme$subsystem", 00:16:19.784 "trtype": "$TEST_TRANSPORT", 00:16:19.784 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:19.784 "adrfam": "ipv4", 00:16:19.784 "trsvcid": "$NVMF_PORT", 00:16:19.784 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:19.784 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:19.784 "hdgst": ${hdgst:-false}, 00:16:19.784 "ddgst": ${ddgst:-false} 00:16:19.784 }, 00:16:19.784 "method": "bdev_nvme_attach_controller" 00:16:19.784 } 00:16:19.784 EOF 00:16:19.784 )") 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=356949 00:16:19.784 14:20:34 -- nvmf/common.sh@542 -- # cat 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@35 -- # sync 00:16:19.784 14:20:34 -- nvmf/common.sh@520 -- # config=() 00:16:19.784 14:20:34 -- nvmf/common.sh@520 -- # local subsystem config 00:16:19.784 14:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:16:19.784 14:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:19.784 { 00:16:19.784 "params": { 00:16:19.784 "name": "Nvme$subsystem", 00:16:19.784 "trtype": "$TEST_TRANSPORT", 00:16:19.784 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:19.784 "adrfam": "ipv4", 00:16:19.784 "trsvcid": "$NVMF_PORT", 00:16:19.784 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:19.784 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:19.784 "hdgst": ${hdgst:-false}, 00:16:19.784 "ddgst": ${ddgst:-false} 00:16:19.784 }, 00:16:19.784 "method": "bdev_nvme_attach_controller" 00:16:19.784 } 00:16:19.784 EOF 00:16:19.784 )") 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:16:19.784 14:20:34 -- nvmf/common.sh@520 -- # config=() 00:16:19.784 14:20:34 -- nvmf/common.sh@520 -- # local subsystem config 00:16:19.784 14:20:34 -- nvmf/common.sh@542 -- # cat 00:16:19.784 14:20:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:19.784 14:20:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:19.784 { 00:16:19.784 "params": { 00:16:19.784 "name": "Nvme$subsystem", 00:16:19.784 "trtype": "$TEST_TRANSPORT", 00:16:19.784 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:19.784 "adrfam": "ipv4", 00:16:19.784 "trsvcid": "$NVMF_PORT", 00:16:19.784 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:19.784 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:19.784 "hdgst": ${hdgst:-false}, 00:16:19.784 "ddgst": ${ddgst:-false} 00:16:19.784 }, 00:16:19.784 "method": "bdev_nvme_attach_controller" 00:16:19.784 } 00:16:19.784 EOF 00:16:19.784 )") 00:16:19.784 14:20:34 -- nvmf/common.sh@542 -- # cat 00:16:19.784 14:20:34 -- target/bdev_io_wait.sh@37 -- # wait 356941 00:16:19.784 14:20:34 -- nvmf/common.sh@542 -- # cat 00:16:19.784 14:20:34 -- nvmf/common.sh@544 -- # jq . 00:16:19.784 14:20:34 -- nvmf/common.sh@544 -- # jq . 00:16:19.784 14:20:34 -- nvmf/common.sh@545 -- # IFS=, 00:16:19.784 14:20:34 -- nvmf/common.sh@544 -- # jq . 00:16:19.784 14:20:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:19.784 "params": { 00:16:19.784 "name": "Nvme1", 00:16:19.784 "trtype": "tcp", 00:16:19.784 "traddr": "10.0.0.2", 00:16:19.784 "adrfam": "ipv4", 00:16:19.784 "trsvcid": "4420", 00:16:19.784 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:19.784 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:19.784 "hdgst": false, 00:16:19.784 "ddgst": false 00:16:19.784 }, 00:16:19.784 "method": "bdev_nvme_attach_controller" 00:16:19.784 }' 00:16:19.784 14:20:34 -- nvmf/common.sh@544 -- # jq . 00:16:19.784 14:20:34 -- nvmf/common.sh@545 -- # IFS=, 00:16:19.784 14:20:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:19.784 "params": { 00:16:19.784 "name": "Nvme1", 00:16:19.784 "trtype": "tcp", 00:16:19.784 "traddr": "10.0.0.2", 00:16:19.784 "adrfam": "ipv4", 00:16:19.784 "trsvcid": "4420", 00:16:19.784 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:19.784 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:19.784 "hdgst": false, 00:16:19.784 "ddgst": false 00:16:19.784 }, 00:16:19.784 "method": "bdev_nvme_attach_controller" 00:16:19.784 }' 00:16:19.784 14:20:34 -- nvmf/common.sh@545 -- # IFS=, 00:16:19.784 14:20:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:19.784 "params": { 00:16:19.784 "name": "Nvme1", 00:16:19.784 "trtype": "tcp", 00:16:19.784 "traddr": "10.0.0.2", 00:16:19.784 "adrfam": "ipv4", 00:16:19.784 "trsvcid": "4420", 00:16:19.784 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:19.784 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:19.784 "hdgst": false, 00:16:19.784 "ddgst": false 00:16:19.784 }, 00:16:19.784 "method": "bdev_nvme_attach_controller" 00:16:19.784 }' 00:16:19.784 14:20:34 -- nvmf/common.sh@545 -- # IFS=, 00:16:19.784 14:20:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:19.784 "params": { 00:16:19.784 "name": "Nvme1", 00:16:19.784 "trtype": "tcp", 00:16:19.784 "traddr": "10.0.0.2", 00:16:19.784 "adrfam": "ipv4", 00:16:19.784 "trsvcid": "4420", 00:16:19.784 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:19.784 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:19.784 "hdgst": false, 00:16:19.784 "ddgst": false 00:16:19.784 }, 00:16:19.784 "method": "bdev_nvme_attach_controller" 00:16:19.784 }' 00:16:19.784 [2024-12-16 14:20:34.191073] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:19.784 [2024-12-16 14:20:34.191121] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:16:19.784 [2024-12-16 14:20:34.193032] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:19.784 [2024-12-16 14:20:34.193080] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:16:19.784 [2024-12-16 14:20:34.197187] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:19.784 [2024-12-16 14:20:34.197228] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:16:19.784 [2024-12-16 14:20:34.203963] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:19.784 [2024-12-16 14:20:34.204055] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:16:19.784 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.784 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.043 [2024-12-16 14:20:34.366431] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:20.043 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.043 [2024-12-16 14:20:34.443827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:16:20.043 [2024-12-16 14:20:34.466627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:20.043 EAL: No free 2048 kB hugepages reported on node 1 00:16:20.043 [2024-12-16 14:20:34.510183] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:20.043 [2024-12-16 14:20:34.559402] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:16:20.044 [2024-12-16 14:20:34.586525] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:20.044 [2024-12-16 14:20:34.587331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:16:20.302 [2024-12-16 14:20:34.659459] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:16:20.302 Running I/O for 1 seconds... 00:16:20.302 Running I/O for 1 seconds... 00:16:20.302 Running I/O for 1 seconds... 00:16:20.302 Running I/O for 1 seconds... 00:16:21.238 00:16:21.238 Latency(us) 00:16:21.238 [2024-12-16T13:20:35.812Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:21.238 [2024-12-16T13:20:35.812Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:16:21.238 Nvme1n1 : 1.01 13292.45 51.92 0.00 0.00 9600.50 5336.50 17351.44 00:16:21.238 [2024-12-16T13:20:35.812Z] =================================================================================================================== 00:16:21.238 [2024-12-16T13:20:35.812Z] Total : 13292.45 51.92 0.00 0.00 9600.50 5336.50 17351.44 00:16:21.496 00:16:21.496 Latency(us) 00:16:21.496 [2024-12-16T13:20:36.070Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:21.496 [2024-12-16T13:20:36.070Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:16:21.496 Nvme1n1 : 1.00 11703.99 45.72 0.00 0.00 10906.29 4868.39 21845.33 00:16:21.496 [2024-12-16T13:20:36.070Z] =================================================================================================================== 00:16:21.496 [2024-12-16T13:20:36.070Z] Total : 11703.99 45.72 0.00 0.00 10906.29 4868.39 21845.33 00:16:21.496 00:16:21.496 Latency(us) 00:16:21.496 [2024-12-16T13:20:36.070Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:21.496 [2024-12-16T13:20:36.070Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:16:21.496 Nvme1n1 : 1.00 257863.02 1007.28 0.00 0.00 494.62 202.85 612.45 00:16:21.496 [2024-12-16T13:20:36.070Z] =================================================================================================================== 00:16:21.496 [2024-12-16T13:20:36.070Z] Total : 257863.02 1007.28 0.00 0.00 494.62 202.85 612.45 00:16:21.496 00:16:21.496 Latency(us) 00:16:21.496 [2024-12-16T13:20:36.070Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:21.496 [2024-12-16T13:20:36.070Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:16:21.496 Nvme1n1 : 1.01 10452.35 40.83 0.00 0.00 12208.11 5773.41 25839.91 00:16:21.496 [2024-12-16T13:20:36.070Z] =================================================================================================================== 00:16:21.496 [2024-12-16T13:20:36.070Z] Total : 10452.35 40.83 0.00 0.00 12208.11 5773.41 25839.91 00:16:21.496 14:20:35 -- target/bdev_io_wait.sh@38 -- # wait 356944 00:16:21.755 14:20:36 -- target/bdev_io_wait.sh@39 -- # wait 356946 00:16:21.755 14:20:36 -- target/bdev_io_wait.sh@40 -- # wait 356949 00:16:21.755 14:20:36 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:16:21.755 14:20:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.755 14:20:36 -- common/autotest_common.sh@10 -- # set +x 00:16:21.755 14:20:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.755 14:20:36 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:16:21.755 14:20:36 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:16:21.755 14:20:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:21.755 14:20:36 -- nvmf/common.sh@116 -- # sync 00:16:21.755 14:20:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:21.755 14:20:36 -- nvmf/common.sh@119 -- # set +e 00:16:21.755 14:20:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:21.755 14:20:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:21.755 rmmod nvme_tcp 00:16:21.755 rmmod nvme_fabrics 00:16:21.755 rmmod nvme_keyring 00:16:21.755 14:20:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:21.755 14:20:36 -- nvmf/common.sh@123 -- # set -e 00:16:21.755 14:20:36 -- nvmf/common.sh@124 -- # return 0 00:16:21.755 14:20:36 -- nvmf/common.sh@477 -- # '[' -n 356697 ']' 00:16:21.755 14:20:36 -- nvmf/common.sh@478 -- # killprocess 356697 00:16:21.755 14:20:36 -- common/autotest_common.sh@936 -- # '[' -z 356697 ']' 00:16:21.755 14:20:36 -- common/autotest_common.sh@940 -- # kill -0 356697 00:16:21.755 14:20:36 -- common/autotest_common.sh@941 -- # uname 00:16:21.755 14:20:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:21.755 14:20:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 356697 00:16:21.755 14:20:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:21.755 14:20:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:21.755 14:20:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 356697' 00:16:21.755 killing process with pid 356697 00:16:21.755 14:20:36 -- common/autotest_common.sh@955 -- # kill 356697 00:16:21.755 14:20:36 -- common/autotest_common.sh@960 -- # wait 356697 00:16:22.014 14:20:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:22.014 14:20:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:22.014 14:20:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:22.014 14:20:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:22.014 14:20:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:22.014 14:20:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:22.014 14:20:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:22.014 14:20:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:24.551 14:20:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:24.551 00:16:24.551 real 0m11.224s 00:16:24.551 user 0m19.760s 00:16:24.551 sys 0m5.962s 00:16:24.551 14:20:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:24.551 14:20:38 -- common/autotest_common.sh@10 -- # set +x 00:16:24.551 ************************************ 00:16:24.551 END TEST nvmf_bdev_io_wait 00:16:24.551 ************************************ 00:16:24.551 14:20:38 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:16:24.551 14:20:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:24.551 14:20:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:24.552 14:20:38 -- common/autotest_common.sh@10 -- # set +x 00:16:24.552 ************************************ 00:16:24.552 START TEST nvmf_queue_depth 00:16:24.552 ************************************ 00:16:24.552 14:20:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:16:24.552 * Looking for test storage... 00:16:24.552 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:24.552 14:20:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:24.552 14:20:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:24.552 14:20:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:24.552 14:20:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:24.552 14:20:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:24.552 14:20:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:24.552 14:20:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:24.552 14:20:38 -- scripts/common.sh@335 -- # IFS=.-: 00:16:24.552 14:20:38 -- scripts/common.sh@335 -- # read -ra ver1 00:16:24.552 14:20:38 -- scripts/common.sh@336 -- # IFS=.-: 00:16:24.552 14:20:38 -- scripts/common.sh@336 -- # read -ra ver2 00:16:24.552 14:20:38 -- scripts/common.sh@337 -- # local 'op=<' 00:16:24.552 14:20:38 -- scripts/common.sh@339 -- # ver1_l=2 00:16:24.552 14:20:38 -- scripts/common.sh@340 -- # ver2_l=1 00:16:24.552 14:20:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:24.552 14:20:38 -- scripts/common.sh@343 -- # case "$op" in 00:16:24.552 14:20:38 -- scripts/common.sh@344 -- # : 1 00:16:24.552 14:20:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:24.552 14:20:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:24.552 14:20:38 -- scripts/common.sh@364 -- # decimal 1 00:16:24.552 14:20:38 -- scripts/common.sh@352 -- # local d=1 00:16:24.552 14:20:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:24.552 14:20:38 -- scripts/common.sh@354 -- # echo 1 00:16:24.552 14:20:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:24.552 14:20:38 -- scripts/common.sh@365 -- # decimal 2 00:16:24.552 14:20:38 -- scripts/common.sh@352 -- # local d=2 00:16:24.552 14:20:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:24.552 14:20:38 -- scripts/common.sh@354 -- # echo 2 00:16:24.552 14:20:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:24.552 14:20:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:24.552 14:20:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:24.552 14:20:38 -- scripts/common.sh@367 -- # return 0 00:16:24.552 14:20:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:24.552 14:20:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:24.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:24.552 --rc genhtml_branch_coverage=1 00:16:24.552 --rc genhtml_function_coverage=1 00:16:24.552 --rc genhtml_legend=1 00:16:24.552 --rc geninfo_all_blocks=1 00:16:24.552 --rc geninfo_unexecuted_blocks=1 00:16:24.552 00:16:24.552 ' 00:16:24.552 14:20:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:24.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:24.552 --rc genhtml_branch_coverage=1 00:16:24.552 --rc genhtml_function_coverage=1 00:16:24.552 --rc genhtml_legend=1 00:16:24.552 --rc geninfo_all_blocks=1 00:16:24.552 --rc geninfo_unexecuted_blocks=1 00:16:24.552 00:16:24.552 ' 00:16:24.552 14:20:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:24.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:24.552 --rc genhtml_branch_coverage=1 00:16:24.552 --rc genhtml_function_coverage=1 00:16:24.552 --rc genhtml_legend=1 00:16:24.552 --rc geninfo_all_blocks=1 00:16:24.552 --rc geninfo_unexecuted_blocks=1 00:16:24.552 00:16:24.552 ' 00:16:24.552 14:20:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:24.552 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:24.552 --rc genhtml_branch_coverage=1 00:16:24.552 --rc genhtml_function_coverage=1 00:16:24.552 --rc genhtml_legend=1 00:16:24.552 --rc geninfo_all_blocks=1 00:16:24.552 --rc geninfo_unexecuted_blocks=1 00:16:24.552 00:16:24.552 ' 00:16:24.552 14:20:38 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:24.552 14:20:38 -- nvmf/common.sh@7 -- # uname -s 00:16:24.552 14:20:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:24.552 14:20:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:24.552 14:20:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:24.552 14:20:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:24.552 14:20:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:24.552 14:20:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:24.552 14:20:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:24.552 14:20:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:24.552 14:20:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:24.552 14:20:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:24.552 14:20:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:16:24.552 14:20:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:16:24.552 14:20:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:24.552 14:20:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:24.552 14:20:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:24.552 14:20:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:24.552 14:20:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:24.552 14:20:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:24.552 14:20:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:24.552 14:20:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.552 14:20:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.552 14:20:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.552 14:20:38 -- paths/export.sh@5 -- # export PATH 00:16:24.552 14:20:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:24.552 14:20:38 -- nvmf/common.sh@46 -- # : 0 00:16:24.552 14:20:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:24.552 14:20:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:24.552 14:20:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:24.552 14:20:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:24.552 14:20:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:24.552 14:20:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:24.552 14:20:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:24.552 14:20:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:24.552 14:20:38 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:16:24.552 14:20:38 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:16:24.552 14:20:38 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:16:24.552 14:20:38 -- target/queue_depth.sh@19 -- # nvmftestinit 00:16:24.552 14:20:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:24.552 14:20:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:24.552 14:20:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:24.552 14:20:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:24.552 14:20:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:24.552 14:20:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:24.552 14:20:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:24.552 14:20:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:24.552 14:20:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:24.552 14:20:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:24.552 14:20:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:24.552 14:20:38 -- common/autotest_common.sh@10 -- # set +x 00:16:29.825 14:20:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:29.825 14:20:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:29.825 14:20:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:29.825 14:20:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:29.825 14:20:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:29.825 14:20:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:29.825 14:20:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:29.825 14:20:43 -- nvmf/common.sh@294 -- # net_devs=() 00:16:29.825 14:20:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:29.825 14:20:43 -- nvmf/common.sh@295 -- # e810=() 00:16:29.825 14:20:43 -- nvmf/common.sh@295 -- # local -ga e810 00:16:29.825 14:20:43 -- nvmf/common.sh@296 -- # x722=() 00:16:29.825 14:20:43 -- nvmf/common.sh@296 -- # local -ga x722 00:16:29.825 14:20:43 -- nvmf/common.sh@297 -- # mlx=() 00:16:29.825 14:20:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:29.825 14:20:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:29.825 14:20:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:29.825 14:20:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:29.825 14:20:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:29.825 14:20:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.825 14:20:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:29.825 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:29.825 14:20:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:29.825 14:20:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:29.825 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:29.825 14:20:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:29.825 14:20:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.825 14:20:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.825 14:20:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.825 14:20:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.825 14:20:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:29.825 Found net devices under 0000:af:00.0: cvl_0_0 00:16:29.825 14:20:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.825 14:20:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:29.825 14:20:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:29.825 14:20:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:29.825 14:20:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:29.825 14:20:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:29.825 Found net devices under 0000:af:00.1: cvl_0_1 00:16:29.825 14:20:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:29.825 14:20:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:29.825 14:20:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:29.825 14:20:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:29.825 14:20:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:29.825 14:20:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:29.825 14:20:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:29.825 14:20:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:29.825 14:20:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:29.825 14:20:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:29.825 14:20:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:29.825 14:20:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:29.825 14:20:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:29.825 14:20:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:29.825 14:20:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:29.825 14:20:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:29.825 14:20:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:29.825 14:20:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:29.825 14:20:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:29.825 14:20:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:29.825 14:20:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:29.825 14:20:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:29.825 14:20:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:29.825 14:20:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:29.825 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:29.825 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.361 ms 00:16:29.825 00:16:29.825 --- 10.0.0.2 ping statistics --- 00:16:29.825 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.825 rtt min/avg/max/mdev = 0.361/0.361/0.361/0.000 ms 00:16:29.825 14:20:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:29.825 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:29.825 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.190 ms 00:16:29.825 00:16:29.825 --- 10.0.0.1 ping statistics --- 00:16:29.825 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:29.825 rtt min/avg/max/mdev = 0.190/0.190/0.190/0.000 ms 00:16:29.825 14:20:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:29.825 14:20:43 -- nvmf/common.sh@410 -- # return 0 00:16:29.825 14:20:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:29.825 14:20:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:29.825 14:20:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:29.825 14:20:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:29.825 14:20:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:29.825 14:20:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:29.825 14:20:43 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:16:29.825 14:20:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:29.825 14:20:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:29.825 14:20:43 -- common/autotest_common.sh@10 -- # set +x 00:16:29.825 14:20:43 -- nvmf/common.sh@469 -- # nvmfpid=360604 00:16:29.825 14:20:43 -- nvmf/common.sh@470 -- # waitforlisten 360604 00:16:29.825 14:20:43 -- common/autotest_common.sh@829 -- # '[' -z 360604 ']' 00:16:29.825 14:20:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:29.825 14:20:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:29.825 14:20:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:29.825 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:29.825 14:20:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:29.825 14:20:43 -- common/autotest_common.sh@10 -- # set +x 00:16:29.825 14:20:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:29.825 [2024-12-16 14:20:43.753904] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:29.825 [2024-12-16 14:20:43.753949] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:29.825 EAL: No free 2048 kB hugepages reported on node 1 00:16:29.825 [2024-12-16 14:20:43.812371] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:29.825 [2024-12-16 14:20:43.886141] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:29.825 [2024-12-16 14:20:43.886244] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:29.825 [2024-12-16 14:20:43.886253] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:29.825 [2024-12-16 14:20:43.886259] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:29.825 [2024-12-16 14:20:43.886275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:30.085 14:20:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:30.085 14:20:44 -- common/autotest_common.sh@862 -- # return 0 00:16:30.085 14:20:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:30.085 14:20:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:30.085 14:20:44 -- common/autotest_common.sh@10 -- # set +x 00:16:30.085 14:20:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:30.085 14:20:44 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:16:30.085 14:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.085 14:20:44 -- common/autotest_common.sh@10 -- # set +x 00:16:30.085 [2024-12-16 14:20:44.591012] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:30.085 14:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.085 14:20:44 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:16:30.085 14:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.085 14:20:44 -- common/autotest_common.sh@10 -- # set +x 00:16:30.085 Malloc0 00:16:30.085 14:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.085 14:20:44 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:16:30.085 14:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.085 14:20:44 -- common/autotest_common.sh@10 -- # set +x 00:16:30.085 14:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.085 14:20:44 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:16:30.085 14:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.085 14:20:44 -- common/autotest_common.sh@10 -- # set +x 00:16:30.085 14:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.085 14:20:44 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:30.085 14:20:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:30.085 14:20:44 -- common/autotest_common.sh@10 -- # set +x 00:16:30.085 [2024-12-16 14:20:44.643223] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:30.085 14:20:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:30.085 14:20:44 -- target/queue_depth.sh@30 -- # bdevperf_pid=360707 00:16:30.085 14:20:44 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:16:30.085 14:20:44 -- target/queue_depth.sh@33 -- # waitforlisten 360707 /var/tmp/bdevperf.sock 00:16:30.085 14:20:44 -- common/autotest_common.sh@829 -- # '[' -z 360707 ']' 00:16:30.085 14:20:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:16:30.085 14:20:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:30.085 14:20:44 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:16:30.085 14:20:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:16:30.085 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:16:30.085 14:20:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:30.085 14:20:44 -- common/autotest_common.sh@10 -- # set +x 00:16:30.344 [2024-12-16 14:20:44.689798] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:30.344 [2024-12-16 14:20:44.689839] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid360707 ] 00:16:30.344 EAL: No free 2048 kB hugepages reported on node 1 00:16:30.344 [2024-12-16 14:20:44.742565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:30.344 [2024-12-16 14:20:44.812928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:31.280 14:20:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:31.280 14:20:45 -- common/autotest_common.sh@862 -- # return 0 00:16:31.280 14:20:45 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:16:31.280 14:20:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:31.280 14:20:45 -- common/autotest_common.sh@10 -- # set +x 00:16:31.280 NVMe0n1 00:16:31.280 14:20:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:31.280 14:20:45 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:16:31.280 Running I/O for 10 seconds... 00:16:41.255 00:16:41.255 Latency(us) 00:16:41.255 [2024-12-16T13:20:55.829Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:41.255 [2024-12-16T13:20:55.829Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:16:41.255 Verification LBA range: start 0x0 length 0x4000 00:16:41.255 NVMe0n1 : 10.05 18927.93 73.94 0.00 0.00 53951.88 10610.59 42192.70 00:16:41.255 [2024-12-16T13:20:55.829Z] =================================================================================================================== 00:16:41.255 [2024-12-16T13:20:55.829Z] Total : 18927.93 73.94 0.00 0.00 53951.88 10610.59 42192.70 00:16:41.255 0 00:16:41.255 14:20:55 -- target/queue_depth.sh@39 -- # killprocess 360707 00:16:41.255 14:20:55 -- common/autotest_common.sh@936 -- # '[' -z 360707 ']' 00:16:41.255 14:20:55 -- common/autotest_common.sh@940 -- # kill -0 360707 00:16:41.255 14:20:55 -- common/autotest_common.sh@941 -- # uname 00:16:41.255 14:20:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:41.255 14:20:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 360707 00:16:41.513 14:20:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:41.513 14:20:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:41.513 14:20:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 360707' 00:16:41.513 killing process with pid 360707 00:16:41.513 14:20:55 -- common/autotest_common.sh@955 -- # kill 360707 00:16:41.513 Received shutdown signal, test time was about 10.000000 seconds 00:16:41.513 00:16:41.513 Latency(us) 00:16:41.513 [2024-12-16T13:20:56.087Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:16:41.513 [2024-12-16T13:20:56.087Z] =================================================================================================================== 00:16:41.513 [2024-12-16T13:20:56.087Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:16:41.513 14:20:55 -- common/autotest_common.sh@960 -- # wait 360707 00:16:41.513 14:20:56 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:16:41.513 14:20:56 -- target/queue_depth.sh@43 -- # nvmftestfini 00:16:41.513 14:20:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:41.513 14:20:56 -- nvmf/common.sh@116 -- # sync 00:16:41.513 14:20:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:41.513 14:20:56 -- nvmf/common.sh@119 -- # set +e 00:16:41.513 14:20:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:41.513 14:20:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:41.513 rmmod nvme_tcp 00:16:41.513 rmmod nvme_fabrics 00:16:41.513 rmmod nvme_keyring 00:16:41.772 14:20:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:41.772 14:20:56 -- nvmf/common.sh@123 -- # set -e 00:16:41.772 14:20:56 -- nvmf/common.sh@124 -- # return 0 00:16:41.772 14:20:56 -- nvmf/common.sh@477 -- # '[' -n 360604 ']' 00:16:41.772 14:20:56 -- nvmf/common.sh@478 -- # killprocess 360604 00:16:41.772 14:20:56 -- common/autotest_common.sh@936 -- # '[' -z 360604 ']' 00:16:41.772 14:20:56 -- common/autotest_common.sh@940 -- # kill -0 360604 00:16:41.772 14:20:56 -- common/autotest_common.sh@941 -- # uname 00:16:41.772 14:20:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:41.772 14:20:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 360604 00:16:41.772 14:20:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:16:41.772 14:20:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:16:41.772 14:20:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 360604' 00:16:41.772 killing process with pid 360604 00:16:41.772 14:20:56 -- common/autotest_common.sh@955 -- # kill 360604 00:16:41.772 14:20:56 -- common/autotest_common.sh@960 -- # wait 360604 00:16:42.031 14:20:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:42.031 14:20:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:42.031 14:20:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:42.031 14:20:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:42.031 14:20:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:42.031 14:20:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:42.031 14:20:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:42.031 14:20:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:43.936 14:20:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:43.936 00:16:43.936 real 0m19.887s 00:16:43.936 user 0m24.559s 00:16:43.936 sys 0m5.483s 00:16:43.936 14:20:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:43.936 14:20:58 -- common/autotest_common.sh@10 -- # set +x 00:16:43.936 ************************************ 00:16:43.936 END TEST nvmf_queue_depth 00:16:43.936 ************************************ 00:16:43.936 14:20:58 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:16:43.936 14:20:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:43.936 14:20:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:43.936 14:20:58 -- common/autotest_common.sh@10 -- # set +x 00:16:43.936 ************************************ 00:16:43.936 START TEST nvmf_multipath 00:16:43.936 ************************************ 00:16:43.936 14:20:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:16:44.195 * Looking for test storage... 00:16:44.195 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:44.195 14:20:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:44.195 14:20:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:44.195 14:20:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:44.195 14:20:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:44.195 14:20:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:44.195 14:20:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:44.195 14:20:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:44.195 14:20:58 -- scripts/common.sh@335 -- # IFS=.-: 00:16:44.195 14:20:58 -- scripts/common.sh@335 -- # read -ra ver1 00:16:44.196 14:20:58 -- scripts/common.sh@336 -- # IFS=.-: 00:16:44.196 14:20:58 -- scripts/common.sh@336 -- # read -ra ver2 00:16:44.196 14:20:58 -- scripts/common.sh@337 -- # local 'op=<' 00:16:44.196 14:20:58 -- scripts/common.sh@339 -- # ver1_l=2 00:16:44.196 14:20:58 -- scripts/common.sh@340 -- # ver2_l=1 00:16:44.196 14:20:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:44.196 14:20:58 -- scripts/common.sh@343 -- # case "$op" in 00:16:44.196 14:20:58 -- scripts/common.sh@344 -- # : 1 00:16:44.196 14:20:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:44.196 14:20:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:44.196 14:20:58 -- scripts/common.sh@364 -- # decimal 1 00:16:44.196 14:20:58 -- scripts/common.sh@352 -- # local d=1 00:16:44.196 14:20:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:44.196 14:20:58 -- scripts/common.sh@354 -- # echo 1 00:16:44.196 14:20:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:44.196 14:20:58 -- scripts/common.sh@365 -- # decimal 2 00:16:44.196 14:20:58 -- scripts/common.sh@352 -- # local d=2 00:16:44.196 14:20:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:44.196 14:20:58 -- scripts/common.sh@354 -- # echo 2 00:16:44.196 14:20:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:44.196 14:20:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:44.196 14:20:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:44.196 14:20:58 -- scripts/common.sh@367 -- # return 0 00:16:44.196 14:20:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:44.196 14:20:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:44.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.196 --rc genhtml_branch_coverage=1 00:16:44.196 --rc genhtml_function_coverage=1 00:16:44.196 --rc genhtml_legend=1 00:16:44.196 --rc geninfo_all_blocks=1 00:16:44.196 --rc geninfo_unexecuted_blocks=1 00:16:44.196 00:16:44.196 ' 00:16:44.196 14:20:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:44.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.196 --rc genhtml_branch_coverage=1 00:16:44.196 --rc genhtml_function_coverage=1 00:16:44.196 --rc genhtml_legend=1 00:16:44.196 --rc geninfo_all_blocks=1 00:16:44.196 --rc geninfo_unexecuted_blocks=1 00:16:44.196 00:16:44.196 ' 00:16:44.196 14:20:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:44.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.196 --rc genhtml_branch_coverage=1 00:16:44.196 --rc genhtml_function_coverage=1 00:16:44.196 --rc genhtml_legend=1 00:16:44.196 --rc geninfo_all_blocks=1 00:16:44.196 --rc geninfo_unexecuted_blocks=1 00:16:44.196 00:16:44.196 ' 00:16:44.196 14:20:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:44.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:44.196 --rc genhtml_branch_coverage=1 00:16:44.196 --rc genhtml_function_coverage=1 00:16:44.196 --rc genhtml_legend=1 00:16:44.196 --rc geninfo_all_blocks=1 00:16:44.196 --rc geninfo_unexecuted_blocks=1 00:16:44.196 00:16:44.196 ' 00:16:44.196 14:20:58 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:44.196 14:20:58 -- nvmf/common.sh@7 -- # uname -s 00:16:44.196 14:20:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:44.196 14:20:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:44.196 14:20:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:44.196 14:20:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:44.196 14:20:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:44.196 14:20:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:44.196 14:20:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:44.196 14:20:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:44.196 14:20:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:44.196 14:20:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:44.196 14:20:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:16:44.196 14:20:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:16:44.196 14:20:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:44.196 14:20:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:44.196 14:20:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:44.196 14:20:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:44.196 14:20:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:44.196 14:20:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:44.196 14:20:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:44.196 14:20:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.196 14:20:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.196 14:20:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.196 14:20:58 -- paths/export.sh@5 -- # export PATH 00:16:44.196 14:20:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:44.196 14:20:58 -- nvmf/common.sh@46 -- # : 0 00:16:44.196 14:20:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:44.196 14:20:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:44.196 14:20:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:44.196 14:20:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:44.196 14:20:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:44.196 14:20:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:44.196 14:20:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:44.196 14:20:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:44.196 14:20:58 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:44.196 14:20:58 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:44.196 14:20:58 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:16:44.196 14:20:58 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:16:44.196 14:20:58 -- target/multipath.sh@43 -- # nvmftestinit 00:16:44.196 14:20:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:44.196 14:20:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:44.196 14:20:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:44.196 14:20:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:44.196 14:20:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:44.196 14:20:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:44.196 14:20:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:44.196 14:20:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:44.196 14:20:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:44.196 14:20:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:44.196 14:20:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:44.196 14:20:58 -- common/autotest_common.sh@10 -- # set +x 00:16:49.468 14:21:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:49.468 14:21:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:49.468 14:21:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:49.468 14:21:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:49.468 14:21:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:49.468 14:21:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:49.468 14:21:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:49.468 14:21:03 -- nvmf/common.sh@294 -- # net_devs=() 00:16:49.468 14:21:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:49.468 14:21:03 -- nvmf/common.sh@295 -- # e810=() 00:16:49.468 14:21:03 -- nvmf/common.sh@295 -- # local -ga e810 00:16:49.468 14:21:03 -- nvmf/common.sh@296 -- # x722=() 00:16:49.468 14:21:03 -- nvmf/common.sh@296 -- # local -ga x722 00:16:49.468 14:21:03 -- nvmf/common.sh@297 -- # mlx=() 00:16:49.468 14:21:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:49.468 14:21:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:49.468 14:21:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:49.468 14:21:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:49.468 14:21:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:49.469 14:21:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:49.469 14:21:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:49.469 14:21:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:49.469 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:49.469 14:21:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:49.469 14:21:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:49.469 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:49.469 14:21:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:49.469 14:21:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:49.469 14:21:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:49.469 14:21:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:49.469 14:21:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:49.469 14:21:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:49.469 Found net devices under 0000:af:00.0: cvl_0_0 00:16:49.469 14:21:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:49.469 14:21:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:49.469 14:21:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:49.469 14:21:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:49.469 14:21:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:49.469 14:21:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:49.469 Found net devices under 0000:af:00.1: cvl_0_1 00:16:49.469 14:21:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:49.469 14:21:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:49.469 14:21:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:49.469 14:21:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:49.469 14:21:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:49.469 14:21:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:49.469 14:21:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:49.469 14:21:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:49.469 14:21:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:49.469 14:21:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:49.469 14:21:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:49.469 14:21:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:49.469 14:21:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:49.469 14:21:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:49.469 14:21:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:49.469 14:21:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:49.469 14:21:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:49.469 14:21:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:49.728 14:21:04 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:49.728 14:21:04 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:49.728 14:21:04 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:49.728 14:21:04 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:49.728 14:21:04 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:49.728 14:21:04 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:49.728 14:21:04 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:49.728 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:49.728 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.379 ms 00:16:49.728 00:16:49.728 --- 10.0.0.2 ping statistics --- 00:16:49.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:49.728 rtt min/avg/max/mdev = 0.379/0.379/0.379/0.000 ms 00:16:49.728 14:21:04 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:49.728 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:49.728 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.214 ms 00:16:49.728 00:16:49.728 --- 10.0.0.1 ping statistics --- 00:16:49.728 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:49.728 rtt min/avg/max/mdev = 0.214/0.214/0.214/0.000 ms 00:16:49.728 14:21:04 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:49.728 14:21:04 -- nvmf/common.sh@410 -- # return 0 00:16:49.728 14:21:04 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:49.728 14:21:04 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:49.728 14:21:04 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:49.728 14:21:04 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:49.728 14:21:04 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:49.728 14:21:04 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:49.728 14:21:04 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:49.728 14:21:04 -- target/multipath.sh@45 -- # '[' -z ']' 00:16:49.728 14:21:04 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:16:49.728 only one NIC for nvmf test 00:16:49.729 14:21:04 -- target/multipath.sh@47 -- # nvmftestfini 00:16:49.729 14:21:04 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:49.729 14:21:04 -- nvmf/common.sh@116 -- # sync 00:16:49.729 14:21:04 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:49.729 14:21:04 -- nvmf/common.sh@119 -- # set +e 00:16:49.729 14:21:04 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:49.729 14:21:04 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:49.729 rmmod nvme_tcp 00:16:49.729 rmmod nvme_fabrics 00:16:49.729 rmmod nvme_keyring 00:16:49.729 14:21:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:49.729 14:21:04 -- nvmf/common.sh@123 -- # set -e 00:16:49.729 14:21:04 -- nvmf/common.sh@124 -- # return 0 00:16:49.729 14:21:04 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:49.729 14:21:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:49.729 14:21:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:49.729 14:21:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:49.729 14:21:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:49.729 14:21:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:49.729 14:21:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:49.729 14:21:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:49.729 14:21:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.264 14:21:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:52.264 14:21:06 -- target/multipath.sh@48 -- # exit 0 00:16:52.264 14:21:06 -- target/multipath.sh@1 -- # nvmftestfini 00:16:52.264 14:21:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:16:52.264 14:21:06 -- nvmf/common.sh@116 -- # sync 00:16:52.264 14:21:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:16:52.264 14:21:06 -- nvmf/common.sh@119 -- # set +e 00:16:52.264 14:21:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:16:52.264 14:21:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:16:52.264 14:21:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:16:52.264 14:21:06 -- nvmf/common.sh@123 -- # set -e 00:16:52.264 14:21:06 -- nvmf/common.sh@124 -- # return 0 00:16:52.264 14:21:06 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:16:52.264 14:21:06 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:16:52.264 14:21:06 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:16:52.265 14:21:06 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:16:52.265 14:21:06 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:16:52.265 14:21:06 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:16:52.265 14:21:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:52.265 14:21:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:52.265 14:21:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.265 14:21:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:16:52.265 00:16:52.265 real 0m7.892s 00:16:52.265 user 0m1.721s 00:16:52.265 sys 0m4.140s 00:16:52.265 14:21:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:52.265 14:21:06 -- common/autotest_common.sh@10 -- # set +x 00:16:52.265 ************************************ 00:16:52.265 END TEST nvmf_multipath 00:16:52.265 ************************************ 00:16:52.265 14:21:06 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:52.265 14:21:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:52.265 14:21:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:52.265 14:21:06 -- common/autotest_common.sh@10 -- # set +x 00:16:52.265 ************************************ 00:16:52.265 START TEST nvmf_zcopy 00:16:52.265 ************************************ 00:16:52.265 14:21:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:16:52.265 * Looking for test storage... 00:16:52.265 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:52.265 14:21:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:52.265 14:21:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:52.265 14:21:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:52.265 14:21:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:52.265 14:21:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:52.265 14:21:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:52.265 14:21:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:52.265 14:21:06 -- scripts/common.sh@335 -- # IFS=.-: 00:16:52.265 14:21:06 -- scripts/common.sh@335 -- # read -ra ver1 00:16:52.265 14:21:06 -- scripts/common.sh@336 -- # IFS=.-: 00:16:52.265 14:21:06 -- scripts/common.sh@336 -- # read -ra ver2 00:16:52.265 14:21:06 -- scripts/common.sh@337 -- # local 'op=<' 00:16:52.265 14:21:06 -- scripts/common.sh@339 -- # ver1_l=2 00:16:52.265 14:21:06 -- scripts/common.sh@340 -- # ver2_l=1 00:16:52.265 14:21:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:52.265 14:21:06 -- scripts/common.sh@343 -- # case "$op" in 00:16:52.265 14:21:06 -- scripts/common.sh@344 -- # : 1 00:16:52.265 14:21:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:52.265 14:21:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:52.265 14:21:06 -- scripts/common.sh@364 -- # decimal 1 00:16:52.265 14:21:06 -- scripts/common.sh@352 -- # local d=1 00:16:52.265 14:21:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:52.265 14:21:06 -- scripts/common.sh@354 -- # echo 1 00:16:52.265 14:21:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:52.265 14:21:06 -- scripts/common.sh@365 -- # decimal 2 00:16:52.265 14:21:06 -- scripts/common.sh@352 -- # local d=2 00:16:52.265 14:21:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:52.265 14:21:06 -- scripts/common.sh@354 -- # echo 2 00:16:52.265 14:21:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:52.265 14:21:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:52.265 14:21:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:52.265 14:21:06 -- scripts/common.sh@367 -- # return 0 00:16:52.265 14:21:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:52.265 14:21:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:52.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.265 --rc genhtml_branch_coverage=1 00:16:52.265 --rc genhtml_function_coverage=1 00:16:52.265 --rc genhtml_legend=1 00:16:52.265 --rc geninfo_all_blocks=1 00:16:52.265 --rc geninfo_unexecuted_blocks=1 00:16:52.265 00:16:52.265 ' 00:16:52.265 14:21:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:52.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.265 --rc genhtml_branch_coverage=1 00:16:52.265 --rc genhtml_function_coverage=1 00:16:52.265 --rc genhtml_legend=1 00:16:52.265 --rc geninfo_all_blocks=1 00:16:52.265 --rc geninfo_unexecuted_blocks=1 00:16:52.265 00:16:52.265 ' 00:16:52.265 14:21:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:52.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.265 --rc genhtml_branch_coverage=1 00:16:52.265 --rc genhtml_function_coverage=1 00:16:52.265 --rc genhtml_legend=1 00:16:52.265 --rc geninfo_all_blocks=1 00:16:52.265 --rc geninfo_unexecuted_blocks=1 00:16:52.265 00:16:52.265 ' 00:16:52.265 14:21:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:52.265 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:52.265 --rc genhtml_branch_coverage=1 00:16:52.265 --rc genhtml_function_coverage=1 00:16:52.265 --rc genhtml_legend=1 00:16:52.265 --rc geninfo_all_blocks=1 00:16:52.265 --rc geninfo_unexecuted_blocks=1 00:16:52.265 00:16:52.265 ' 00:16:52.265 14:21:06 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:52.265 14:21:06 -- nvmf/common.sh@7 -- # uname -s 00:16:52.265 14:21:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:52.265 14:21:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:52.265 14:21:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:52.265 14:21:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:52.265 14:21:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:52.265 14:21:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:52.265 14:21:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:52.265 14:21:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:52.265 14:21:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:52.265 14:21:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:52.265 14:21:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:16:52.265 14:21:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:16:52.265 14:21:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:52.265 14:21:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:52.265 14:21:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:52.265 14:21:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:52.265 14:21:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:52.265 14:21:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:52.265 14:21:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:52.265 14:21:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.265 14:21:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.265 14:21:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.265 14:21:06 -- paths/export.sh@5 -- # export PATH 00:16:52.265 14:21:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:52.265 14:21:06 -- nvmf/common.sh@46 -- # : 0 00:16:52.265 14:21:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:52.265 14:21:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:52.265 14:21:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:52.265 14:21:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:52.265 14:21:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:52.265 14:21:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:52.265 14:21:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:52.265 14:21:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:52.265 14:21:06 -- target/zcopy.sh@12 -- # nvmftestinit 00:16:52.265 14:21:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:52.265 14:21:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:52.265 14:21:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:52.265 14:21:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:52.265 14:21:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:52.265 14:21:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:52.265 14:21:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:52.265 14:21:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:52.265 14:21:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:52.265 14:21:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:52.265 14:21:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:52.265 14:21:06 -- common/autotest_common.sh@10 -- # set +x 00:16:57.539 14:21:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:16:57.539 14:21:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:16:57.539 14:21:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:16:57.539 14:21:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:16:57.539 14:21:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:16:57.539 14:21:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:16:57.539 14:21:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:16:57.539 14:21:11 -- nvmf/common.sh@294 -- # net_devs=() 00:16:57.539 14:21:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:16:57.539 14:21:11 -- nvmf/common.sh@295 -- # e810=() 00:16:57.539 14:21:11 -- nvmf/common.sh@295 -- # local -ga e810 00:16:57.539 14:21:11 -- nvmf/common.sh@296 -- # x722=() 00:16:57.539 14:21:11 -- nvmf/common.sh@296 -- # local -ga x722 00:16:57.539 14:21:11 -- nvmf/common.sh@297 -- # mlx=() 00:16:57.539 14:21:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:16:57.539 14:21:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:16:57.539 14:21:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:16:57.540 14:21:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:16:57.540 14:21:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:16:57.540 14:21:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:16:57.540 14:21:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:16:57.540 14:21:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:57.540 14:21:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:16:57.540 Found 0000:af:00.0 (0x8086 - 0x159b) 00:16:57.540 14:21:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:16:57.540 14:21:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:16:57.540 Found 0000:af:00.1 (0x8086 - 0x159b) 00:16:57.540 14:21:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:16:57.540 14:21:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:57.540 14:21:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:57.540 14:21:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:57.540 14:21:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:57.540 14:21:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:16:57.540 Found net devices under 0000:af:00.0: cvl_0_0 00:16:57.540 14:21:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:57.540 14:21:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:16:57.540 14:21:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:16:57.540 14:21:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:16:57.540 14:21:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:16:57.540 14:21:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:16:57.540 Found net devices under 0000:af:00.1: cvl_0_1 00:16:57.540 14:21:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:16:57.540 14:21:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:16:57.540 14:21:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:16:57.540 14:21:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:16:57.540 14:21:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:16:57.540 14:21:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:16:57.540 14:21:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:16:57.540 14:21:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:16:57.540 14:21:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:16:57.540 14:21:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:16:57.540 14:21:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:16:57.540 14:21:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:16:57.540 14:21:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:16:57.540 14:21:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:16:57.540 14:21:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:16:57.540 14:21:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:16:57.540 14:21:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:16:57.540 14:21:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:16:57.540 14:21:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:16:57.540 14:21:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:16:57.540 14:21:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:16:57.540 14:21:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:16:57.540 14:21:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:16:57.540 14:21:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:16:57.540 14:21:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:16:57.540 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:16:57.540 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.359 ms 00:16:57.540 00:16:57.540 --- 10.0.0.2 ping statistics --- 00:16:57.540 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:57.540 rtt min/avg/max/mdev = 0.359/0.359/0.359/0.000 ms 00:16:57.540 14:21:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:16:57.540 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:16:57.540 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.210 ms 00:16:57.540 00:16:57.540 --- 10.0.0.1 ping statistics --- 00:16:57.540 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:16:57.540 rtt min/avg/max/mdev = 0.210/0.210/0.210/0.000 ms 00:16:57.540 14:21:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:16:57.540 14:21:12 -- nvmf/common.sh@410 -- # return 0 00:16:57.540 14:21:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:16:57.540 14:21:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:16:57.540 14:21:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:16:57.540 14:21:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:16:57.540 14:21:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:16:57.540 14:21:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:16:57.540 14:21:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:16:57.799 14:21:12 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:16:57.799 14:21:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:16:57.799 14:21:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:16:57.799 14:21:12 -- common/autotest_common.sh@10 -- # set +x 00:16:57.799 14:21:12 -- nvmf/common.sh@469 -- # nvmfpid=370010 00:16:57.799 14:21:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:16:57.799 14:21:12 -- nvmf/common.sh@470 -- # waitforlisten 370010 00:16:57.799 14:21:12 -- common/autotest_common.sh@829 -- # '[' -z 370010 ']' 00:16:57.800 14:21:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:57.800 14:21:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:57.800 14:21:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:57.800 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:57.800 14:21:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:57.800 14:21:12 -- common/autotest_common.sh@10 -- # set +x 00:16:57.800 [2024-12-16 14:21:12.176154] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:57.800 [2024-12-16 14:21:12.176199] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:57.800 EAL: No free 2048 kB hugepages reported on node 1 00:16:57.800 [2024-12-16 14:21:12.234886] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:57.800 [2024-12-16 14:21:12.305384] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:57.800 [2024-12-16 14:21:12.305492] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:57.800 [2024-12-16 14:21:12.305499] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:57.800 [2024-12-16 14:21:12.305506] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:57.800 [2024-12-16 14:21:12.305525] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:58.736 14:21:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:58.736 14:21:12 -- common/autotest_common.sh@862 -- # return 0 00:16:58.736 14:21:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:16:58.736 14:21:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:16:58.736 14:21:12 -- common/autotest_common.sh@10 -- # set +x 00:16:58.736 14:21:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:16:58.736 14:21:13 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:16:58.736 14:21:13 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:16:58.736 14:21:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.736 14:21:13 -- common/autotest_common.sh@10 -- # set +x 00:16:58.736 [2024-12-16 14:21:13.011478] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:16:58.736 14:21:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.736 14:21:13 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:16:58.736 14:21:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.736 14:21:13 -- common/autotest_common.sh@10 -- # set +x 00:16:58.736 14:21:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.736 14:21:13 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:16:58.736 14:21:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.736 14:21:13 -- common/autotest_common.sh@10 -- # set +x 00:16:58.736 [2024-12-16 14:21:13.027649] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:16:58.736 14:21:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.736 14:21:13 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:16:58.736 14:21:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.736 14:21:13 -- common/autotest_common.sh@10 -- # set +x 00:16:58.736 14:21:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.736 14:21:13 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:16:58.736 14:21:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.736 14:21:13 -- common/autotest_common.sh@10 -- # set +x 00:16:58.736 malloc0 00:16:58.736 14:21:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.736 14:21:13 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:16:58.736 14:21:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:58.736 14:21:13 -- common/autotest_common.sh@10 -- # set +x 00:16:58.736 14:21:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:58.736 14:21:13 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:16:58.736 14:21:13 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:16:58.736 14:21:13 -- nvmf/common.sh@520 -- # config=() 00:16:58.736 14:21:13 -- nvmf/common.sh@520 -- # local subsystem config 00:16:58.736 14:21:13 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:16:58.736 14:21:13 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:16:58.736 { 00:16:58.736 "params": { 00:16:58.736 "name": "Nvme$subsystem", 00:16:58.736 "trtype": "$TEST_TRANSPORT", 00:16:58.736 "traddr": "$NVMF_FIRST_TARGET_IP", 00:16:58.736 "adrfam": "ipv4", 00:16:58.736 "trsvcid": "$NVMF_PORT", 00:16:58.736 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:16:58.736 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:16:58.736 "hdgst": ${hdgst:-false}, 00:16:58.736 "ddgst": ${ddgst:-false} 00:16:58.736 }, 00:16:58.736 "method": "bdev_nvme_attach_controller" 00:16:58.736 } 00:16:58.736 EOF 00:16:58.736 )") 00:16:58.736 14:21:13 -- nvmf/common.sh@542 -- # cat 00:16:58.736 14:21:13 -- nvmf/common.sh@544 -- # jq . 00:16:58.736 14:21:13 -- nvmf/common.sh@545 -- # IFS=, 00:16:58.736 14:21:13 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:16:58.736 "params": { 00:16:58.736 "name": "Nvme1", 00:16:58.736 "trtype": "tcp", 00:16:58.736 "traddr": "10.0.0.2", 00:16:58.736 "adrfam": "ipv4", 00:16:58.736 "trsvcid": "4420", 00:16:58.736 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:16:58.736 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:16:58.736 "hdgst": false, 00:16:58.736 "ddgst": false 00:16:58.736 }, 00:16:58.736 "method": "bdev_nvme_attach_controller" 00:16:58.736 }' 00:16:58.736 [2024-12-16 14:21:13.100722] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:58.736 [2024-12-16 14:21:13.100764] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid370251 ] 00:16:58.736 EAL: No free 2048 kB hugepages reported on node 1 00:16:58.736 [2024-12-16 14:21:13.155133] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:16:58.736 [2024-12-16 14:21:13.223938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:58.995 Running I/O for 10 seconds... 00:17:08.975 00:17:08.975 Latency(us) 00:17:08.975 [2024-12-16T13:21:23.549Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:08.975 [2024-12-16T13:21:23.549Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:17:08.975 Verification LBA range: start 0x0 length 0x1000 00:17:08.975 Nvme1n1 : 10.01 13387.79 104.59 0.00 0.00 9538.40 1209.30 16352.79 00:17:08.975 [2024-12-16T13:21:23.549Z] =================================================================================================================== 00:17:08.975 [2024-12-16T13:21:23.549Z] Total : 13387.79 104.59 0.00 0.00 9538.40 1209.30 16352.79 00:17:09.234 14:21:23 -- target/zcopy.sh@39 -- # perfpid=371910 00:17:09.234 14:21:23 -- target/zcopy.sh@41 -- # xtrace_disable 00:17:09.234 14:21:23 -- common/autotest_common.sh@10 -- # set +x 00:17:09.234 14:21:23 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:17:09.234 14:21:23 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:17:09.234 14:21:23 -- nvmf/common.sh@520 -- # config=() 00:17:09.234 [2024-12-16 14:21:23.657781] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.234 [2024-12-16 14:21:23.657818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.234 14:21:23 -- nvmf/common.sh@520 -- # local subsystem config 00:17:09.234 14:21:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:09.234 14:21:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:09.234 { 00:17:09.234 "params": { 00:17:09.234 "name": "Nvme$subsystem", 00:17:09.234 "trtype": "$TEST_TRANSPORT", 00:17:09.234 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:09.234 "adrfam": "ipv4", 00:17:09.234 "trsvcid": "$NVMF_PORT", 00:17:09.234 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:09.234 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:09.234 "hdgst": ${hdgst:-false}, 00:17:09.234 "ddgst": ${ddgst:-false} 00:17:09.234 }, 00:17:09.234 "method": "bdev_nvme_attach_controller" 00:17:09.234 } 00:17:09.234 EOF 00:17:09.234 )") 00:17:09.234 14:21:23 -- nvmf/common.sh@542 -- # cat 00:17:09.234 14:21:23 -- nvmf/common.sh@544 -- # jq . 00:17:09.234 [2024-12-16 14:21:23.665759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.234 [2024-12-16 14:21:23.665772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.234 14:21:23 -- nvmf/common.sh@545 -- # IFS=, 00:17:09.234 14:21:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:09.234 "params": { 00:17:09.234 "name": "Nvme1", 00:17:09.234 "trtype": "tcp", 00:17:09.234 "traddr": "10.0.0.2", 00:17:09.234 "adrfam": "ipv4", 00:17:09.234 "trsvcid": "4420", 00:17:09.234 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:17:09.234 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:17:09.234 "hdgst": false, 00:17:09.234 "ddgst": false 00:17:09.234 }, 00:17:09.234 "method": "bdev_nvme_attach_controller" 00:17:09.234 }' 00:17:09.234 [2024-12-16 14:21:23.673777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.234 [2024-12-16 14:21:23.673789] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.234 [2024-12-16 14:21:23.681798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.234 [2024-12-16 14:21:23.681809] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.234 [2024-12-16 14:21:23.689820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.234 [2024-12-16 14:21:23.689831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.234 [2024-12-16 14:21:23.696532] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:09.234 [2024-12-16 14:21:23.696574] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid371910 ] 00:17:09.234 [2024-12-16 14:21:23.697841] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.234 [2024-12-16 14:21:23.697852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.705867] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.705878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.713890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.713901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 EAL: No free 2048 kB hugepages reported on node 1 00:17:09.235 [2024-12-16 14:21:23.721911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.721922] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.729932] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.729942] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.737954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.737966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.745977] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.745988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.751434] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:09.235 [2024-12-16 14:21:23.753999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.754010] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.762022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.762034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.770040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.770052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.778063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.778074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.786086] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.786097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.794113] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.794141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.235 [2024-12-16 14:21:23.802144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.235 [2024-12-16 14:21:23.802156] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.810151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.810164] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.818170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.818182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.823669] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:09.494 [2024-12-16 14:21:23.826191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.826203] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.834222] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.834238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.842244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.842263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.850263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.850278] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.858283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.858297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.866303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.866316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.874321] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.874333] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.882347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.882360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.890366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.890377] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.898384] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.898395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.906407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.906417] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.914445] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.914465] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.922461] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.922476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.494 [2024-12-16 14:21:23.930481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.494 [2024-12-16 14:21:23.930494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:23.938501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:23.938514] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:23.946516] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:23.946526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:23.954536] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:23.954546] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:23.962559] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:23.962569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:23.970580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:23.970589] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:23.978606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:23.978620] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:23.986632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:23.986647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:23.994650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:23.994660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.002670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.002680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.010690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.010700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.018715] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.018724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.026736] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.026745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.034760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.034774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.042782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.042792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.050802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.050812] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.058825] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.058835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.495 [2024-12-16 14:21:24.066847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.495 [2024-12-16 14:21:24.066861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.074877] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.074892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.082896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.082906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.090913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.090923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.098934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.098944] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.106955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.106965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.114984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.114994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.123001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.123011] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.131030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.131050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.139047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.139070] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 Running I/O for 5 seconds... 00:17:09.754 [2024-12-16 14:21:24.147065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.147075] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.158102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.158123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.167503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.167523] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.176493] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.176512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.754 [2024-12-16 14:21:24.185367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.754 [2024-12-16 14:21:24.185387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.194180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.194200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.203212] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.203231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.211649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.211668] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.220442] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.220460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.229637] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.229655] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.238737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.238755] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.247890] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.247908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.256300] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.256322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.264968] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.264987] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.273210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.273228] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.282602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.282621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.291145] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.291163] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.299905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.299924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.308911] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.308930] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.318213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.318231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:09.755 [2024-12-16 14:21:24.327001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:09.755 [2024-12-16 14:21:24.327020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.336108] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.336136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.345258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.345277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.353707] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.353726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.363008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.363027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.372127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.372145] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.380920] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.380941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.390155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.390175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.399069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.399089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.408271] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.408291] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.417593] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.417612] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.426569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.426591] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.435402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.435421] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.443620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.443639] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.452314] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.452332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.461050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.461068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.470161] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.470179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.479350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.479369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.488737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.488756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.496846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.496872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.506049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.506067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.514961] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.514981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.524217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.524235] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.533424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.533442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.542652] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.542671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.551360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.551380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.560159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.560179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.014 [2024-12-16 14:21:24.568863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.014 [2024-12-16 14:21:24.568881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.015 [2024-12-16 14:21:24.577835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.015 [2024-12-16 14:21:24.577861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.015 [2024-12-16 14:21:24.586733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.015 [2024-12-16 14:21:24.586752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.595916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.595940] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.604898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.604916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.613633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.613652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.622481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.622499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.631826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.631844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.640595] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.640613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.649301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.649320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.657952] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.657970] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.667233] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.667252] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.675978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.675996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.685448] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.685468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.694457] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.694476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.703388] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.703407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.712284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.712302] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.721513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.721532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.730432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.730450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.739147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.739165] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.748319] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.748338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.756606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.756625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.765582] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.765604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.774537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.774555] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.783481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.783505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.792275] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.792293] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.801385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.801403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.809377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.809395] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.818835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.818861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.827065] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.827084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.836310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.836331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.274 [2024-12-16 14:21:24.844561] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.274 [2024-12-16 14:21:24.844579] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.853513] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.853532] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.862886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.862905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.871790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.871808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.880535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.880554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.889748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.889767] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.898399] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.898418] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.907765] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.907784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.916675] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.916695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.925979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.925998] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.935330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.935350] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.944090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.944110] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.952747] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.952766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.961362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.961380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.969948] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.969967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.978615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.978635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.987824] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.987843] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:24.997160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:24.997178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.005957] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.005975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.014211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.014230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.022718] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.022737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.031420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.031439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.040252] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.040272] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.049066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.049084] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.057633] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.057651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.066705] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.066723] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.074813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.074832] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.084002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.084020] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.092306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.092325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.533 [2024-12-16 14:21:25.101737] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.533 [2024-12-16 14:21:25.101757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.791 [2024-12-16 14:21:25.110634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.791 [2024-12-16 14:21:25.110654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.791 [2024-12-16 14:21:25.119851] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.791 [2024-12-16 14:21:25.119877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.791 [2024-12-16 14:21:25.128465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.791 [2024-12-16 14:21:25.128484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.791 [2024-12-16 14:21:25.137209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.791 [2024-12-16 14:21:25.137229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.791 [2024-12-16 14:21:25.145881] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.791 [2024-12-16 14:21:25.145900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.791 [2024-12-16 14:21:25.154569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.791 [2024-12-16 14:21:25.154588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.791 [2024-12-16 14:21:25.163659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.791 [2024-12-16 14:21:25.163677] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.172407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.172426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.181197] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.181217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.189912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.189931] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.198685] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.198705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.207232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.207251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.216003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.216022] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.224719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.224739] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.233337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.233356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.241988] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.242007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.251205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.251223] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.259958] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.259978] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.268744] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.268763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.277626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.277645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.286733] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.286752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.295466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.295485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.304942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.304962] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.313424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.313442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.322408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.322426] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.330760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.330779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.340001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.340021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.348967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.348986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:10.792 [2024-12-16 14:21:25.357082] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:10.792 [2024-12-16 14:21:25.357101] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.365339] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.365359] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.374149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.374168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.383217] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.383236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.392531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.392549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.401588] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.401607] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.410358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.410375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.419169] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.419188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.427860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.427887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.436786] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.436805] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.445671] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.445690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.455285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.455304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.464731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.464751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.473728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.473747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.482512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.482531] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.491849] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.491875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.500496] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.500516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.509377] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.509397] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.518569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.518588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.527740] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.527759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.536638] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.536656] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.545390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.545409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.554214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.554233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.562916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.562934] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.571689] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.571708] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.580900] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.580920] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.590312] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.590331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.599673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.599696] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.608515] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.608534] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.052 [2024-12-16 14:21:25.617304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.052 [2024-12-16 14:21:25.617323] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.626232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.626251] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.635016] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.635034] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.643814] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.643833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.652477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.652495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.661110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.661128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.669172] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.669191] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.677891] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.677910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.687070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.687088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.696547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.696566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.705711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.705729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.714466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.714484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.723166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.723185] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.731939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.731958] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.740632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.740650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.749149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.749167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.757664] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.757684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.766390] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.766412] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.775011] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.775030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.783919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.783937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.792816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.792835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.801615] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.801634] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.810936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.810955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.819833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.819852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.829106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.829124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.837882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.837900] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.847246] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.847267] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.856613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.856633] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.865354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.865373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.873682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.873701] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.312 [2024-12-16 14:21:25.882990] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.312 [2024-12-16 14:21:25.883009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.571 [2024-12-16 14:21:25.891876] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.571 [2024-12-16 14:21:25.891896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.571 [2024-12-16 14:21:25.900063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.571 [2024-12-16 14:21:25.900082] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.571 [2024-12-16 14:21:25.908608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.571 [2024-12-16 14:21:25.908627] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.571 [2024-12-16 14:21:25.917613] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.571 [2024-12-16 14:21:25.917632] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.926888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.926907] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.935292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.935315] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.943897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.943916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.952846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.952873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.961704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.961724] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.969931] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.969950] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.978696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.978715] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.987819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.987837] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:25.997177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:25.997196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.005521] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.005541] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.014075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.014094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.022676] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.022695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.031986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.032005] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.040734] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.040752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.049420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.049439] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.058603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.058621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.067474] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.067494] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.076228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.076246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.085043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.085062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.094175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.094194] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.102979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.103001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.111799] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.111818] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.121069] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.121089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.129954] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.129974] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.572 [2024-12-16 14:21:26.138899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.572 [2024-12-16 14:21:26.138918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.147415] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.147434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.156156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.156173] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.164265] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.164283] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.172807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.172826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.181991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.182009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.190822] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.190840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.199325] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.199342] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.208808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.208827] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.217550] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.217569] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.226466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.226485] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.235198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.235217] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.244478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.244497] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.253812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.253831] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.262373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.262391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.271502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.271521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.279616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.279635] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.288772] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.288790] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.297603] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.297622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.306658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.306678] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.315353] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.315374] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.323864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.323883] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.332136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.332157] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.340788] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.340806] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.348986] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.349006] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.358237] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.358256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.366978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.366996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.375887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.375906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.384546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.384566] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.393726] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.393745] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:11.831 [2024-12-16 14:21:26.402984] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:11.831 [2024-12-16 14:21:26.403004] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.089 [2024-12-16 14:21:26.411739] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.411759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.420470] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.420490] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.429148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.429167] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.437934] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.437955] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.447040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.447059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.455753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.455772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.465127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.465147] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.474093] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.474118] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.482897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.482916] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.491710] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.491729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.500354] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.500373] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.508502] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.508521] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.517767] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.517787] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.525882] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.525901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.534393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.534411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.543068] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.543088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.551576] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.551595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.559775] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.559794] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.567945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.567964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.577003] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.577021] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.585887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.585906] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.594870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.594888] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.603463] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.603486] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.612745] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.612764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.622412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.622431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.630748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.630768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.639567] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.639587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.648820] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.648841] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.090 [2024-12-16 14:21:26.657978] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.090 [2024-12-16 14:21:26.657997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.667402] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.667422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.676807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.676826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.685039] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.685059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.693842] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.693870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.703211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.703230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.712106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.712124] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.720973] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.720992] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.729535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.729553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.738303] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.738321] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.746896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.746915] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.755711] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.755729] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.764467] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.764489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.772700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.772719] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.781848] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.781875] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.790780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.790799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.799330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.799348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.808307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.808325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.817007] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.817026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.825594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.349 [2024-12-16 14:21:26.825613] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.349 [2024-12-16 14:21:26.834322] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.834341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.843907] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.843925] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.852684] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.852703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.861511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.861530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.870947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.870966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.880150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.880169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.888896] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.888917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.897151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.897170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.905817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.905836] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.350 [2024-12-16 14:21:26.914577] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.350 [2024-12-16 14:21:26.914595] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.923371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.923391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.931965] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.931988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.940071] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.940089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.948738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.948757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.957418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.957438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.966228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.966247] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.975569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.975588] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.983821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.983840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:26.992960] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:26.992979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.002055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.002074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.010766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.010785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.019546] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.019565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.028395] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.028414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.037699] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.037718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.046606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.046626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.055304] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.055322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.064070] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.064089] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.073262] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.073280] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.081337] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.081356] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.089998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.090016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.098670] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.098693] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.107274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.107292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.116531] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.116550] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.125439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.125458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.609 [2024-12-16 14:21:27.134041] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.609 [2024-12-16 14:21:27.134060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.610 [2024-12-16 14:21:27.142944] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.610 [2024-12-16 14:21:27.142964] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.610 [2024-12-16 14:21:27.151844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.610 [2024-12-16 14:21:27.151870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.610 [2024-12-16 14:21:27.160766] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.610 [2024-12-16 14:21:27.160785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.610 [2024-12-16 14:21:27.169481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.610 [2024-12-16 14:21:27.169499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.610 [2024-12-16 14:21:27.178545] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.610 [2024-12-16 14:21:27.178564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.187441] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.187460] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.196196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.196214] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.204894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.204912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.213122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.213141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.221919] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.221938] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.231410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.231429] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.240492] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.240511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.249500] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.249519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.258190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.258208] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.266776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.266799] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.275371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.275394] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.284084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.284102] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.292878] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.292896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.302101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.302120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.310790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.310808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.320090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.320108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.329207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.329225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.337598] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.337618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.346284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.346303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.355719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.355738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.364938] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.364956] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.373062] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.373081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.382412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.382431] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.391465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.391484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.400293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.400311] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.409102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.409120] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.417362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.417381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.426328] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.426347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:12.869 [2024-12-16 14:21:27.435228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:12.869 [2024-12-16 14:21:27.435249] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.444266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.444285] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.453106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.453125] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.462360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.462378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.470606] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.470624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.479187] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.479205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.485863] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.485881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.496285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.496305] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.504544] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.504562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.513194] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.513212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.522043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.522062] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.530306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.530325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.539042] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.539060] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.547947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.547965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.557160] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.557179] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.565976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.565994] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.574991] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.129 [2024-12-16 14:21:27.575009] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.129 [2024-12-16 14:21:27.583188] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.583207] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.591971] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.591990] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.601150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.601169] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.610159] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.610177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.619111] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.619129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.627847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.627873] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.637046] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.637064] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.645357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.645375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.654267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.654286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.663642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.663661] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.672362] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.672382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.681274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.681294] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.690503] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.690525] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.130 [2024-12-16 14:21:27.699557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.130 [2024-12-16 14:21:27.699578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.708495] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.708515] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.717617] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.717638] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.726054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.726074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.735257] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.735276] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.744087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.744106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.752899] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.752918] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.762236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.762256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.771072] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.771090] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.779557] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.779575] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.788783] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.788802] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.797236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.797256] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.806267] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.806286] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.814997] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.815016] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.823826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.823844] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.830401] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.830420] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.840760] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.840779] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.849195] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.849215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.858032] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.858051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.867227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.867246] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.875533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.875552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.884749] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.884768] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.893031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.893051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.901752] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.901771] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.910498] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.910518] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.919132] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.919151] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.927949] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.927969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.936835] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.936862] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.389 [2024-12-16 14:21:27.945410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.389 [2024-12-16 14:21:27.945428] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.390 [2024-12-16 14:21:27.953905] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.390 [2024-12-16 14:21:27.953923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.390 [2024-12-16 14:21:27.962221] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.390 [2024-12-16 14:21:27.962241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:27.970807] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:27.970826] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:27.980196] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:27.980215] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:27.988548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:27.988568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:27.997216] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:27.997236] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.006542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.006562] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.015469] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.015489] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.028721] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.028741] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.037078] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.037097] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.045429] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.045448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.054067] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.054086] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.062702] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.062721] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.071374] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.071392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.079887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.079905] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.088565] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.088584] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.097182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.097205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.105839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.105865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.114306] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.114324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.123240] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.123258] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.131430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.131448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.140700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.140718] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.149947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.149981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.158751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.158770] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.168075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.168093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.177430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.177448] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.186293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.186312] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.195023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.195042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.203639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.203657] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.212181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.212200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.649 [2024-12-16 14:21:28.221164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.649 [2024-12-16 14:21:28.221183] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.229976] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.229996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.239018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.239037] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.248320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.248339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.256642] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.256660] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.265605] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.265628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.274366] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.274385] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.283104] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.283123] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.291947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.291965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.301269] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.301289] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.309420] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.309438] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.318833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.318852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.327584] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.908 [2024-12-16 14:21:28.327602] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.908 [2024-12-16 14:21:28.335753] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.335772] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.344431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.344449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.353191] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.353209] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.361817] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.361835] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.370719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.370738] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.379341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.379360] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.388482] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.388501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.397407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.397425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.406641] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.406659] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.415533] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.415552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.424207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.424225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.433488] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.433509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.442423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.442441] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.451610] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.451628] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.460894] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.460912] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.469748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.469766] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:13.909 [2024-12-16 14:21:28.478569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:13.909 [2024-12-16 14:21:28.478587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.487373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.487392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.495989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.496007] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.504790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.504808] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.513746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.513765] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.522372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.522390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.531043] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.531061] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.540434] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.540452] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.549148] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.549166] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.557868] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.557887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.566611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.566629] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.575320] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.575338] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.584683] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.584702] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.593494] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.593513] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.602055] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.602078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.611170] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.611188] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.619361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.619379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.627941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.627959] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.637151] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.637170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.646511] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.646530] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.655179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.655198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.664350] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.664369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.673631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.673650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.682751] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.682769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.691037] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.691055] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.699648] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.699666] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.708631] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.708653] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.717947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.717965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.726837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.726861] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.168 [2024-12-16 14:21:28.736056] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.168 [2024-12-16 14:21:28.736074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.427 [2024-12-16 14:21:28.744912] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.744932] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.753466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.753484] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.762211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.762230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.771089] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.771112] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.780480] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.780498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.789668] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.789689] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.797774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.797792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.806962] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.806981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.816134] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.816153] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.825532] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.825553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.834491] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.834511] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.842804] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.842823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.851439] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.851458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.860728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.860747] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.869009] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.869027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.877669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.877687] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.886142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.886160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.895357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.895375] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.904023] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.904042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.913431] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.913450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.922281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.922300] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.930979] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.930999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.939632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.939651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.948276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.948296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.957483] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.957501] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.966777] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.966796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.975510] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.975528] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.983774] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.983792] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.428 [2024-12-16 14:21:28.992759] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.428 [2024-12-16 14:21:28.992778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.001654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.001674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.010871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.010890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.019263] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.019281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.028273] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.028292] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.037090] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.037108] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.045735] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.045754] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.055060] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.055078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.064031] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.064050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.073008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.073027] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.081818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.081838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.090846] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.090872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.099371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.099390] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.108243] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.108263] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.117179] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.117198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.126177] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.126196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.134936] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.134954] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.143506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.143526] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.687 [2024-12-16 14:21:29.152798] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.687 [2024-12-16 14:21:29.152817] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.159021] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.159039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 00:17:14.688 Latency(us) 00:17:14.688 [2024-12-16T13:21:29.262Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:14.688 [2024-12-16T13:21:29.262Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:17:14.688 Nvme1n1 : 5.01 17926.00 140.05 0.00 0.00 7134.53 3042.74 15603.81 00:17:14.688 [2024-12-16T13:21:29.262Z] =================================================================================================================== 00:17:14.688 [2024-12-16T13:21:29.262Z] Total : 17926.00 140.05 0.00 0.00 7134.53 3042.74 15603.81 00:17:14.688 [2024-12-16 14:21:29.167036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.167051] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.175054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.175068] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.183075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.183087] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.191109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.191127] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.199121] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.199134] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.207142] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.207155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.215165] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.215178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.223182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.223196] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.231205] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.231220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.239227] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.239241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.247255] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.247273] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.688 [2024-12-16 14:21:29.255270] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.688 [2024-12-16 14:21:29.255281] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.263292] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.263304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.271310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.271320] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.279332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.279343] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.287351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.287362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.295379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.295391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.303398] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.303413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.311416] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.311427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.319437] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.319447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.327458] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.327468] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.335481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.335493] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.343506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.343519] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.351522] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.351533] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 [2024-12-16 14:21:29.359542] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:17:14.947 [2024-12-16 14:21:29.359552] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:14.947 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (371910) - No such process 00:17:14.947 14:21:29 -- target/zcopy.sh@49 -- # wait 371910 00:17:14.947 14:21:29 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:17:14.947 14:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:14.947 14:21:29 -- common/autotest_common.sh@10 -- # set +x 00:17:14.947 14:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:14.947 14:21:29 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:17:14.947 14:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:14.947 14:21:29 -- common/autotest_common.sh@10 -- # set +x 00:17:14.947 delay0 00:17:14.947 14:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:14.947 14:21:29 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:17:14.947 14:21:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:14.947 14:21:29 -- common/autotest_common.sh@10 -- # set +x 00:17:14.947 14:21:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:14.948 14:21:29 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:17:14.948 EAL: No free 2048 kB hugepages reported on node 1 00:17:14.948 [2024-12-16 14:21:29.483993] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:17:21.513 Initializing NVMe Controllers 00:17:21.513 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:17:21.513 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:17:21.513 Initialization complete. Launching workers. 00:17:21.513 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 851 00:17:21.513 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 1129, failed to submit 42 00:17:21.513 success 953, unsuccess 176, failed 0 00:17:21.513 14:21:35 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:17:21.513 14:21:35 -- target/zcopy.sh@60 -- # nvmftestfini 00:17:21.513 14:21:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:21.513 14:21:35 -- nvmf/common.sh@116 -- # sync 00:17:21.513 14:21:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:21.513 14:21:35 -- nvmf/common.sh@119 -- # set +e 00:17:21.513 14:21:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:21.513 14:21:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:21.513 rmmod nvme_tcp 00:17:21.513 rmmod nvme_fabrics 00:17:21.513 rmmod nvme_keyring 00:17:21.513 14:21:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:21.513 14:21:35 -- nvmf/common.sh@123 -- # set -e 00:17:21.513 14:21:35 -- nvmf/common.sh@124 -- # return 0 00:17:21.513 14:21:35 -- nvmf/common.sh@477 -- # '[' -n 370010 ']' 00:17:21.513 14:21:35 -- nvmf/common.sh@478 -- # killprocess 370010 00:17:21.513 14:21:35 -- common/autotest_common.sh@936 -- # '[' -z 370010 ']' 00:17:21.513 14:21:35 -- common/autotest_common.sh@940 -- # kill -0 370010 00:17:21.513 14:21:35 -- common/autotest_common.sh@941 -- # uname 00:17:21.513 14:21:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:21.513 14:21:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 370010 00:17:21.513 14:21:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:21.513 14:21:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:21.513 14:21:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 370010' 00:17:21.513 killing process with pid 370010 00:17:21.513 14:21:35 -- common/autotest_common.sh@955 -- # kill 370010 00:17:21.513 14:21:35 -- common/autotest_common.sh@960 -- # wait 370010 00:17:21.513 14:21:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:21.513 14:21:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:21.513 14:21:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:21.513 14:21:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:21.513 14:21:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:21.513 14:21:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:21.513 14:21:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:21.513 14:21:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:23.543 14:21:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:23.543 00:17:23.543 real 0m31.576s 00:17:23.543 user 0m42.402s 00:17:23.543 sys 0m10.500s 00:17:23.543 14:21:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:23.543 14:21:37 -- common/autotest_common.sh@10 -- # set +x 00:17:23.543 ************************************ 00:17:23.543 END TEST nvmf_zcopy 00:17:23.543 ************************************ 00:17:23.543 14:21:38 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:17:23.543 14:21:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:23.543 14:21:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:23.543 14:21:38 -- common/autotest_common.sh@10 -- # set +x 00:17:23.543 ************************************ 00:17:23.543 START TEST nvmf_nmic 00:17:23.543 ************************************ 00:17:23.543 14:21:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:17:23.802 * Looking for test storage... 00:17:23.802 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:23.802 14:21:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:23.802 14:21:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:23.802 14:21:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:23.802 14:21:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:23.802 14:21:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:23.802 14:21:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:23.802 14:21:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:23.802 14:21:38 -- scripts/common.sh@335 -- # IFS=.-: 00:17:23.802 14:21:38 -- scripts/common.sh@335 -- # read -ra ver1 00:17:23.802 14:21:38 -- scripts/common.sh@336 -- # IFS=.-: 00:17:23.802 14:21:38 -- scripts/common.sh@336 -- # read -ra ver2 00:17:23.802 14:21:38 -- scripts/common.sh@337 -- # local 'op=<' 00:17:23.802 14:21:38 -- scripts/common.sh@339 -- # ver1_l=2 00:17:23.802 14:21:38 -- scripts/common.sh@340 -- # ver2_l=1 00:17:23.802 14:21:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:23.802 14:21:38 -- scripts/common.sh@343 -- # case "$op" in 00:17:23.802 14:21:38 -- scripts/common.sh@344 -- # : 1 00:17:23.802 14:21:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:23.802 14:21:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:23.802 14:21:38 -- scripts/common.sh@364 -- # decimal 1 00:17:23.802 14:21:38 -- scripts/common.sh@352 -- # local d=1 00:17:23.802 14:21:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:23.802 14:21:38 -- scripts/common.sh@354 -- # echo 1 00:17:23.802 14:21:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:23.802 14:21:38 -- scripts/common.sh@365 -- # decimal 2 00:17:23.802 14:21:38 -- scripts/common.sh@352 -- # local d=2 00:17:23.802 14:21:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:23.802 14:21:38 -- scripts/common.sh@354 -- # echo 2 00:17:23.802 14:21:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:23.802 14:21:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:23.802 14:21:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:23.802 14:21:38 -- scripts/common.sh@367 -- # return 0 00:17:23.802 14:21:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:23.802 14:21:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:23.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:23.802 --rc genhtml_branch_coverage=1 00:17:23.802 --rc genhtml_function_coverage=1 00:17:23.802 --rc genhtml_legend=1 00:17:23.802 --rc geninfo_all_blocks=1 00:17:23.802 --rc geninfo_unexecuted_blocks=1 00:17:23.802 00:17:23.802 ' 00:17:23.802 14:21:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:23.802 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:23.802 --rc genhtml_branch_coverage=1 00:17:23.802 --rc genhtml_function_coverage=1 00:17:23.802 --rc genhtml_legend=1 00:17:23.802 --rc geninfo_all_blocks=1 00:17:23.802 --rc geninfo_unexecuted_blocks=1 00:17:23.802 00:17:23.802 ' 00:17:23.802 14:21:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:23.803 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:23.803 --rc genhtml_branch_coverage=1 00:17:23.803 --rc genhtml_function_coverage=1 00:17:23.803 --rc genhtml_legend=1 00:17:23.803 --rc geninfo_all_blocks=1 00:17:23.803 --rc geninfo_unexecuted_blocks=1 00:17:23.803 00:17:23.803 ' 00:17:23.803 14:21:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:23.803 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:23.803 --rc genhtml_branch_coverage=1 00:17:23.803 --rc genhtml_function_coverage=1 00:17:23.803 --rc genhtml_legend=1 00:17:23.803 --rc geninfo_all_blocks=1 00:17:23.803 --rc geninfo_unexecuted_blocks=1 00:17:23.803 00:17:23.803 ' 00:17:23.803 14:21:38 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:23.803 14:21:38 -- nvmf/common.sh@7 -- # uname -s 00:17:23.803 14:21:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:23.803 14:21:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:23.803 14:21:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:23.803 14:21:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:23.803 14:21:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:23.803 14:21:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:23.803 14:21:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:23.803 14:21:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:23.803 14:21:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:23.803 14:21:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:23.803 14:21:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:17:23.803 14:21:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:17:23.803 14:21:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:23.803 14:21:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:23.803 14:21:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:23.803 14:21:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:23.803 14:21:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:23.803 14:21:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:23.803 14:21:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:23.803 14:21:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:23.803 14:21:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:23.803 14:21:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:23.803 14:21:38 -- paths/export.sh@5 -- # export PATH 00:17:23.803 14:21:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:23.803 14:21:38 -- nvmf/common.sh@46 -- # : 0 00:17:23.803 14:21:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:23.803 14:21:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:23.803 14:21:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:23.803 14:21:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:23.803 14:21:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:23.803 14:21:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:23.803 14:21:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:23.803 14:21:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:23.803 14:21:38 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:23.803 14:21:38 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:23.803 14:21:38 -- target/nmic.sh@14 -- # nvmftestinit 00:17:23.803 14:21:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:23.803 14:21:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:23.803 14:21:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:23.803 14:21:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:23.803 14:21:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:23.803 14:21:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:23.803 14:21:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:23.803 14:21:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:23.803 14:21:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:23.803 14:21:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:23.803 14:21:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:23.803 14:21:38 -- common/autotest_common.sh@10 -- # set +x 00:17:29.076 14:21:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:29.076 14:21:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:29.076 14:21:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:29.076 14:21:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:29.076 14:21:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:29.076 14:21:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:29.076 14:21:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:29.076 14:21:43 -- nvmf/common.sh@294 -- # net_devs=() 00:17:29.076 14:21:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:29.076 14:21:43 -- nvmf/common.sh@295 -- # e810=() 00:17:29.076 14:21:43 -- nvmf/common.sh@295 -- # local -ga e810 00:17:29.076 14:21:43 -- nvmf/common.sh@296 -- # x722=() 00:17:29.076 14:21:43 -- nvmf/common.sh@296 -- # local -ga x722 00:17:29.076 14:21:43 -- nvmf/common.sh@297 -- # mlx=() 00:17:29.076 14:21:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:29.076 14:21:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:29.076 14:21:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:29.076 14:21:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:29.076 14:21:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:29.076 14:21:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:29.076 14:21:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:17:29.076 Found 0000:af:00.0 (0x8086 - 0x159b) 00:17:29.076 14:21:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:29.076 14:21:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:17:29.076 Found 0000:af:00.1 (0x8086 - 0x159b) 00:17:29.076 14:21:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:29.076 14:21:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:29.076 14:21:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:29.076 14:21:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:29.076 14:21:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:29.076 14:21:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:17:29.076 Found net devices under 0000:af:00.0: cvl_0_0 00:17:29.076 14:21:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:29.076 14:21:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:29.076 14:21:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:29.076 14:21:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:29.076 14:21:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:29.076 14:21:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:17:29.076 Found net devices under 0000:af:00.1: cvl_0_1 00:17:29.076 14:21:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:29.076 14:21:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:29.076 14:21:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:29.076 14:21:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:29.076 14:21:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:29.076 14:21:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:29.076 14:21:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:29.076 14:21:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:29.076 14:21:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:29.076 14:21:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:29.076 14:21:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:29.077 14:21:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:29.077 14:21:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:29.077 14:21:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:29.077 14:21:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:29.077 14:21:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:29.077 14:21:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:29.077 14:21:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:29.077 14:21:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:29.077 14:21:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:29.077 14:21:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:29.077 14:21:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:29.335 14:21:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:29.335 14:21:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:29.335 14:21:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:29.335 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:29.335 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.376 ms 00:17:29.335 00:17:29.335 --- 10.0.0.2 ping statistics --- 00:17:29.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:29.336 rtt min/avg/max/mdev = 0.376/0.376/0.376/0.000 ms 00:17:29.336 14:21:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:29.336 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:29.336 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.224 ms 00:17:29.336 00:17:29.336 --- 10.0.0.1 ping statistics --- 00:17:29.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:29.336 rtt min/avg/max/mdev = 0.224/0.224/0.224/0.000 ms 00:17:29.336 14:21:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:29.336 14:21:43 -- nvmf/common.sh@410 -- # return 0 00:17:29.336 14:21:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:29.336 14:21:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:29.336 14:21:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:29.336 14:21:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:29.336 14:21:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:29.336 14:21:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:29.336 14:21:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:29.336 14:21:43 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:17:29.336 14:21:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:29.336 14:21:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:29.336 14:21:43 -- common/autotest_common.sh@10 -- # set +x 00:17:29.336 14:21:43 -- nvmf/common.sh@469 -- # nvmfpid=377369 00:17:29.336 14:21:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:29.336 14:21:43 -- nvmf/common.sh@470 -- # waitforlisten 377369 00:17:29.336 14:21:43 -- common/autotest_common.sh@829 -- # '[' -z 377369 ']' 00:17:29.336 14:21:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:29.336 14:21:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:29.336 14:21:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:29.336 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:29.336 14:21:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:29.336 14:21:43 -- common/autotest_common.sh@10 -- # set +x 00:17:29.336 [2024-12-16 14:21:43.787120] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:29.336 [2024-12-16 14:21:43.787163] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:29.336 EAL: No free 2048 kB hugepages reported on node 1 00:17:29.336 [2024-12-16 14:21:43.846198] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:29.594 [2024-12-16 14:21:43.924678] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:29.594 [2024-12-16 14:21:43.924783] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:29.595 [2024-12-16 14:21:43.924792] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:29.595 [2024-12-16 14:21:43.924798] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:29.595 [2024-12-16 14:21:43.924836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:29.595 [2024-12-16 14:21:43.924937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:29.595 [2024-12-16 14:21:43.924961] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:29.595 [2024-12-16 14:21:43.924963] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:30.163 14:21:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:30.163 14:21:44 -- common/autotest_common.sh@862 -- # return 0 00:17:30.163 14:21:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:30.163 14:21:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:30.163 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.163 14:21:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:30.163 14:21:44 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:30.163 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.163 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.163 [2024-12-16 14:21:44.662212] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:30.163 14:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.163 14:21:44 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:17:30.163 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.163 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.163 Malloc0 00:17:30.163 14:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.163 14:21:44 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:17:30.163 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.163 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.163 14:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.163 14:21:44 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:30.163 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.163 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.163 14:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.163 14:21:44 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:30.163 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.163 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.163 [2024-12-16 14:21:44.717830] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:30.163 14:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.163 14:21:44 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:17:30.163 test case1: single bdev can't be used in multiple subsystems 00:17:30.163 14:21:44 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:17:30.163 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.163 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.163 14:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.163 14:21:44 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:17:30.163 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.163 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.422 14:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.422 14:21:44 -- target/nmic.sh@28 -- # nmic_status=0 00:17:30.422 14:21:44 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:17:30.423 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.423 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.423 [2024-12-16 14:21:44.741721] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:17:30.423 [2024-12-16 14:21:44.741741] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:17:30.423 [2024-12-16 14:21:44.741748] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:17:30.423 request: 00:17:30.423 { 00:17:30.423 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:17:30.423 "namespace": { 00:17:30.423 "bdev_name": "Malloc0" 00:17:30.423 }, 00:17:30.423 "method": "nvmf_subsystem_add_ns", 00:17:30.423 "req_id": 1 00:17:30.423 } 00:17:30.423 Got JSON-RPC error response 00:17:30.423 response: 00:17:30.423 { 00:17:30.423 "code": -32602, 00:17:30.423 "message": "Invalid parameters" 00:17:30.423 } 00:17:30.423 14:21:44 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:17:30.423 14:21:44 -- target/nmic.sh@29 -- # nmic_status=1 00:17:30.423 14:21:44 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:17:30.423 14:21:44 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:17:30.423 Adding namespace failed - expected result. 00:17:30.423 14:21:44 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:17:30.423 test case2: host connect to nvmf target in multiple paths 00:17:30.423 14:21:44 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:17:30.423 14:21:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:30.423 14:21:44 -- common/autotest_common.sh@10 -- # set +x 00:17:30.423 [2024-12-16 14:21:44.753862] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:17:30.423 14:21:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:30.423 14:21:44 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:17:31.803 14:21:45 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:17:32.740 14:21:47 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:17:32.740 14:21:47 -- common/autotest_common.sh@1187 -- # local i=0 00:17:32.740 14:21:47 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:17:32.740 14:21:47 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:17:32.740 14:21:47 -- common/autotest_common.sh@1194 -- # sleep 2 00:17:34.645 14:21:49 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:17:34.645 14:21:49 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:17:34.645 14:21:49 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:17:34.645 14:21:49 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:17:34.645 14:21:49 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:17:34.645 14:21:49 -- common/autotest_common.sh@1197 -- # return 0 00:17:34.645 14:21:49 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:17:34.645 [global] 00:17:34.645 thread=1 00:17:34.645 invalidate=1 00:17:34.645 rw=write 00:17:34.645 time_based=1 00:17:34.645 runtime=1 00:17:34.645 ioengine=libaio 00:17:34.645 direct=1 00:17:34.645 bs=4096 00:17:34.645 iodepth=1 00:17:34.645 norandommap=0 00:17:34.645 numjobs=1 00:17:34.645 00:17:34.645 verify_dump=1 00:17:34.645 verify_backlog=512 00:17:34.645 verify_state_save=0 00:17:34.645 do_verify=1 00:17:34.645 verify=crc32c-intel 00:17:34.645 [job0] 00:17:34.645 filename=/dev/nvme0n1 00:17:34.645 Could not set queue depth (nvme0n1) 00:17:34.904 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:34.904 fio-3.35 00:17:34.904 Starting 1 thread 00:17:36.282 00:17:36.282 job0: (groupid=0, jobs=1): err= 0: pid=378436: Mon Dec 16 14:21:50 2024 00:17:36.282 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:17:36.282 slat (nsec): min=6910, max=36509, avg=7977.44, stdev=1799.14 00:17:36.282 clat (usec): min=196, max=41981, avg=462.18, stdev=2992.14 00:17:36.282 lat (usec): min=205, max=42003, avg=470.16, stdev=2993.06 00:17:36.282 clat percentiles (usec): 00:17:36.282 | 1.00th=[ 215], 5.00th=[ 227], 10.00th=[ 231], 20.00th=[ 233], 00:17:36.282 | 30.00th=[ 235], 40.00th=[ 237], 50.00th=[ 241], 60.00th=[ 243], 00:17:36.282 | 70.00th=[ 247], 80.00th=[ 253], 90.00th=[ 273], 95.00th=[ 277], 00:17:36.282 | 99.00th=[ 293], 99.50th=[40633], 99.90th=[42206], 99.95th=[42206], 00:17:36.282 | 99.99th=[42206] 00:17:36.282 write: IOPS=1595, BW=6382KiB/s (6535kB/s)(6388KiB/1001msec); 0 zone resets 00:17:36.283 slat (nsec): min=9264, max=40499, avg=10786.15, stdev=1688.87 00:17:36.283 clat (usec): min=117, max=479, avg=157.61, stdev=21.79 00:17:36.283 lat (usec): min=127, max=491, avg=168.40, stdev=22.04 00:17:36.283 clat percentiles (usec): 00:17:36.283 | 1.00th=[ 122], 5.00th=[ 141], 10.00th=[ 145], 20.00th=[ 147], 00:17:36.283 | 30.00th=[ 149], 40.00th=[ 151], 50.00th=[ 153], 60.00th=[ 155], 00:17:36.283 | 70.00th=[ 157], 80.00th=[ 161], 90.00th=[ 192], 95.00th=[ 200], 00:17:36.283 | 99.00th=[ 233], 99.50th=[ 253], 99.90th=[ 334], 99.95th=[ 478], 00:17:36.283 | 99.99th=[ 478] 00:17:36.283 bw ( KiB/s): min= 4096, max= 4096, per=64.18%, avg=4096.00, stdev= 0.00, samples=1 00:17:36.283 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:36.283 lat (usec) : 250=87.97%, 500=11.75% 00:17:36.283 lat (msec) : 4=0.03%, 50=0.26% 00:17:36.283 cpu : usr=2.20%, sys=4.70%, ctx=3133, majf=0, minf=1 00:17:36.283 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:36.283 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:36.283 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:36.283 issued rwts: total=1536,1597,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:36.283 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:36.283 00:17:36.283 Run status group 0 (all jobs): 00:17:36.283 READ: bw=6138KiB/s (6285kB/s), 6138KiB/s-6138KiB/s (6285kB/s-6285kB/s), io=6144KiB (6291kB), run=1001-1001msec 00:17:36.283 WRITE: bw=6382KiB/s (6535kB/s), 6382KiB/s-6382KiB/s (6535kB/s-6535kB/s), io=6388KiB (6541kB), run=1001-1001msec 00:17:36.283 00:17:36.283 Disk stats (read/write): 00:17:36.283 nvme0n1: ios=1232/1536, merge=0/0, ticks=637/242, in_queue=879, util=91.28% 00:17:36.283 14:21:50 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:17:36.283 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:17:36.283 14:21:50 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:17:36.283 14:21:50 -- common/autotest_common.sh@1208 -- # local i=0 00:17:36.283 14:21:50 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:17:36.283 14:21:50 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:36.283 14:21:50 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:17:36.283 14:21:50 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:17:36.283 14:21:50 -- common/autotest_common.sh@1220 -- # return 0 00:17:36.283 14:21:50 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:17:36.283 14:21:50 -- target/nmic.sh@53 -- # nvmftestfini 00:17:36.283 14:21:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:36.283 14:21:50 -- nvmf/common.sh@116 -- # sync 00:17:36.283 14:21:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:36.283 14:21:50 -- nvmf/common.sh@119 -- # set +e 00:17:36.283 14:21:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:36.283 14:21:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:36.283 rmmod nvme_tcp 00:17:36.283 rmmod nvme_fabrics 00:17:36.283 rmmod nvme_keyring 00:17:36.283 14:21:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:36.283 14:21:50 -- nvmf/common.sh@123 -- # set -e 00:17:36.283 14:21:50 -- nvmf/common.sh@124 -- # return 0 00:17:36.283 14:21:50 -- nvmf/common.sh@477 -- # '[' -n 377369 ']' 00:17:36.283 14:21:50 -- nvmf/common.sh@478 -- # killprocess 377369 00:17:36.283 14:21:50 -- common/autotest_common.sh@936 -- # '[' -z 377369 ']' 00:17:36.283 14:21:50 -- common/autotest_common.sh@940 -- # kill -0 377369 00:17:36.283 14:21:50 -- common/autotest_common.sh@941 -- # uname 00:17:36.283 14:21:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:36.283 14:21:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 377369 00:17:36.283 14:21:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:36.283 14:21:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:36.283 14:21:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 377369' 00:17:36.283 killing process with pid 377369 00:17:36.283 14:21:50 -- common/autotest_common.sh@955 -- # kill 377369 00:17:36.283 14:21:50 -- common/autotest_common.sh@960 -- # wait 377369 00:17:36.541 14:21:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:36.541 14:21:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:36.541 14:21:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:36.541 14:21:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:36.541 14:21:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:36.541 14:21:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:36.541 14:21:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:36.541 14:21:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.075 14:21:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:39.075 00:17:39.075 real 0m15.023s 00:17:39.075 user 0m35.567s 00:17:39.075 sys 0m4.882s 00:17:39.075 14:21:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:39.075 14:21:53 -- common/autotest_common.sh@10 -- # set +x 00:17:39.075 ************************************ 00:17:39.075 END TEST nvmf_nmic 00:17:39.075 ************************************ 00:17:39.075 14:21:53 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:17:39.075 14:21:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:39.075 14:21:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:39.075 14:21:53 -- common/autotest_common.sh@10 -- # set +x 00:17:39.075 ************************************ 00:17:39.075 START TEST nvmf_fio_target 00:17:39.075 ************************************ 00:17:39.075 14:21:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:17:39.075 * Looking for test storage... 00:17:39.075 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:39.075 14:21:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:39.075 14:21:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:39.075 14:21:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:39.075 14:21:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:39.075 14:21:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:39.075 14:21:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:39.075 14:21:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:39.075 14:21:53 -- scripts/common.sh@335 -- # IFS=.-: 00:17:39.075 14:21:53 -- scripts/common.sh@335 -- # read -ra ver1 00:17:39.075 14:21:53 -- scripts/common.sh@336 -- # IFS=.-: 00:17:39.075 14:21:53 -- scripts/common.sh@336 -- # read -ra ver2 00:17:39.076 14:21:53 -- scripts/common.sh@337 -- # local 'op=<' 00:17:39.076 14:21:53 -- scripts/common.sh@339 -- # ver1_l=2 00:17:39.076 14:21:53 -- scripts/common.sh@340 -- # ver2_l=1 00:17:39.076 14:21:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:39.076 14:21:53 -- scripts/common.sh@343 -- # case "$op" in 00:17:39.076 14:21:53 -- scripts/common.sh@344 -- # : 1 00:17:39.076 14:21:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:39.076 14:21:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:39.076 14:21:53 -- scripts/common.sh@364 -- # decimal 1 00:17:39.076 14:21:53 -- scripts/common.sh@352 -- # local d=1 00:17:39.076 14:21:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:39.076 14:21:53 -- scripts/common.sh@354 -- # echo 1 00:17:39.076 14:21:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:39.076 14:21:53 -- scripts/common.sh@365 -- # decimal 2 00:17:39.076 14:21:53 -- scripts/common.sh@352 -- # local d=2 00:17:39.076 14:21:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:39.076 14:21:53 -- scripts/common.sh@354 -- # echo 2 00:17:39.076 14:21:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:39.076 14:21:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:39.076 14:21:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:39.076 14:21:53 -- scripts/common.sh@367 -- # return 0 00:17:39.076 14:21:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:39.076 14:21:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:39.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.076 --rc genhtml_branch_coverage=1 00:17:39.076 --rc genhtml_function_coverage=1 00:17:39.076 --rc genhtml_legend=1 00:17:39.076 --rc geninfo_all_blocks=1 00:17:39.076 --rc geninfo_unexecuted_blocks=1 00:17:39.076 00:17:39.076 ' 00:17:39.076 14:21:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:39.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.076 --rc genhtml_branch_coverage=1 00:17:39.076 --rc genhtml_function_coverage=1 00:17:39.076 --rc genhtml_legend=1 00:17:39.076 --rc geninfo_all_blocks=1 00:17:39.076 --rc geninfo_unexecuted_blocks=1 00:17:39.076 00:17:39.076 ' 00:17:39.076 14:21:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:39.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.076 --rc genhtml_branch_coverage=1 00:17:39.076 --rc genhtml_function_coverage=1 00:17:39.076 --rc genhtml_legend=1 00:17:39.076 --rc geninfo_all_blocks=1 00:17:39.076 --rc geninfo_unexecuted_blocks=1 00:17:39.076 00:17:39.076 ' 00:17:39.076 14:21:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:39.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:39.076 --rc genhtml_branch_coverage=1 00:17:39.076 --rc genhtml_function_coverage=1 00:17:39.076 --rc genhtml_legend=1 00:17:39.076 --rc geninfo_all_blocks=1 00:17:39.076 --rc geninfo_unexecuted_blocks=1 00:17:39.076 00:17:39.076 ' 00:17:39.076 14:21:53 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:39.076 14:21:53 -- nvmf/common.sh@7 -- # uname -s 00:17:39.076 14:21:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:39.076 14:21:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:39.076 14:21:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:39.076 14:21:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:39.076 14:21:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:39.076 14:21:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:39.076 14:21:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:39.076 14:21:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:39.076 14:21:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:39.076 14:21:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:39.076 14:21:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:17:39.076 14:21:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:17:39.076 14:21:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:39.076 14:21:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:39.076 14:21:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:39.076 14:21:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:39.076 14:21:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:39.076 14:21:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:39.076 14:21:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:39.076 14:21:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.076 14:21:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.076 14:21:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.076 14:21:53 -- paths/export.sh@5 -- # export PATH 00:17:39.076 14:21:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:39.076 14:21:53 -- nvmf/common.sh@46 -- # : 0 00:17:39.076 14:21:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:39.076 14:21:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:39.076 14:21:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:39.076 14:21:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:39.076 14:21:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:39.076 14:21:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:39.076 14:21:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:39.076 14:21:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:39.076 14:21:53 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:39.076 14:21:53 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:39.076 14:21:53 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:39.076 14:21:53 -- target/fio.sh@16 -- # nvmftestinit 00:17:39.076 14:21:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:39.076 14:21:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:39.076 14:21:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:39.076 14:21:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:39.076 14:21:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:39.076 14:21:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:39.076 14:21:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:39.076 14:21:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:39.076 14:21:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:39.076 14:21:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:39.076 14:21:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:39.076 14:21:53 -- common/autotest_common.sh@10 -- # set +x 00:17:44.358 14:21:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:44.358 14:21:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:44.358 14:21:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:44.358 14:21:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:44.358 14:21:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:44.358 14:21:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:44.358 14:21:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:44.358 14:21:58 -- nvmf/common.sh@294 -- # net_devs=() 00:17:44.358 14:21:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:44.358 14:21:58 -- nvmf/common.sh@295 -- # e810=() 00:17:44.358 14:21:58 -- nvmf/common.sh@295 -- # local -ga e810 00:17:44.358 14:21:58 -- nvmf/common.sh@296 -- # x722=() 00:17:44.358 14:21:58 -- nvmf/common.sh@296 -- # local -ga x722 00:17:44.358 14:21:58 -- nvmf/common.sh@297 -- # mlx=() 00:17:44.358 14:21:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:44.358 14:21:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:44.358 14:21:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:44.358 14:21:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:44.358 14:21:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:44.358 14:21:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:44.358 14:21:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:17:44.358 Found 0000:af:00.0 (0x8086 - 0x159b) 00:17:44.358 14:21:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:44.358 14:21:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:17:44.358 Found 0000:af:00.1 (0x8086 - 0x159b) 00:17:44.358 14:21:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:44.358 14:21:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:44.358 14:21:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:44.358 14:21:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:44.358 14:21:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:44.358 14:21:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:17:44.358 Found net devices under 0000:af:00.0: cvl_0_0 00:17:44.358 14:21:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:44.358 14:21:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:44.358 14:21:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:44.358 14:21:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:44.358 14:21:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:44.358 14:21:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:17:44.358 Found net devices under 0000:af:00.1: cvl_0_1 00:17:44.358 14:21:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:44.358 14:21:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:44.358 14:21:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:44.358 14:21:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:44.358 14:21:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:44.358 14:21:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:44.358 14:21:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:44.358 14:21:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:44.358 14:21:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:44.358 14:21:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:44.358 14:21:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:44.358 14:21:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:44.358 14:21:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:44.358 14:21:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:44.358 14:21:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:44.358 14:21:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:44.358 14:21:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:44.358 14:21:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:44.358 14:21:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:44.358 14:21:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:44.358 14:21:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:44.358 14:21:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:44.358 14:21:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:44.358 14:21:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:44.358 14:21:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:44.358 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:44.358 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.356 ms 00:17:44.358 00:17:44.358 --- 10.0.0.2 ping statistics --- 00:17:44.358 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.358 rtt min/avg/max/mdev = 0.356/0.356/0.356/0.000 ms 00:17:44.358 14:21:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:44.358 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:44.358 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.216 ms 00:17:44.358 00:17:44.358 --- 10.0.0.1 ping statistics --- 00:17:44.358 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:44.358 rtt min/avg/max/mdev = 0.216/0.216/0.216/0.000 ms 00:17:44.359 14:21:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:44.359 14:21:58 -- nvmf/common.sh@410 -- # return 0 00:17:44.359 14:21:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:44.359 14:21:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:44.359 14:21:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:44.359 14:21:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:44.359 14:21:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:44.359 14:21:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:44.359 14:21:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:44.359 14:21:58 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:17:44.359 14:21:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:44.359 14:21:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:44.359 14:21:58 -- common/autotest_common.sh@10 -- # set +x 00:17:44.359 14:21:58 -- nvmf/common.sh@469 -- # nvmfpid=382150 00:17:44.359 14:21:58 -- nvmf/common.sh@470 -- # waitforlisten 382150 00:17:44.359 14:21:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:17:44.359 14:21:58 -- common/autotest_common.sh@829 -- # '[' -z 382150 ']' 00:17:44.359 14:21:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:44.359 14:21:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:44.359 14:21:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:44.359 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:44.359 14:21:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:44.359 14:21:58 -- common/autotest_common.sh@10 -- # set +x 00:17:44.359 [2024-12-16 14:21:58.800741] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:44.359 [2024-12-16 14:21:58.800787] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:44.359 EAL: No free 2048 kB hugepages reported on node 1 00:17:44.359 [2024-12-16 14:21:58.862384] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:44.618 [2024-12-16 14:21:58.934389] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:44.618 [2024-12-16 14:21:58.934504] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:44.618 [2024-12-16 14:21:58.934513] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:44.618 [2024-12-16 14:21:58.934520] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:44.618 [2024-12-16 14:21:58.934572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:44.618 [2024-12-16 14:21:58.934677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:44.618 [2024-12-16 14:21:58.934767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:44.618 [2024-12-16 14:21:58.934768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:45.185 14:21:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:45.185 14:21:59 -- common/autotest_common.sh@862 -- # return 0 00:17:45.185 14:21:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:45.185 14:21:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:45.185 14:21:59 -- common/autotest_common.sh@10 -- # set +x 00:17:45.185 14:21:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:45.185 14:21:59 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:45.443 [2024-12-16 14:21:59.832740] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:45.443 14:21:59 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:45.702 14:22:00 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:17:45.702 14:22:00 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:45.702 14:22:00 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:17:45.702 14:22:00 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:45.960 14:22:00 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:17:45.961 14:22:00 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:46.219 14:22:00 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:17:46.219 14:22:00 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:17:46.478 14:22:00 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:46.478 14:22:01 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:17:46.478 14:22:01 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:46.736 14:22:01 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:17:46.736 14:22:01 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:46.995 14:22:01 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:17:46.995 14:22:01 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:17:47.254 14:22:01 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:17:47.512 14:22:01 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:17:47.512 14:22:01 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:17:47.512 14:22:02 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:17:47.512 14:22:02 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:17:47.771 14:22:02 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:17:48.030 [2024-12-16 14:22:02.358400] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:48.030 14:22:02 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:17:48.030 14:22:02 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:17:48.288 14:22:02 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:17:49.665 14:22:03 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:17:49.665 14:22:03 -- common/autotest_common.sh@1187 -- # local i=0 00:17:49.665 14:22:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:17:49.665 14:22:03 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:17:49.665 14:22:03 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:17:49.665 14:22:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:17:51.568 14:22:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:17:51.568 14:22:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:17:51.568 14:22:05 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:17:51.568 14:22:05 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:17:51.568 14:22:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:17:51.568 14:22:05 -- common/autotest_common.sh@1197 -- # return 0 00:17:51.568 14:22:05 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:17:51.568 [global] 00:17:51.568 thread=1 00:17:51.568 invalidate=1 00:17:51.568 rw=write 00:17:51.568 time_based=1 00:17:51.568 runtime=1 00:17:51.568 ioengine=libaio 00:17:51.568 direct=1 00:17:51.568 bs=4096 00:17:51.568 iodepth=1 00:17:51.568 norandommap=0 00:17:51.568 numjobs=1 00:17:51.568 00:17:51.568 verify_dump=1 00:17:51.568 verify_backlog=512 00:17:51.568 verify_state_save=0 00:17:51.568 do_verify=1 00:17:51.568 verify=crc32c-intel 00:17:51.568 [job0] 00:17:51.568 filename=/dev/nvme0n1 00:17:51.568 [job1] 00:17:51.568 filename=/dev/nvme0n2 00:17:51.568 [job2] 00:17:51.568 filename=/dev/nvme0n3 00:17:51.568 [job3] 00:17:51.568 filename=/dev/nvme0n4 00:17:51.568 Could not set queue depth (nvme0n1) 00:17:51.568 Could not set queue depth (nvme0n2) 00:17:51.568 Could not set queue depth (nvme0n3) 00:17:51.568 Could not set queue depth (nvme0n4) 00:17:51.826 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:51.826 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:51.826 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:51.826 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:51.826 fio-3.35 00:17:51.826 Starting 4 threads 00:17:53.229 00:17:53.229 job0: (groupid=0, jobs=1): err= 0: pid=383489: Mon Dec 16 14:22:07 2024 00:17:53.229 read: IOPS=191, BW=766KiB/s (784kB/s)(784KiB/1024msec) 00:17:53.229 slat (nsec): min=9030, max=38668, avg=12127.74, stdev=4046.64 00:17:53.229 clat (usec): min=197, max=42035, avg=4656.94, stdev=12664.87 00:17:53.229 lat (usec): min=208, max=42058, avg=4669.07, stdev=12668.08 00:17:53.229 clat percentiles (usec): 00:17:53.229 | 1.00th=[ 208], 5.00th=[ 221], 10.00th=[ 229], 20.00th=[ 237], 00:17:53.229 | 30.00th=[ 243], 40.00th=[ 251], 50.00th=[ 260], 60.00th=[ 273], 00:17:53.229 | 70.00th=[ 302], 80.00th=[ 375], 90.00th=[41157], 95.00th=[41157], 00:17:53.229 | 99.00th=[41681], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:53.229 | 99.99th=[42206] 00:17:53.229 write: IOPS=500, BW=2000KiB/s (2048kB/s)(2048KiB/1024msec); 0 zone resets 00:17:53.229 slat (usec): min=11, max=360, avg=14.59, stdev=15.74 00:17:53.229 clat (usec): min=140, max=568, avg=193.44, stdev=32.27 00:17:53.229 lat (usec): min=154, max=626, avg=208.03, stdev=37.30 00:17:53.229 clat percentiles (usec): 00:17:53.229 | 1.00th=[ 147], 5.00th=[ 153], 10.00th=[ 157], 20.00th=[ 169], 00:17:53.229 | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 194], 60.00th=[ 200], 00:17:53.229 | 70.00th=[ 206], 80.00th=[ 212], 90.00th=[ 223], 95.00th=[ 233], 00:17:53.229 | 99.00th=[ 269], 99.50th=[ 367], 99.90th=[ 570], 99.95th=[ 570], 00:17:53.229 | 99.99th=[ 570] 00:17:53.229 bw ( KiB/s): min= 4096, max= 4096, per=21.70%, avg=4096.00, stdev= 0.00, samples=1 00:17:53.229 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:53.229 lat (usec) : 250=81.50%, 500=14.41%, 750=1.13% 00:17:53.229 lat (msec) : 50=2.97% 00:17:53.229 cpu : usr=0.68%, sys=1.17%, ctx=708, majf=0, minf=1 00:17:53.229 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:53.229 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:53.229 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:53.229 issued rwts: total=196,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:53.229 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:53.229 job1: (groupid=0, jobs=1): err= 0: pid=383490: Mon Dec 16 14:22:07 2024 00:17:53.229 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:17:53.229 slat (nsec): min=8174, max=43624, avg=9868.26, stdev=1675.16 00:17:53.229 clat (usec): min=201, max=41181, avg=278.27, stdev=905.66 00:17:53.229 lat (usec): min=211, max=41194, avg=288.14, stdev=905.71 00:17:53.229 clat percentiles (usec): 00:17:53.229 | 1.00th=[ 215], 5.00th=[ 223], 10.00th=[ 227], 20.00th=[ 231], 00:17:53.229 | 30.00th=[ 235], 40.00th=[ 239], 50.00th=[ 243], 60.00th=[ 247], 00:17:53.229 | 70.00th=[ 251], 80.00th=[ 258], 90.00th=[ 379], 95.00th=[ 392], 00:17:53.229 | 99.00th=[ 400], 99.50th=[ 404], 99.90th=[ 449], 99.95th=[ 578], 00:17:53.229 | 99.99th=[41157] 00:17:53.229 write: IOPS=2339, BW=9359KiB/s (9583kB/s)(9368KiB/1001msec); 0 zone resets 00:17:53.229 slat (nsec): min=11076, max=48279, avg=13125.12, stdev=2119.80 00:17:53.229 clat (usec): min=116, max=239, avg=155.61, stdev=19.31 00:17:53.229 lat (usec): min=128, max=273, avg=168.74, stdev=19.67 00:17:53.229 clat percentiles (usec): 00:17:53.229 | 1.00th=[ 125], 5.00th=[ 131], 10.00th=[ 135], 20.00th=[ 139], 00:17:53.229 | 30.00th=[ 145], 40.00th=[ 149], 50.00th=[ 153], 60.00th=[ 159], 00:17:53.229 | 70.00th=[ 163], 80.00th=[ 169], 90.00th=[ 182], 95.00th=[ 192], 00:17:53.229 | 99.00th=[ 217], 99.50th=[ 223], 99.90th=[ 233], 99.95th=[ 235], 00:17:53.229 | 99.99th=[ 239] 00:17:53.229 bw ( KiB/s): min= 8896, max= 8896, per=47.14%, avg=8896.00, stdev= 0.00, samples=1 00:17:53.229 iops : min= 2224, max= 2224, avg=2224.00, stdev= 0.00, samples=1 00:17:53.229 lat (usec) : 250=85.47%, 500=14.49%, 750=0.02% 00:17:53.229 lat (msec) : 50=0.02% 00:17:53.229 cpu : usr=3.90%, sys=7.90%, ctx=4390, majf=0, minf=1 00:17:53.229 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:53.229 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:53.229 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:53.229 issued rwts: total=2048,2342,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:53.229 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:53.229 job2: (groupid=0, jobs=1): err= 0: pid=383492: Mon Dec 16 14:22:07 2024 00:17:53.229 read: IOPS=21, BW=85.0KiB/s (87.1kB/s)(88.0KiB/1035msec) 00:17:53.229 slat (nsec): min=10146, max=24913, avg=22589.55, stdev=3671.34 00:17:53.229 clat (usec): min=40820, max=42153, avg=41243.33, stdev=483.05 00:17:53.229 lat (usec): min=40845, max=42171, avg=41265.92, stdev=482.03 00:17:53.229 clat percentiles (usec): 00:17:53.229 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:17:53.229 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:53.229 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:17:53.229 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:53.229 | 99.99th=[42206] 00:17:53.229 write: IOPS=494, BW=1979KiB/s (2026kB/s)(2048KiB/1035msec); 0 zone resets 00:17:53.229 slat (usec): min=10, max=24260, avg=59.23, stdev=1071.64 00:17:53.229 clat (usec): min=136, max=2311, avg=186.25, stdev=109.00 00:17:53.229 lat (usec): min=150, max=24581, avg=245.47, stdev=1083.09 00:17:53.229 clat percentiles (usec): 00:17:53.229 | 1.00th=[ 143], 5.00th=[ 151], 10.00th=[ 155], 20.00th=[ 161], 00:17:53.229 | 30.00th=[ 165], 40.00th=[ 172], 50.00th=[ 176], 60.00th=[ 182], 00:17:53.229 | 70.00th=[ 188], 80.00th=[ 192], 90.00th=[ 204], 95.00th=[ 215], 00:17:53.229 | 99.00th=[ 326], 99.50th=[ 693], 99.90th=[ 2311], 99.95th=[ 2311], 00:17:53.229 | 99.99th=[ 2311] 00:17:53.229 bw ( KiB/s): min= 4096, max= 4096, per=21.70%, avg=4096.00, stdev= 0.00, samples=1 00:17:53.229 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:53.229 lat (usec) : 250=94.38%, 500=0.56%, 750=0.56% 00:17:53.229 lat (msec) : 2=0.19%, 4=0.19%, 50=4.12% 00:17:53.229 cpu : usr=0.19%, sys=0.68%, ctx=536, majf=0, minf=1 00:17:53.229 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:53.229 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:53.229 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:53.229 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:53.229 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:53.229 job3: (groupid=0, jobs=1): err= 0: pid=383494: Mon Dec 16 14:22:07 2024 00:17:53.229 read: IOPS=998, BW=3992KiB/s (4088kB/s)(4148KiB/1039msec) 00:17:53.229 slat (nsec): min=6666, max=24801, avg=7913.08, stdev=1946.53 00:17:53.229 clat (usec): min=172, max=41894, avg=728.43, stdev=4545.23 00:17:53.229 lat (usec): min=180, max=41918, avg=736.34, stdev=4546.96 00:17:53.229 clat percentiles (usec): 00:17:53.229 | 1.00th=[ 182], 5.00th=[ 186], 10.00th=[ 190], 20.00th=[ 196], 00:17:53.229 | 30.00th=[ 198], 40.00th=[ 204], 50.00th=[ 208], 60.00th=[ 212], 00:17:53.229 | 70.00th=[ 219], 80.00th=[ 231], 90.00th=[ 258], 95.00th=[ 289], 00:17:53.229 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41681], 00:17:53.229 | 99.99th=[41681] 00:17:53.229 write: IOPS=1478, BW=5913KiB/s (6055kB/s)(6144KiB/1039msec); 0 zone resets 00:17:53.229 slat (nsec): min=9590, max=42608, avg=11033.33, stdev=1537.58 00:17:53.229 clat (usec): min=116, max=323, avg=164.43, stdev=29.14 00:17:53.229 lat (usec): min=126, max=336, avg=175.46, stdev=29.25 00:17:53.229 clat percentiles (usec): 00:17:53.229 | 1.00th=[ 126], 5.00th=[ 131], 10.00th=[ 135], 20.00th=[ 141], 00:17:53.229 | 30.00th=[ 145], 40.00th=[ 151], 50.00th=[ 157], 60.00th=[ 163], 00:17:53.229 | 70.00th=[ 174], 80.00th=[ 192], 90.00th=[ 210], 95.00th=[ 223], 00:17:53.229 | 99.00th=[ 239], 99.50th=[ 260], 99.90th=[ 289], 99.95th=[ 326], 00:17:53.229 | 99.99th=[ 326] 00:17:53.229 bw ( KiB/s): min= 224, max=12064, per=32.56%, avg=6144.00, stdev=8372.14, samples=2 00:17:53.229 iops : min= 56, max= 3016, avg=1536.00, stdev=2093.04, samples=2 00:17:53.229 lat (usec) : 250=94.71%, 500=4.74%, 750=0.04% 00:17:53.229 lat (msec) : 50=0.51% 00:17:53.229 cpu : usr=1.25%, sys=2.41%, ctx=2574, majf=0, minf=1 00:17:53.229 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:53.229 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:53.229 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:53.229 issued rwts: total=1037,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:53.229 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:53.229 00:17:53.229 Run status group 0 (all jobs): 00:17:53.229 READ: bw=12.4MiB/s (13.0MB/s), 85.0KiB/s-8184KiB/s (87.1kB/s-8380kB/s), io=12.9MiB (13.5MB), run=1001-1039msec 00:17:53.229 WRITE: bw=18.4MiB/s (19.3MB/s), 1979KiB/s-9359KiB/s (2026kB/s-9583kB/s), io=19.1MiB (20.1MB), run=1001-1039msec 00:17:53.230 00:17:53.230 Disk stats (read/write): 00:17:53.230 nvme0n1: ios=241/512, merge=0/0, ticks=757/90, in_queue=847, util=90.88% 00:17:53.230 nvme0n2: ios=1714/2048, merge=0/0, ticks=460/291, in_queue=751, util=86.89% 00:17:53.230 nvme0n3: ios=41/512, merge=0/0, ticks=1693/93, in_queue=1786, util=98.54% 00:17:53.230 nvme0n4: ios=1090/1536, merge=0/0, ticks=752/248, in_queue=1000, util=98.64% 00:17:53.230 14:22:07 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:17:53.230 [global] 00:17:53.230 thread=1 00:17:53.230 invalidate=1 00:17:53.230 rw=randwrite 00:17:53.230 time_based=1 00:17:53.230 runtime=1 00:17:53.230 ioengine=libaio 00:17:53.230 direct=1 00:17:53.230 bs=4096 00:17:53.230 iodepth=1 00:17:53.230 norandommap=0 00:17:53.230 numjobs=1 00:17:53.230 00:17:53.230 verify_dump=1 00:17:53.230 verify_backlog=512 00:17:53.230 verify_state_save=0 00:17:53.230 do_verify=1 00:17:53.230 verify=crc32c-intel 00:17:53.230 [job0] 00:17:53.230 filename=/dev/nvme0n1 00:17:53.230 [job1] 00:17:53.230 filename=/dev/nvme0n2 00:17:53.230 [job2] 00:17:53.230 filename=/dev/nvme0n3 00:17:53.230 [job3] 00:17:53.230 filename=/dev/nvme0n4 00:17:53.230 Could not set queue depth (nvme0n1) 00:17:53.230 Could not set queue depth (nvme0n2) 00:17:53.230 Could not set queue depth (nvme0n3) 00:17:53.230 Could not set queue depth (nvme0n4) 00:17:53.487 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:53.487 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:53.487 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:53.487 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:53.487 fio-3.35 00:17:53.487 Starting 4 threads 00:17:54.856 00:17:54.856 job0: (groupid=0, jobs=1): err= 0: pid=383865: Mon Dec 16 14:22:09 2024 00:17:54.856 read: IOPS=23, BW=92.5KiB/s (94.7kB/s)(96.0KiB/1038msec) 00:17:54.856 slat (nsec): min=8555, max=23776, avg=21310.04, stdev=4332.33 00:17:54.856 clat (usec): min=342, max=41969, avg=39393.51, stdev=8325.32 00:17:54.856 lat (usec): min=364, max=41993, avg=39414.82, stdev=8325.27 00:17:54.856 clat percentiles (usec): 00:17:54.856 | 1.00th=[ 343], 5.00th=[40633], 10.00th=[40633], 20.00th=[40633], 00:17:54.856 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:54.856 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:17:54.856 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:54.856 | 99.99th=[42206] 00:17:54.856 write: IOPS=493, BW=1973KiB/s (2020kB/s)(2048KiB/1038msec); 0 zone resets 00:17:54.856 slat (nsec): min=9541, max=38112, avg=11037.26, stdev=1621.69 00:17:54.856 clat (usec): min=138, max=285, avg=165.95, stdev=14.90 00:17:54.856 lat (usec): min=149, max=295, avg=176.99, stdev=15.37 00:17:54.856 clat percentiles (usec): 00:17:54.856 | 1.00th=[ 143], 5.00th=[ 147], 10.00th=[ 149], 20.00th=[ 155], 00:17:54.856 | 30.00th=[ 157], 40.00th=[ 161], 50.00th=[ 165], 60.00th=[ 167], 00:17:54.856 | 70.00th=[ 172], 80.00th=[ 178], 90.00th=[ 184], 95.00th=[ 190], 00:17:54.856 | 99.00th=[ 204], 99.50th=[ 237], 99.90th=[ 285], 99.95th=[ 285], 00:17:54.856 | 99.99th=[ 285] 00:17:54.856 bw ( KiB/s): min= 4096, max= 4096, per=17.79%, avg=4096.00, stdev= 0.00, samples=1 00:17:54.856 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:54.856 lat (usec) : 250=95.34%, 500=0.37% 00:17:54.856 lat (msec) : 50=4.29% 00:17:54.856 cpu : usr=0.19%, sys=1.06%, ctx=536, majf=0, minf=1 00:17:54.856 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:54.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:54.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:54.856 issued rwts: total=24,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:54.856 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:54.856 job1: (groupid=0, jobs=1): err= 0: pid=383866: Mon Dec 16 14:22:09 2024 00:17:54.856 read: IOPS=21, BW=87.8KiB/s (89.9kB/s)(88.0KiB/1002msec) 00:17:54.856 slat (nsec): min=10896, max=41199, avg=24833.00, stdev=4919.33 00:17:54.856 clat (usec): min=40690, max=42043, avg=41224.27, stdev=451.77 00:17:54.856 lat (usec): min=40701, max=42067, avg=41249.10, stdev=452.69 00:17:54.856 clat percentiles (usec): 00:17:54.856 | 1.00th=[40633], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:17:54.856 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:17:54.856 | 70.00th=[41157], 80.00th=[41681], 90.00th=[42206], 95.00th=[42206], 00:17:54.856 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:17:54.856 | 99.99th=[42206] 00:17:54.856 write: IOPS=510, BW=2044KiB/s (2093kB/s)(2048KiB/1002msec); 0 zone resets 00:17:54.856 slat (nsec): min=10408, max=36779, avg=11809.80, stdev=2207.50 00:17:54.856 clat (usec): min=137, max=335, avg=169.12, stdev=15.94 00:17:54.856 lat (usec): min=147, max=372, avg=180.93, stdev=16.75 00:17:54.856 clat percentiles (usec): 00:17:54.856 | 1.00th=[ 145], 5.00th=[ 147], 10.00th=[ 153], 20.00th=[ 157], 00:17:54.856 | 30.00th=[ 161], 40.00th=[ 165], 50.00th=[ 167], 60.00th=[ 172], 00:17:54.856 | 70.00th=[ 176], 80.00th=[ 180], 90.00th=[ 188], 95.00th=[ 194], 00:17:54.856 | 99.00th=[ 208], 99.50th=[ 215], 99.90th=[ 334], 99.95th=[ 334], 00:17:54.856 | 99.99th=[ 334] 00:17:54.856 bw ( KiB/s): min= 4096, max= 4096, per=17.79%, avg=4096.00, stdev= 0.00, samples=1 00:17:54.856 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:17:54.856 lat (usec) : 250=95.69%, 500=0.19% 00:17:54.856 lat (msec) : 50=4.12% 00:17:54.856 cpu : usr=0.30%, sys=1.10%, ctx=535, majf=0, minf=1 00:17:54.856 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:54.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:54.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:54.856 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:54.856 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:54.856 job2: (groupid=0, jobs=1): err= 0: pid=383867: Mon Dec 16 14:22:09 2024 00:17:54.856 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:17:54.856 slat (nsec): min=7705, max=24576, avg=8702.55, stdev=1373.29 00:17:54.856 clat (usec): min=177, max=675, avg=231.25, stdev=24.61 00:17:54.856 lat (usec): min=185, max=684, avg=239.95, stdev=24.66 00:17:54.856 clat percentiles (usec): 00:17:54.856 | 1.00th=[ 192], 5.00th=[ 200], 10.00th=[ 206], 20.00th=[ 212], 00:17:54.856 | 30.00th=[ 219], 40.00th=[ 225], 50.00th=[ 233], 60.00th=[ 239], 00:17:54.856 | 70.00th=[ 243], 80.00th=[ 247], 90.00th=[ 253], 95.00th=[ 260], 00:17:54.856 | 99.00th=[ 269], 99.50th=[ 297], 99.90th=[ 515], 99.95th=[ 578], 00:17:54.856 | 99.99th=[ 676] 00:17:54.856 write: IOPS=2472, BW=9890KiB/s (10.1MB/s)(9900KiB/1001msec); 0 zone resets 00:17:54.856 slat (nsec): min=11414, max=51400, avg=12548.18, stdev=1800.65 00:17:54.856 clat (usec): min=128, max=810, avg=186.73, stdev=41.18 00:17:54.856 lat (usec): min=140, max=823, avg=199.27, stdev=41.43 00:17:54.856 clat percentiles (usec): 00:17:54.856 | 1.00th=[ 141], 5.00th=[ 147], 10.00th=[ 151], 20.00th=[ 157], 00:17:54.856 | 30.00th=[ 161], 40.00th=[ 165], 50.00th=[ 172], 60.00th=[ 180], 00:17:54.856 | 70.00th=[ 196], 80.00th=[ 231], 90.00th=[ 241], 95.00th=[ 265], 00:17:54.856 | 99.00th=[ 281], 99.50th=[ 289], 99.90th=[ 523], 99.95th=[ 537], 00:17:54.856 | 99.99th=[ 807] 00:17:54.856 bw ( KiB/s): min= 9072, max= 9072, per=39.40%, avg=9072.00, stdev= 0.00, samples=1 00:17:54.856 iops : min= 2268, max= 2268, avg=2268.00, stdev= 0.00, samples=1 00:17:54.856 lat (usec) : 250=88.79%, 500=11.03%, 750=0.15%, 1000=0.02% 00:17:54.856 cpu : usr=4.50%, sys=7.20%, ctx=4524, majf=0, minf=1 00:17:54.856 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:54.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:54.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:54.856 issued rwts: total=2048,2475,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:54.856 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:54.856 job3: (groupid=0, jobs=1): err= 0: pid=383868: Mon Dec 16 14:22:09 2024 00:17:54.856 read: IOPS=2045, BW=8184KiB/s (8380kB/s)(8192KiB/1001msec) 00:17:54.856 slat (nsec): min=8484, max=29999, avg=10000.82, stdev=1829.61 00:17:54.856 clat (usec): min=207, max=477, avg=244.06, stdev=15.74 00:17:54.856 lat (usec): min=216, max=487, avg=254.06, stdev=15.94 00:17:54.856 clat percentiles (usec): 00:17:54.856 | 1.00th=[ 217], 5.00th=[ 225], 10.00th=[ 229], 20.00th=[ 233], 00:17:54.856 | 30.00th=[ 237], 40.00th=[ 241], 50.00th=[ 243], 60.00th=[ 247], 00:17:54.856 | 70.00th=[ 249], 80.00th=[ 253], 90.00th=[ 260], 95.00th=[ 265], 00:17:54.856 | 99.00th=[ 273], 99.50th=[ 293], 99.90th=[ 441], 99.95th=[ 453], 00:17:54.856 | 99.99th=[ 478] 00:17:54.856 write: IOPS=2473, BW=9894KiB/s (10.1MB/s)(9904KiB/1001msec); 0 zone resets 00:17:54.856 slat (nsec): min=11963, max=37148, avg=13488.23, stdev=1677.54 00:17:54.856 clat (usec): min=134, max=266, avg=174.15, stdev=14.68 00:17:54.856 lat (usec): min=146, max=303, avg=187.64, stdev=14.98 00:17:54.856 clat percentiles (usec): 00:17:54.856 | 1.00th=[ 143], 5.00th=[ 153], 10.00th=[ 157], 20.00th=[ 163], 00:17:54.856 | 30.00th=[ 167], 40.00th=[ 169], 50.00th=[ 174], 60.00th=[ 178], 00:17:54.856 | 70.00th=[ 182], 80.00th=[ 186], 90.00th=[ 194], 95.00th=[ 200], 00:17:54.856 | 99.00th=[ 212], 99.50th=[ 219], 99.90th=[ 229], 99.95th=[ 249], 00:17:54.856 | 99.99th=[ 269] 00:17:54.856 bw ( KiB/s): min= 9744, max= 9744, per=42.32%, avg=9744.00, stdev= 0.00, samples=1 00:17:54.856 iops : min= 2436, max= 2436, avg=2436.00, stdev= 0.00, samples=1 00:17:54.856 lat (usec) : 250=86.60%, 500=13.40% 00:17:54.856 cpu : usr=4.50%, sys=7.90%, ctx=4525, majf=0, minf=1 00:17:54.856 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:17:54.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:54.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:54.856 issued rwts: total=2048,2476,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:54.856 latency : target=0, window=0, percentile=100.00%, depth=1 00:17:54.856 00:17:54.856 Run status group 0 (all jobs): 00:17:54.856 READ: bw=15.6MiB/s (16.3MB/s), 87.8KiB/s-8184KiB/s (89.9kB/s-8380kB/s), io=16.2MiB (17.0MB), run=1001-1038msec 00:17:54.856 WRITE: bw=22.5MiB/s (23.6MB/s), 1973KiB/s-9894KiB/s (2020kB/s-10.1MB/s), io=23.3MiB (24.5MB), run=1001-1038msec 00:17:54.856 00:17:54.856 Disk stats (read/write): 00:17:54.856 nvme0n1: ios=58/512, merge=0/0, ticks=775/80, in_queue=855, util=86.57% 00:17:54.856 nvme0n2: ios=45/512, merge=0/0, ticks=1408/77, in_queue=1485, util=97.26% 00:17:54.856 nvme0n3: ios=1885/2048, merge=0/0, ticks=1409/344, in_queue=1753, util=98.34% 00:17:54.856 nvme0n4: ios=1799/2048, merge=0/0, ticks=1370/337, in_queue=1707, util=99.90% 00:17:54.856 14:22:09 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:17:54.856 [global] 00:17:54.856 thread=1 00:17:54.856 invalidate=1 00:17:54.856 rw=write 00:17:54.856 time_based=1 00:17:54.856 runtime=1 00:17:54.856 ioengine=libaio 00:17:54.856 direct=1 00:17:54.856 bs=4096 00:17:54.856 iodepth=128 00:17:54.856 norandommap=0 00:17:54.856 numjobs=1 00:17:54.856 00:17:54.856 verify_dump=1 00:17:54.856 verify_backlog=512 00:17:54.856 verify_state_save=0 00:17:54.856 do_verify=1 00:17:54.856 verify=crc32c-intel 00:17:54.856 [job0] 00:17:54.856 filename=/dev/nvme0n1 00:17:54.856 [job1] 00:17:54.856 filename=/dev/nvme0n2 00:17:54.856 [job2] 00:17:54.856 filename=/dev/nvme0n3 00:17:54.856 [job3] 00:17:54.856 filename=/dev/nvme0n4 00:17:54.856 Could not set queue depth (nvme0n1) 00:17:54.856 Could not set queue depth (nvme0n2) 00:17:54.856 Could not set queue depth (nvme0n3) 00:17:54.856 Could not set queue depth (nvme0n4) 00:17:54.856 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:54.856 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:54.856 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:54.856 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:54.856 fio-3.35 00:17:54.856 Starting 4 threads 00:17:56.225 00:17:56.225 job0: (groupid=0, jobs=1): err= 0: pid=384266: Mon Dec 16 14:22:10 2024 00:17:56.225 read: IOPS=2567, BW=10.0MiB/s (10.5MB/s)(10.5MiB/1046msec) 00:17:56.225 slat (nsec): min=1428, max=13746k, avg=165146.98, stdev=993493.39 00:17:56.225 clat (msec): min=5, max=127, avg=19.29, stdev=20.46 00:17:56.225 lat (msec): min=6, max=127, avg=19.45, stdev=20.57 00:17:56.225 clat percentiles (msec): 00:17:56.225 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], 00:17:56.225 | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 15], 00:17:56.225 | 70.00th=[ 18], 80.00th=[ 22], 90.00th=[ 32], 95.00th=[ 63], 00:17:56.225 | 99.00th=[ 121], 99.50th=[ 122], 99.90th=[ 128], 99.95th=[ 128], 00:17:56.225 | 99.99th=[ 128] 00:17:56.225 write: IOPS=2936, BW=11.5MiB/s (12.0MB/s)(12.0MiB/1046msec); 0 zone resets 00:17:56.225 slat (usec): min=2, max=14416, avg=175.44, stdev=788.32 00:17:56.225 clat (usec): min=1516, max=127120, avg=26320.21, stdev=14091.99 00:17:56.225 lat (usec): min=1575, max=127126, avg=26495.64, stdev=14173.30 00:17:56.225 clat percentiles (msec): 00:17:56.225 | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 15], 20.00th=[ 17], 00:17:56.225 | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 22], 60.00th=[ 26], 00:17:56.225 | 70.00th=[ 29], 80.00th=[ 34], 90.00th=[ 47], 95.00th=[ 61], 00:17:56.225 | 99.00th=[ 68], 99.50th=[ 68], 99.90th=[ 72], 99.95th=[ 83], 00:17:56.225 | 99.99th=[ 128] 00:17:56.225 bw ( KiB/s): min= 8968, max=15600, per=20.16%, avg=12284.00, stdev=4689.53, samples=2 00:17:56.225 iops : min= 2242, max= 3900, avg=3071.00, stdev=1172.38, samples=2 00:17:56.225 lat (msec) : 2=0.02%, 4=0.21%, 10=16.26%, 20=39.65%, 50=36.37% 00:17:56.225 lat (msec) : 100=6.29%, 250=1.22% 00:17:56.225 cpu : usr=2.97%, sys=2.97%, ctx=367, majf=0, minf=2 00:17:56.225 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:17:56.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:56.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:56.225 issued rwts: total=2686,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:56.225 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:56.225 job1: (groupid=0, jobs=1): err= 0: pid=384280: Mon Dec 16 14:22:10 2024 00:17:56.225 read: IOPS=4957, BW=19.4MiB/s (20.3MB/s)(19.5MiB/1006msec) 00:17:56.225 slat (nsec): min=1056, max=19845k, avg=98294.68, stdev=786510.45 00:17:56.225 clat (usec): min=1177, max=78024, avg=12618.19, stdev=9242.88 00:17:56.225 lat (usec): min=1196, max=78032, avg=12716.48, stdev=9332.72 00:17:56.225 clat percentiles (usec): 00:17:56.225 | 1.00th=[ 3294], 5.00th=[ 4555], 10.00th=[ 6063], 20.00th=[ 7373], 00:17:56.225 | 30.00th=[ 8455], 40.00th=[ 8848], 50.00th=[ 9503], 60.00th=[11207], 00:17:56.225 | 70.00th=[13042], 80.00th=[14877], 90.00th=[21890], 95.00th=[31589], 00:17:56.225 | 99.00th=[52167], 99.50th=[58983], 99.90th=[71828], 99.95th=[78119], 00:17:56.225 | 99.99th=[78119] 00:17:56.225 write: IOPS=5089, BW=19.9MiB/s (20.8MB/s)(20.0MiB/1006msec); 0 zone resets 00:17:56.225 slat (usec): min=2, max=9105, avg=76.96, stdev=522.33 00:17:56.225 clat (usec): min=532, max=78045, avg=12603.53, stdev=13145.16 00:17:56.225 lat (usec): min=546, max=78065, avg=12680.49, stdev=13222.26 00:17:56.225 clat percentiles (usec): 00:17:56.225 | 1.00th=[ 1336], 5.00th=[ 2999], 10.00th=[ 4883], 20.00th=[ 6325], 00:17:56.225 | 30.00th=[ 7177], 40.00th=[ 8455], 50.00th=[ 9372], 60.00th=[ 9896], 00:17:56.225 | 70.00th=[10159], 80.00th=[11207], 90.00th=[25297], 95.00th=[40109], 00:17:56.225 | 99.00th=[67634], 99.50th=[72877], 99.90th=[76022], 99.95th=[78119], 00:17:56.225 | 99.99th=[78119] 00:17:56.225 bw ( KiB/s): min=16384, max=24576, per=33.61%, avg=20480.00, stdev=5792.62, samples=2 00:17:56.225 iops : min= 4096, max= 6144, avg=5120.00, stdev=1448.15, samples=2 00:17:56.225 lat (usec) : 750=0.45%, 1000=0.01% 00:17:56.225 lat (msec) : 2=0.57%, 4=3.22%, 10=54.86%, 20=28.65%, 50=8.93% 00:17:56.225 lat (msec) : 100=3.30% 00:17:56.225 cpu : usr=4.58%, sys=4.58%, ctx=416, majf=0, minf=2 00:17:56.225 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:17:56.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:56.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:56.225 issued rwts: total=4987,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:56.225 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:56.225 job2: (groupid=0, jobs=1): err= 0: pid=384296: Mon Dec 16 14:22:10 2024 00:17:56.225 read: IOPS=3041, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec) 00:17:56.225 slat (nsec): min=1654, max=17991k, avg=143983.70, stdev=940095.79 00:17:56.225 clat (usec): min=3750, max=56224, avg=18027.40, stdev=9185.62 00:17:56.225 lat (usec): min=4662, max=56491, avg=18171.38, stdev=9241.57 00:17:56.225 clat percentiles (usec): 00:17:56.225 | 1.00th=[ 8094], 5.00th=[ 9110], 10.00th=[10421], 20.00th=[10814], 00:17:56.225 | 30.00th=[11469], 40.00th=[13304], 50.00th=[16188], 60.00th=[16909], 00:17:56.225 | 70.00th=[19792], 80.00th=[23987], 90.00th=[30540], 95.00th=[37487], 00:17:56.225 | 99.00th=[49021], 99.50th=[51119], 99.90th=[56361], 99.95th=[56361], 00:17:56.225 | 99.99th=[56361] 00:17:56.225 write: IOPS=3053, BW=11.9MiB/s (12.5MB/s)(12.0MiB/1006msec); 0 zone resets 00:17:56.225 slat (usec): min=2, max=19230, avg=176.31, stdev=903.62 00:17:56.225 clat (usec): min=2491, max=77077, avg=23537.42, stdev=15974.34 00:17:56.225 lat (usec): min=2502, max=77090, avg=23713.73, stdev=16089.26 00:17:56.225 clat percentiles (usec): 00:17:56.225 | 1.00th=[ 6259], 5.00th=[10945], 10.00th=[11469], 20.00th=[11863], 00:17:56.225 | 30.00th=[12518], 40.00th=[15664], 50.00th=[16909], 60.00th=[20055], 00:17:56.225 | 70.00th=[22938], 80.00th=[32900], 90.00th=[50070], 95.00th=[62653], 00:17:56.225 | 99.00th=[70779], 99.50th=[72877], 99.90th=[77071], 99.95th=[77071], 00:17:56.225 | 99.99th=[77071] 00:17:56.225 bw ( KiB/s): min= 7880, max=16696, per=20.17%, avg=12288.00, stdev=6233.85, samples=2 00:17:56.225 iops : min= 1970, max= 4174, avg=3072.00, stdev=1558.46, samples=2 00:17:56.225 lat (msec) : 4=0.24%, 10=5.50%, 20=59.77%, 50=28.91%, 100=5.58% 00:17:56.225 cpu : usr=1.99%, sys=4.58%, ctx=395, majf=0, minf=1 00:17:56.225 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:17:56.225 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:56.225 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:56.225 issued rwts: total=3060,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:56.225 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:56.225 job3: (groupid=0, jobs=1): err= 0: pid=384302: Mon Dec 16 14:22:10 2024 00:17:56.225 read: IOPS=4580, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1006msec) 00:17:56.225 slat (nsec): min=1050, max=22514k, avg=103728.59, stdev=822877.96 00:17:56.225 clat (usec): min=3816, max=51271, avg=13138.23, stdev=7292.76 00:17:56.225 lat (usec): min=3819, max=51278, avg=13241.96, stdev=7360.61 00:17:56.225 clat percentiles (usec): 00:17:56.225 | 1.00th=[ 6128], 5.00th=[ 7439], 10.00th=[ 7963], 20.00th=[ 8848], 00:17:56.225 | 30.00th=[ 9110], 40.00th=[ 9503], 50.00th=[10159], 60.00th=[11207], 00:17:56.225 | 70.00th=[13304], 80.00th=[15533], 90.00th=[24249], 95.00th=[30016], 00:17:56.225 | 99.00th=[45351], 99.50th=[49021], 99.90th=[51119], 99.95th=[51119], 00:17:56.225 | 99.99th=[51119] 00:17:56.225 write: IOPS=4642, BW=18.1MiB/s (19.0MB/s)(18.2MiB/1006msec); 0 zone resets 00:17:56.226 slat (nsec): min=1890, max=25662k, avg=105763.67, stdev=648826.67 00:17:56.226 clat (usec): min=3045, max=51245, avg=13581.13, stdev=8610.95 00:17:56.226 lat (usec): min=3052, max=51251, avg=13686.89, stdev=8668.17 00:17:56.226 clat percentiles (usec): 00:17:56.226 | 1.00th=[ 4948], 5.00th=[ 5669], 10.00th=[ 6456], 20.00th=[ 7308], 00:17:56.226 | 30.00th=[ 7963], 40.00th=[ 8979], 50.00th=[ 9503], 60.00th=[11469], 00:17:56.226 | 70.00th=[16450], 80.00th=[20841], 90.00th=[26084], 95.00th=[32113], 00:17:56.226 | 99.00th=[42730], 99.50th=[43779], 99.90th=[45876], 99.95th=[45876], 00:17:56.226 | 99.99th=[51119] 00:17:56.226 bw ( KiB/s): min=16384, max=20480, per=30.25%, avg=18432.00, stdev=2896.31, samples=2 00:17:56.226 iops : min= 4096, max= 5120, avg=4608.00, stdev=724.08, samples=2 00:17:56.226 lat (msec) : 4=0.33%, 10=50.29%, 20=31.30%, 50=18.01%, 100=0.06% 00:17:56.226 cpu : usr=2.59%, sys=5.47%, ctx=445, majf=0, minf=1 00:17:56.226 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:17:56.226 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:56.226 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:56.226 issued rwts: total=4608,4670,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:56.226 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:56.226 00:17:56.226 Run status group 0 (all jobs): 00:17:56.226 READ: bw=57.3MiB/s (60.1MB/s), 10.0MiB/s-19.4MiB/s (10.5MB/s-20.3MB/s), io=59.9MiB (62.8MB), run=1006-1046msec 00:17:56.226 WRITE: bw=59.5MiB/s (62.4MB/s), 11.5MiB/s-19.9MiB/s (12.0MB/s-20.8MB/s), io=62.2MiB (65.3MB), run=1006-1046msec 00:17:56.226 00:17:56.226 Disk stats (read/write): 00:17:56.226 nvme0n1: ios=2610/2639, merge=0/0, ticks=38463/65904, in_queue=104367, util=86.57% 00:17:56.226 nvme0n2: ios=4146/4135, merge=0/0, ticks=42394/48036, in_queue=90430, util=95.23% 00:17:56.226 nvme0n3: ios=2598/2783, merge=0/0, ticks=28018/38886, in_queue=66904, util=100.00% 00:17:56.226 nvme0n4: ios=4139/4231, merge=0/0, ticks=36587/37372, in_queue=73959, util=100.00% 00:17:56.226 14:22:10 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:17:56.226 [global] 00:17:56.226 thread=1 00:17:56.226 invalidate=1 00:17:56.226 rw=randwrite 00:17:56.226 time_based=1 00:17:56.226 runtime=1 00:17:56.226 ioengine=libaio 00:17:56.226 direct=1 00:17:56.226 bs=4096 00:17:56.226 iodepth=128 00:17:56.226 norandommap=0 00:17:56.226 numjobs=1 00:17:56.226 00:17:56.226 verify_dump=1 00:17:56.226 verify_backlog=512 00:17:56.226 verify_state_save=0 00:17:56.226 do_verify=1 00:17:56.226 verify=crc32c-intel 00:17:56.226 [job0] 00:17:56.226 filename=/dev/nvme0n1 00:17:56.226 [job1] 00:17:56.226 filename=/dev/nvme0n2 00:17:56.226 [job2] 00:17:56.226 filename=/dev/nvme0n3 00:17:56.226 [job3] 00:17:56.226 filename=/dev/nvme0n4 00:17:56.226 Could not set queue depth (nvme0n1) 00:17:56.226 Could not set queue depth (nvme0n2) 00:17:56.226 Could not set queue depth (nvme0n3) 00:17:56.226 Could not set queue depth (nvme0n4) 00:17:56.483 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:56.483 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:56.483 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:56.483 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:17:56.483 fio-3.35 00:17:56.483 Starting 4 threads 00:17:57.856 00:17:57.856 job0: (groupid=0, jobs=1): err= 0: pid=384738: Mon Dec 16 14:22:12 2024 00:17:57.856 read: IOPS=5581, BW=21.8MiB/s (22.9MB/s)(22.0MiB/1009msec) 00:17:57.856 slat (nsec): min=1209, max=14177k, avg=82922.42, stdev=627652.46 00:17:57.856 clat (usec): min=1972, max=46435, avg=10424.82, stdev=5690.53 00:17:57.856 lat (usec): min=1984, max=46442, avg=10507.74, stdev=5735.42 00:17:57.856 clat percentiles (usec): 00:17:57.856 | 1.00th=[ 4047], 5.00th=[ 5932], 10.00th=[ 6652], 20.00th=[ 6980], 00:17:57.856 | 30.00th=[ 7504], 40.00th=[ 7963], 50.00th=[ 8586], 60.00th=[ 9241], 00:17:57.856 | 70.00th=[11600], 80.00th=[12256], 90.00th=[15926], 95.00th=[22152], 00:17:57.856 | 99.00th=[36963], 99.50th=[42206], 99.90th=[44827], 99.95th=[46400], 00:17:57.856 | 99.99th=[46400] 00:17:57.856 write: IOPS=5762, BW=22.5MiB/s (23.6MB/s)(22.7MiB/1009msec); 0 zone resets 00:17:57.856 slat (usec): min=2, max=32626, avg=81.43, stdev=630.43 00:17:57.856 clat (usec): min=868, max=47064, avg=11919.82, stdev=7786.71 00:17:57.856 lat (usec): min=879, max=47100, avg=12001.26, stdev=7845.28 00:17:57.856 clat percentiles (usec): 00:17:57.856 | 1.00th=[ 2180], 5.00th=[ 3752], 10.00th=[ 5276], 20.00th=[ 6915], 00:17:57.856 | 30.00th=[ 7635], 40.00th=[ 7963], 50.00th=[ 8225], 60.00th=[10290], 00:17:57.856 | 70.00th=[13698], 80.00th=[16188], 90.00th=[22938], 95.00th=[29754], 00:17:57.856 | 99.00th=[38011], 99.50th=[39060], 99.90th=[40109], 99.95th=[46400], 00:17:57.856 | 99.99th=[46924] 00:17:57.856 bw ( KiB/s): min=20920, max=24576, per=31.98%, avg=22748.00, stdev=2585.18, samples=2 00:17:57.856 iops : min= 5230, max= 6144, avg=5687.00, stdev=646.30, samples=2 00:17:57.856 lat (usec) : 1000=0.03% 00:17:57.856 lat (msec) : 2=0.42%, 4=2.91%, 10=57.20%, 20=29.00%, 50=10.44% 00:17:57.856 cpu : usr=3.77%, sys=6.85%, ctx=618, majf=0, minf=1 00:17:57.856 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:17:57.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:57.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:57.856 issued rwts: total=5632,5814,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:57.856 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:57.856 job1: (groupid=0, jobs=1): err= 0: pid=384761: Mon Dec 16 14:22:12 2024 00:17:57.856 read: IOPS=4059, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1009msec) 00:17:57.856 slat (nsec): min=1449, max=8249.8k, avg=125068.33, stdev=739011.26 00:17:57.856 clat (usec): min=6177, max=49533, avg=16732.42, stdev=10720.43 00:17:57.856 lat (usec): min=6184, max=49559, avg=16857.48, stdev=10815.48 00:17:57.856 clat percentiles (usec): 00:17:57.856 | 1.00th=[ 6259], 5.00th=[ 7767], 10.00th=[ 8586], 20.00th=[ 9110], 00:17:57.856 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[11469], 00:17:57.856 | 70.00th=[20055], 80.00th=[27657], 90.00th=[35914], 95.00th=[39060], 00:17:57.856 | 99.00th=[42206], 99.50th=[42206], 99.90th=[45351], 99.95th=[46400], 00:17:57.856 | 99.99th=[49546] 00:17:57.856 write: IOPS=4408, BW=17.2MiB/s (18.1MB/s)(17.4MiB/1009msec); 0 zone resets 00:17:57.856 slat (nsec): min=1886, max=9818.4k, avg=96049.37, stdev=499606.68 00:17:57.856 clat (usec): min=2763, max=43448, avg=13238.02, stdev=6933.75 00:17:57.856 lat (usec): min=2773, max=43451, avg=13334.07, stdev=6981.21 00:17:57.856 clat percentiles (usec): 00:17:57.856 | 1.00th=[ 4948], 5.00th=[ 7046], 10.00th=[ 7832], 20.00th=[ 8094], 00:17:57.856 | 30.00th=[ 9241], 40.00th=[ 9765], 50.00th=[10159], 60.00th=[10552], 00:17:57.856 | 70.00th=[14353], 80.00th=[17433], 90.00th=[25035], 95.00th=[28181], 00:17:57.856 | 99.00th=[32113], 99.50th=[33162], 99.90th=[41681], 99.95th=[41681], 00:17:57.856 | 99.99th=[43254] 00:17:57.856 bw ( KiB/s): min=14032, max=20536, per=24.30%, avg=17284.00, stdev=4599.02, samples=2 00:17:57.856 iops : min= 3508, max= 5134, avg=4321.00, stdev=1149.76, samples=2 00:17:57.856 lat (msec) : 4=0.32%, 10=43.67%, 20=32.70%, 50=23.31% 00:17:57.856 cpu : usr=2.48%, sys=5.16%, ctx=509, majf=0, minf=1 00:17:57.856 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:17:57.856 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:57.856 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:57.856 issued rwts: total=4096,4448,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:57.856 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:57.856 job2: (groupid=0, jobs=1): err= 0: pid=384792: Mon Dec 16 14:22:12 2024 00:17:57.856 read: IOPS=3752, BW=14.7MiB/s (15.4MB/s)(14.7MiB/1005msec) 00:17:57.856 slat (nsec): min=1374, max=16172k, avg=108042.42, stdev=859987.22 00:17:57.856 clat (usec): min=1626, max=56868, avg=15087.02, stdev=6071.56 00:17:57.856 lat (usec): min=3476, max=62379, avg=15195.06, stdev=6143.04 00:17:57.856 clat percentiles (usec): 00:17:57.856 | 1.00th=[ 5080], 5.00th=[ 6915], 10.00th=[ 8094], 20.00th=[10945], 00:17:57.856 | 30.00th=[11731], 40.00th=[13042], 50.00th=[14615], 60.00th=[15270], 00:17:57.856 | 70.00th=[17171], 80.00th=[18220], 90.00th=[22152], 95.00th=[26346], 00:17:57.856 | 99.00th=[32113], 99.50th=[41157], 99.90th=[52167], 99.95th=[52167], 00:17:57.856 | 99.99th=[56886] 00:17:57.856 write: IOPS=4075, BW=15.9MiB/s (16.7MB/s)(16.0MiB/1005msec); 0 zone resets 00:17:57.856 slat (usec): min=2, max=9961, avg=131.90, stdev=764.63 00:17:57.856 clat (usec): min=1501, max=43845, avg=17085.14, stdev=7512.69 00:17:57.856 lat (usec): min=1528, max=44870, avg=17217.03, stdev=7574.86 00:17:57.856 clat percentiles (usec): 00:17:57.856 | 1.00th=[ 5342], 5.00th=[ 7046], 10.00th=[ 9765], 20.00th=[11469], 00:17:57.856 | 30.00th=[12649], 40.00th=[13960], 50.00th=[15139], 60.00th=[16319], 00:17:57.856 | 70.00th=[19792], 80.00th=[22938], 90.00th=[26608], 95.00th=[33424], 00:17:57.856 | 99.00th=[40633], 99.50th=[42206], 99.90th=[43779], 99.95th=[43779], 00:17:57.856 | 99.99th=[43779] 00:17:57.856 bw ( KiB/s): min=14344, max=18424, per=23.03%, avg=16384.00, stdev=2885.00, samples=2 00:17:57.856 iops : min= 3586, max= 4606, avg=4096.00, stdev=721.25, samples=2 00:17:57.856 lat (msec) : 2=0.04%, 4=0.46%, 10=11.97%, 20=64.62%, 50=22.69% 00:17:57.856 lat (msec) : 100=0.22% 00:17:57.856 cpu : usr=3.38%, sys=3.68%, ctx=296, majf=0, minf=1 00:17:57.857 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:17:57.857 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:57.857 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:57.857 issued rwts: total=3771,4096,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:57.857 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:57.857 job3: (groupid=0, jobs=1): err= 0: pid=384803: Mon Dec 16 14:22:12 2024 00:17:57.857 read: IOPS=3125, BW=12.2MiB/s (12.8MB/s)(12.3MiB/1006msec) 00:17:57.857 slat (nsec): min=1115, max=46751k, avg=154914.73, stdev=1175213.56 00:17:57.857 clat (usec): min=987, max=81410, avg=19607.40, stdev=14401.53 00:17:57.857 lat (usec): min=5721, max=81416, avg=19762.31, stdev=14461.89 00:17:57.857 clat percentiles (usec): 00:17:57.857 | 1.00th=[ 6456], 5.00th=[ 8586], 10.00th=[ 9372], 20.00th=[10683], 00:17:57.857 | 30.00th=[10945], 40.00th=[11731], 50.00th=[15270], 60.00th=[17433], 00:17:57.857 | 70.00th=[21890], 80.00th=[25035], 90.00th=[32900], 95.00th=[43779], 00:17:57.857 | 99.00th=[80217], 99.50th=[80217], 99.90th=[81265], 99.95th=[81265], 00:17:57.857 | 99.99th=[81265] 00:17:57.857 write: IOPS=3562, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1006msec); 0 zone resets 00:17:57.857 slat (nsec): min=1984, max=8838.5k, avg=139772.53, stdev=745956.55 00:17:57.857 clat (usec): min=7368, max=41918, avg=18278.95, stdev=7488.94 00:17:57.857 lat (usec): min=7409, max=41928, avg=18418.72, stdev=7523.27 00:17:57.857 clat percentiles (usec): 00:17:57.857 | 1.00th=[ 8848], 5.00th=[10290], 10.00th=[10814], 20.00th=[11076], 00:17:57.857 | 30.00th=[12387], 40.00th=[14615], 50.00th=[17171], 60.00th=[18482], 00:17:57.857 | 70.00th=[20841], 80.00th=[24249], 90.00th=[31065], 95.00th=[33817], 00:17:57.857 | 99.00th=[39584], 99.50th=[39584], 99.90th=[41681], 99.95th=[41681], 00:17:57.857 | 99.99th=[41681] 00:17:57.857 bw ( KiB/s): min=12288, max=15936, per=19.84%, avg=14112.00, stdev=2579.53, samples=2 00:17:57.857 iops : min= 3072, max= 3984, avg=3528.00, stdev=644.88, samples=2 00:17:57.857 lat (usec) : 1000=0.01% 00:17:57.857 lat (msec) : 10=7.67%, 20=60.30%, 50=29.86%, 100=2.16% 00:17:57.857 cpu : usr=1.89%, sys=3.58%, ctx=395, majf=0, minf=1 00:17:57.857 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:17:57.857 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:17:57.857 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:17:57.857 issued rwts: total=3144,3584,0,0 short=0,0,0,0 dropped=0,0,0,0 00:17:57.857 latency : target=0, window=0, percentile=100.00%, depth=128 00:17:57.857 00:17:57.857 Run status group 0 (all jobs): 00:17:57.857 READ: bw=64.4MiB/s (67.6MB/s), 12.2MiB/s-21.8MiB/s (12.8MB/s-22.9MB/s), io=65.0MiB (68.2MB), run=1005-1009msec 00:17:57.857 WRITE: bw=69.5MiB/s (72.8MB/s), 13.9MiB/s-22.5MiB/s (14.6MB/s-23.6MB/s), io=70.1MiB (73.5MB), run=1005-1009msec 00:17:57.857 00:17:57.857 Disk stats (read/write): 00:17:57.857 nvme0n1: ios=4645/4775, merge=0/0, ticks=44217/50452, in_queue=94669, util=99.60% 00:17:57.857 nvme0n2: ios=2811/3072, merge=0/0, ticks=19366/15804, in_queue=35170, util=99.59% 00:17:57.857 nvme0n3: ios=3114/3287, merge=0/0, ticks=33144/34205, in_queue=67349, util=96.53% 00:17:57.857 nvme0n4: ios=2602/2767, merge=0/0, ticks=16362/13501, in_queue=29863, util=99.12% 00:17:57.857 14:22:12 -- target/fio.sh@55 -- # sync 00:17:57.857 14:22:12 -- target/fio.sh@59 -- # fio_pid=384910 00:17:57.857 14:22:12 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:17:57.857 14:22:12 -- target/fio.sh@61 -- # sleep 3 00:17:57.857 [global] 00:17:57.857 thread=1 00:17:57.857 invalidate=1 00:17:57.857 rw=read 00:17:57.857 time_based=1 00:17:57.857 runtime=10 00:17:57.857 ioengine=libaio 00:17:57.857 direct=1 00:17:57.857 bs=4096 00:17:57.857 iodepth=1 00:17:57.857 norandommap=1 00:17:57.857 numjobs=1 00:17:57.857 00:17:57.857 [job0] 00:17:57.857 filename=/dev/nvme0n1 00:17:57.857 [job1] 00:17:57.857 filename=/dev/nvme0n2 00:17:57.857 [job2] 00:17:57.857 filename=/dev/nvme0n3 00:17:57.857 [job3] 00:17:57.857 filename=/dev/nvme0n4 00:17:57.857 Could not set queue depth (nvme0n1) 00:17:57.857 Could not set queue depth (nvme0n2) 00:17:57.857 Could not set queue depth (nvme0n3) 00:17:57.857 Could not set queue depth (nvme0n4) 00:17:58.114 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:58.114 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:58.114 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:58.114 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:17:58.114 fio-3.35 00:17:58.114 Starting 4 threads 00:18:01.390 14:22:15 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:18:01.390 14:22:15 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:18:01.390 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=270336, buflen=4096 00:18:01.390 fio: pid=385197, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:18:01.390 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=294912, buflen=4096 00:18:01.390 fio: pid=385194, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:18:01.390 14:22:15 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:01.390 14:22:15 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:18:01.390 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=47214592, buflen=4096 00:18:01.390 fio: pid=385192, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:18:01.390 14:22:15 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:01.390 14:22:15 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:18:01.648 14:22:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:01.648 14:22:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:18:01.648 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=327680, buflen=4096 00:18:01.648 fio: pid=385193, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:18:01.648 00:18:01.648 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=385192: Mon Dec 16 14:22:16 2024 00:18:01.648 read: IOPS=3794, BW=14.8MiB/s (15.5MB/s)(45.0MiB/3038msec) 00:18:01.648 slat (usec): min=4, max=7618, avg= 9.64, stdev=98.44 00:18:01.648 clat (usec): min=168, max=42016, avg=250.15, stdev=1149.65 00:18:01.648 lat (usec): min=178, max=42039, avg=259.79, stdev=1154.34 00:18:01.648 clat percentiles (usec): 00:18:01.648 | 1.00th=[ 184], 5.00th=[ 188], 10.00th=[ 190], 20.00th=[ 196], 00:18:01.648 | 30.00th=[ 200], 40.00th=[ 204], 50.00th=[ 208], 60.00th=[ 219], 00:18:01.648 | 70.00th=[ 237], 80.00th=[ 247], 90.00th=[ 255], 95.00th=[ 260], 00:18:01.648 | 99.00th=[ 269], 99.50th=[ 273], 99.90th=[ 445], 99.95th=[41157], 00:18:01.648 | 99.99th=[42206] 00:18:01.648 bw ( KiB/s): min=15528, max=18768, per=100.00%, avg=16849.60, stdev=1281.59, samples=5 00:18:01.648 iops : min= 3882, max= 4692, avg=4212.40, stdev=320.40, samples=5 00:18:01.648 lat (usec) : 250=84.80%, 500=15.09%, 750=0.01% 00:18:01.648 lat (msec) : 2=0.01%, 50=0.08% 00:18:01.648 cpu : usr=1.42%, sys=6.78%, ctx=11531, majf=0, minf=2 00:18:01.648 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:01.648 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.648 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.648 issued rwts: total=11528,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:01.648 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:01.648 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=385193: Mon Dec 16 14:22:16 2024 00:18:01.648 read: IOPS=24, BW=97.9KiB/s (100kB/s)(320KiB/3269msec) 00:18:01.648 slat (usec): min=13, max=7740, avg=118.01, stdev=857.60 00:18:01.648 clat (usec): min=647, max=41250, avg=40467.58, stdev=4508.90 00:18:01.648 lat (usec): min=682, max=48991, avg=40586.78, stdev=4605.98 00:18:01.648 clat percentiles (usec): 00:18:01.648 | 1.00th=[ 652], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:18:01.648 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:18:01.648 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:18:01.648 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:18:01.648 | 99.99th=[41157] 00:18:01.648 bw ( KiB/s): min= 94, max= 104, per=0.68%, avg=98.33, stdev= 4.46, samples=6 00:18:01.648 iops : min= 23, max= 26, avg=24.50, stdev= 1.22, samples=6 00:18:01.648 lat (usec) : 750=1.23% 00:18:01.648 lat (msec) : 50=97.53% 00:18:01.648 cpu : usr=0.12%, sys=0.00%, ctx=83, majf=0, minf=1 00:18:01.648 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:01.648 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.648 complete : 0=1.2%, 4=98.8%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.648 issued rwts: total=81,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:01.648 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:01.648 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=385194: Mon Dec 16 14:22:16 2024 00:18:01.648 read: IOPS=25, BW=101KiB/s (103kB/s)(288KiB/2859msec) 00:18:01.648 slat (usec): min=8, max=4826, avg=89.11, stdev=562.21 00:18:01.648 clat (usec): min=364, max=42044, avg=39311.06, stdev=8168.04 00:18:01.648 lat (usec): min=390, max=46049, avg=39401.07, stdev=8202.40 00:18:01.648 clat percentiles (usec): 00:18:01.648 | 1.00th=[ 363], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:18:01.648 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:18:01.648 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:18:01.648 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:01.648 | 99.99th=[42206] 00:18:01.648 bw ( KiB/s): min= 96, max= 104, per=0.70%, avg=100.80, stdev= 4.38, samples=5 00:18:01.648 iops : min= 24, max= 26, avg=25.20, stdev= 1.10, samples=5 00:18:01.648 lat (usec) : 500=4.11% 00:18:01.648 lat (msec) : 50=94.52% 00:18:01.648 cpu : usr=0.10%, sys=0.00%, ctx=75, majf=0, minf=2 00:18:01.648 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:01.648 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.648 complete : 0=1.4%, 4=98.6%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.648 issued rwts: total=73,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:01.648 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:01.648 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=385197: Mon Dec 16 14:22:16 2024 00:18:01.648 read: IOPS=24, BW=98.1KiB/s (100kB/s)(264KiB/2690msec) 00:18:01.648 slat (nsec): min=11745, max=60924, avg=23881.93, stdev=4985.58 00:18:01.648 clat (usec): min=517, max=42032, avg=40398.45, stdev=4989.85 00:18:01.648 lat (usec): min=578, max=42054, avg=40422.33, stdev=4985.23 00:18:01.648 clat percentiles (usec): 00:18:01.648 | 1.00th=[ 519], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:18:01.648 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:18:01.648 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:18:01.648 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:18:01.648 | 99.99th=[42206] 00:18:01.648 bw ( KiB/s): min= 96, max= 104, per=0.67%, avg=97.60, stdev= 3.58, samples=5 00:18:01.648 iops : min= 24, max= 26, avg=24.40, stdev= 0.89, samples=5 00:18:01.648 lat (usec) : 750=1.49% 00:18:01.648 lat (msec) : 50=97.01% 00:18:01.648 cpu : usr=0.11%, sys=0.00%, ctx=68, majf=0, minf=2 00:18:01.648 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:18:01.648 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.648 complete : 0=1.5%, 4=98.5%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:18:01.648 issued rwts: total=67,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:18:01.648 latency : target=0, window=0, percentile=100.00%, depth=1 00:18:01.648 00:18:01.648 Run status group 0 (all jobs): 00:18:01.648 READ: bw=14.0MiB/s (14.7MB/s), 97.9KiB/s-14.8MiB/s (100kB/s-15.5MB/s), io=45.9MiB (48.1MB), run=2690-3269msec 00:18:01.648 00:18:01.648 Disk stats (read/write): 00:18:01.648 nvme0n1: ios=11549/0, merge=0/0, ticks=3154/0, in_queue=3154, util=99.03% 00:18:01.648 nvme0n2: ios=75/0, merge=0/0, ticks=3035/0, in_queue=3035, util=94.75% 00:18:01.648 nvme0n3: ios=113/0, merge=0/0, ticks=2979/0, in_queue=2979, util=98.87% 00:18:01.648 nvme0n4: ios=80/0, merge=0/0, ticks=3014/0, in_queue=3014, util=96.76% 00:18:01.905 14:22:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:01.905 14:22:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:18:02.163 14:22:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:02.163 14:22:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:18:02.163 14:22:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:02.163 14:22:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:18:02.420 14:22:16 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:18:02.420 14:22:16 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:18:02.677 14:22:17 -- target/fio.sh@69 -- # fio_status=0 00:18:02.677 14:22:17 -- target/fio.sh@70 -- # wait 384910 00:18:02.677 14:22:17 -- target/fio.sh@70 -- # fio_status=4 00:18:02.677 14:22:17 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:18:02.677 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:18:02.677 14:22:17 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:18:02.677 14:22:17 -- common/autotest_common.sh@1208 -- # local i=0 00:18:02.677 14:22:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:18:02.677 14:22:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:02.677 14:22:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:18:02.677 14:22:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:18:02.677 14:22:17 -- common/autotest_common.sh@1220 -- # return 0 00:18:02.677 14:22:17 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:18:02.677 14:22:17 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:18:02.677 nvmf hotplug test: fio failed as expected 00:18:02.677 14:22:17 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:02.935 14:22:17 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:18:02.935 14:22:17 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:18:02.935 14:22:17 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:18:02.935 14:22:17 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:18:02.935 14:22:17 -- target/fio.sh@91 -- # nvmftestfini 00:18:02.935 14:22:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:02.935 14:22:17 -- nvmf/common.sh@116 -- # sync 00:18:02.935 14:22:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:02.935 14:22:17 -- nvmf/common.sh@119 -- # set +e 00:18:02.935 14:22:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:02.935 14:22:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:02.935 rmmod nvme_tcp 00:18:02.935 rmmod nvme_fabrics 00:18:02.935 rmmod nvme_keyring 00:18:02.935 14:22:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:02.935 14:22:17 -- nvmf/common.sh@123 -- # set -e 00:18:02.935 14:22:17 -- nvmf/common.sh@124 -- # return 0 00:18:02.935 14:22:17 -- nvmf/common.sh@477 -- # '[' -n 382150 ']' 00:18:02.935 14:22:17 -- nvmf/common.sh@478 -- # killprocess 382150 00:18:02.935 14:22:17 -- common/autotest_common.sh@936 -- # '[' -z 382150 ']' 00:18:02.935 14:22:17 -- common/autotest_common.sh@940 -- # kill -0 382150 00:18:02.935 14:22:17 -- common/autotest_common.sh@941 -- # uname 00:18:02.935 14:22:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:02.935 14:22:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 382150 00:18:03.193 14:22:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:03.193 14:22:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:03.193 14:22:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 382150' 00:18:03.193 killing process with pid 382150 00:18:03.193 14:22:17 -- common/autotest_common.sh@955 -- # kill 382150 00:18:03.193 14:22:17 -- common/autotest_common.sh@960 -- # wait 382150 00:18:03.193 14:22:17 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:03.193 14:22:17 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:03.193 14:22:17 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:03.193 14:22:17 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:03.193 14:22:17 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:03.193 14:22:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:03.193 14:22:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:03.193 14:22:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:05.725 14:22:19 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:05.725 00:18:05.725 real 0m26.703s 00:18:05.725 user 1m48.760s 00:18:05.725 sys 0m8.063s 00:18:05.725 14:22:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:05.725 14:22:19 -- common/autotest_common.sh@10 -- # set +x 00:18:05.725 ************************************ 00:18:05.725 END TEST nvmf_fio_target 00:18:05.725 ************************************ 00:18:05.725 14:22:19 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:18:05.725 14:22:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:05.725 14:22:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:05.725 14:22:19 -- common/autotest_common.sh@10 -- # set +x 00:18:05.725 ************************************ 00:18:05.725 START TEST nvmf_bdevio 00:18:05.725 ************************************ 00:18:05.725 14:22:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:18:05.725 * Looking for test storage... 00:18:05.725 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:05.725 14:22:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:05.725 14:22:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:05.725 14:22:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:05.725 14:22:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:05.725 14:22:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:05.725 14:22:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:05.725 14:22:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:05.725 14:22:19 -- scripts/common.sh@335 -- # IFS=.-: 00:18:05.725 14:22:19 -- scripts/common.sh@335 -- # read -ra ver1 00:18:05.725 14:22:19 -- scripts/common.sh@336 -- # IFS=.-: 00:18:05.725 14:22:19 -- scripts/common.sh@336 -- # read -ra ver2 00:18:05.725 14:22:19 -- scripts/common.sh@337 -- # local 'op=<' 00:18:05.725 14:22:19 -- scripts/common.sh@339 -- # ver1_l=2 00:18:05.725 14:22:19 -- scripts/common.sh@340 -- # ver2_l=1 00:18:05.725 14:22:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:05.725 14:22:19 -- scripts/common.sh@343 -- # case "$op" in 00:18:05.725 14:22:19 -- scripts/common.sh@344 -- # : 1 00:18:05.725 14:22:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:05.725 14:22:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:05.725 14:22:19 -- scripts/common.sh@364 -- # decimal 1 00:18:05.725 14:22:20 -- scripts/common.sh@352 -- # local d=1 00:18:05.725 14:22:20 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:05.725 14:22:20 -- scripts/common.sh@354 -- # echo 1 00:18:05.725 14:22:20 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:05.725 14:22:20 -- scripts/common.sh@365 -- # decimal 2 00:18:05.725 14:22:20 -- scripts/common.sh@352 -- # local d=2 00:18:05.725 14:22:20 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:05.725 14:22:20 -- scripts/common.sh@354 -- # echo 2 00:18:05.725 14:22:20 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:05.725 14:22:20 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:05.725 14:22:20 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:05.725 14:22:20 -- scripts/common.sh@367 -- # return 0 00:18:05.725 14:22:20 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:05.725 14:22:20 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:05.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.725 --rc genhtml_branch_coverage=1 00:18:05.725 --rc genhtml_function_coverage=1 00:18:05.725 --rc genhtml_legend=1 00:18:05.725 --rc geninfo_all_blocks=1 00:18:05.725 --rc geninfo_unexecuted_blocks=1 00:18:05.725 00:18:05.725 ' 00:18:05.725 14:22:20 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:05.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.725 --rc genhtml_branch_coverage=1 00:18:05.725 --rc genhtml_function_coverage=1 00:18:05.725 --rc genhtml_legend=1 00:18:05.725 --rc geninfo_all_blocks=1 00:18:05.725 --rc geninfo_unexecuted_blocks=1 00:18:05.725 00:18:05.725 ' 00:18:05.725 14:22:20 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:05.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.725 --rc genhtml_branch_coverage=1 00:18:05.725 --rc genhtml_function_coverage=1 00:18:05.725 --rc genhtml_legend=1 00:18:05.725 --rc geninfo_all_blocks=1 00:18:05.725 --rc geninfo_unexecuted_blocks=1 00:18:05.725 00:18:05.725 ' 00:18:05.725 14:22:20 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:05.725 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:05.725 --rc genhtml_branch_coverage=1 00:18:05.725 --rc genhtml_function_coverage=1 00:18:05.725 --rc genhtml_legend=1 00:18:05.725 --rc geninfo_all_blocks=1 00:18:05.725 --rc geninfo_unexecuted_blocks=1 00:18:05.725 00:18:05.725 ' 00:18:05.725 14:22:20 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:05.725 14:22:20 -- nvmf/common.sh@7 -- # uname -s 00:18:05.725 14:22:20 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:05.725 14:22:20 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:05.725 14:22:20 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:05.725 14:22:20 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:05.725 14:22:20 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:05.725 14:22:20 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:05.725 14:22:20 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:05.725 14:22:20 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:05.725 14:22:20 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:05.725 14:22:20 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:05.725 14:22:20 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:18:05.725 14:22:20 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:18:05.725 14:22:20 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:05.725 14:22:20 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:05.725 14:22:20 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:05.725 14:22:20 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:05.725 14:22:20 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:05.725 14:22:20 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:05.725 14:22:20 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:05.726 14:22:20 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.726 14:22:20 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.726 14:22:20 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.726 14:22:20 -- paths/export.sh@5 -- # export PATH 00:18:05.726 14:22:20 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:05.726 14:22:20 -- nvmf/common.sh@46 -- # : 0 00:18:05.726 14:22:20 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:05.726 14:22:20 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:05.726 14:22:20 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:05.726 14:22:20 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:05.726 14:22:20 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:05.726 14:22:20 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:05.726 14:22:20 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:05.726 14:22:20 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:05.726 14:22:20 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:05.726 14:22:20 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:05.726 14:22:20 -- target/bdevio.sh@14 -- # nvmftestinit 00:18:05.726 14:22:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:05.726 14:22:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:05.726 14:22:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:05.726 14:22:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:05.726 14:22:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:05.726 14:22:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:05.726 14:22:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:05.726 14:22:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:05.726 14:22:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:05.726 14:22:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:05.726 14:22:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:05.726 14:22:20 -- common/autotest_common.sh@10 -- # set +x 00:18:10.989 14:22:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:10.989 14:22:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:10.989 14:22:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:10.989 14:22:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:10.989 14:22:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:10.989 14:22:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:10.989 14:22:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:10.989 14:22:25 -- nvmf/common.sh@294 -- # net_devs=() 00:18:10.989 14:22:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:10.989 14:22:25 -- nvmf/common.sh@295 -- # e810=() 00:18:10.989 14:22:25 -- nvmf/common.sh@295 -- # local -ga e810 00:18:10.989 14:22:25 -- nvmf/common.sh@296 -- # x722=() 00:18:10.989 14:22:25 -- nvmf/common.sh@296 -- # local -ga x722 00:18:10.989 14:22:25 -- nvmf/common.sh@297 -- # mlx=() 00:18:10.989 14:22:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:10.989 14:22:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:10.989 14:22:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:10.989 14:22:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:10.989 14:22:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:10.989 14:22:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:10.989 14:22:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:18:10.989 Found 0000:af:00.0 (0x8086 - 0x159b) 00:18:10.989 14:22:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:10.989 14:22:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:18:10.989 Found 0000:af:00.1 (0x8086 - 0x159b) 00:18:10.989 14:22:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:10.989 14:22:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:10.989 14:22:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:10.989 14:22:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:10.989 14:22:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:10.989 14:22:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:18:10.989 Found net devices under 0000:af:00.0: cvl_0_0 00:18:10.989 14:22:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:10.989 14:22:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:10.989 14:22:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:10.989 14:22:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:10.989 14:22:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:10.989 14:22:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:18:10.989 Found net devices under 0000:af:00.1: cvl_0_1 00:18:10.989 14:22:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:10.989 14:22:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:10.989 14:22:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:10.989 14:22:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:10.989 14:22:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:10.989 14:22:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:10.989 14:22:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:10.989 14:22:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:10.989 14:22:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:10.989 14:22:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:10.989 14:22:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:10.989 14:22:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:10.989 14:22:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:10.989 14:22:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:10.989 14:22:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:10.989 14:22:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:10.989 14:22:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:10.989 14:22:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:10.989 14:22:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:10.989 14:22:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:10.989 14:22:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:10.989 14:22:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:10.989 14:22:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:10.989 14:22:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:10.989 14:22:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:10.990 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:10.990 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.433 ms 00:18:10.990 00:18:10.990 --- 10.0.0.2 ping statistics --- 00:18:10.990 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:10.990 rtt min/avg/max/mdev = 0.433/0.433/0.433/0.000 ms 00:18:10.990 14:22:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:10.990 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:10.990 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.213 ms 00:18:10.990 00:18:10.990 --- 10.0.0.1 ping statistics --- 00:18:10.990 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:10.990 rtt min/avg/max/mdev = 0.213/0.213/0.213/0.000 ms 00:18:11.247 14:22:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:11.247 14:22:25 -- nvmf/common.sh@410 -- # return 0 00:18:11.247 14:22:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:11.247 14:22:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:11.247 14:22:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:11.247 14:22:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:11.247 14:22:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:11.247 14:22:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:11.247 14:22:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:11.247 14:22:25 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:18:11.247 14:22:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:11.247 14:22:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:11.247 14:22:25 -- common/autotest_common.sh@10 -- # set +x 00:18:11.247 14:22:25 -- nvmf/common.sh@469 -- # nvmfpid=389386 00:18:11.247 14:22:25 -- nvmf/common.sh@470 -- # waitforlisten 389386 00:18:11.247 14:22:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:18:11.247 14:22:25 -- common/autotest_common.sh@829 -- # '[' -z 389386 ']' 00:18:11.247 14:22:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:11.247 14:22:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:11.247 14:22:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:11.247 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:11.247 14:22:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:11.247 14:22:25 -- common/autotest_common.sh@10 -- # set +x 00:18:11.247 [2024-12-16 14:22:25.639441] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:11.247 [2024-12-16 14:22:25.639489] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:11.247 EAL: No free 2048 kB hugepages reported on node 1 00:18:11.247 [2024-12-16 14:22:25.698935] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:11.247 [2024-12-16 14:22:25.774513] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:11.247 [2024-12-16 14:22:25.774621] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:11.247 [2024-12-16 14:22:25.774629] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:11.247 [2024-12-16 14:22:25.774636] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:11.247 [2024-12-16 14:22:25.774749] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:11.247 [2024-12-16 14:22:25.774876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:11.247 [2024-12-16 14:22:25.774938] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:11.247 [2024-12-16 14:22:25.774937] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:12.175 14:22:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:12.175 14:22:26 -- common/autotest_common.sh@862 -- # return 0 00:18:12.175 14:22:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:12.175 14:22:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:12.175 14:22:26 -- common/autotest_common.sh@10 -- # set +x 00:18:12.175 14:22:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:12.175 14:22:26 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:12.175 14:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:12.175 14:22:26 -- common/autotest_common.sh@10 -- # set +x 00:18:12.175 [2024-12-16 14:22:26.520237] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:12.175 14:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:12.175 14:22:26 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:12.175 14:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:12.175 14:22:26 -- common/autotest_common.sh@10 -- # set +x 00:18:12.175 Malloc0 00:18:12.175 14:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:12.175 14:22:26 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:12.175 14:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:12.175 14:22:26 -- common/autotest_common.sh@10 -- # set +x 00:18:12.175 14:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:12.175 14:22:26 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:12.175 14:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:12.175 14:22:26 -- common/autotest_common.sh@10 -- # set +x 00:18:12.175 14:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:12.175 14:22:26 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:12.175 14:22:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:12.175 14:22:26 -- common/autotest_common.sh@10 -- # set +x 00:18:12.175 [2024-12-16 14:22:26.575706] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:12.175 14:22:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:12.175 14:22:26 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:18:12.175 14:22:26 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:18:12.175 14:22:26 -- nvmf/common.sh@520 -- # config=() 00:18:12.175 14:22:26 -- nvmf/common.sh@520 -- # local subsystem config 00:18:12.175 14:22:26 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:12.175 14:22:26 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:12.175 { 00:18:12.175 "params": { 00:18:12.176 "name": "Nvme$subsystem", 00:18:12.176 "trtype": "$TEST_TRANSPORT", 00:18:12.176 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:12.176 "adrfam": "ipv4", 00:18:12.176 "trsvcid": "$NVMF_PORT", 00:18:12.176 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:12.176 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:12.176 "hdgst": ${hdgst:-false}, 00:18:12.176 "ddgst": ${ddgst:-false} 00:18:12.176 }, 00:18:12.176 "method": "bdev_nvme_attach_controller" 00:18:12.176 } 00:18:12.176 EOF 00:18:12.176 )") 00:18:12.176 14:22:26 -- nvmf/common.sh@542 -- # cat 00:18:12.176 14:22:26 -- nvmf/common.sh@544 -- # jq . 00:18:12.176 14:22:26 -- nvmf/common.sh@545 -- # IFS=, 00:18:12.176 14:22:26 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:12.176 "params": { 00:18:12.176 "name": "Nvme1", 00:18:12.176 "trtype": "tcp", 00:18:12.176 "traddr": "10.0.0.2", 00:18:12.176 "adrfam": "ipv4", 00:18:12.176 "trsvcid": "4420", 00:18:12.176 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:12.176 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:12.176 "hdgst": false, 00:18:12.176 "ddgst": false 00:18:12.176 }, 00:18:12.176 "method": "bdev_nvme_attach_controller" 00:18:12.176 }' 00:18:12.176 [2024-12-16 14:22:26.622267] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:12.176 [2024-12-16 14:22:26.622311] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid389635 ] 00:18:12.176 EAL: No free 2048 kB hugepages reported on node 1 00:18:12.176 [2024-12-16 14:22:26.677847] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:18:12.176 [2024-12-16 14:22:26.748493] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:12.176 [2024-12-16 14:22:26.748589] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:12.176 [2024-12-16 14:22:26.748591] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:12.740 [2024-12-16 14:22:27.021092] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:18:12.740 [2024-12-16 14:22:27.021126] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:18:12.740 I/O targets: 00:18:12.740 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:18:12.740 00:18:12.740 00:18:12.740 CUnit - A unit testing framework for C - Version 2.1-3 00:18:12.740 http://cunit.sourceforge.net/ 00:18:12.740 00:18:12.740 00:18:12.740 Suite: bdevio tests on: Nvme1n1 00:18:12.740 Test: blockdev write read block ...passed 00:18:12.740 Test: blockdev write zeroes read block ...passed 00:18:12.740 Test: blockdev write zeroes read no split ...passed 00:18:12.740 Test: blockdev write zeroes read split ...passed 00:18:12.740 Test: blockdev write zeroes read split partial ...passed 00:18:12.740 Test: blockdev reset ...[2024-12-16 14:22:27.215613] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:12.740 [2024-12-16 14:22:27.215662] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xc2e1f0 (9): Bad file descriptor 00:18:12.740 [2024-12-16 14:22:27.269864] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:12.740 passed 00:18:12.740 Test: blockdev write read 8 blocks ...passed 00:18:12.997 Test: blockdev write read size > 128k ...passed 00:18:12.997 Test: blockdev write read invalid size ...passed 00:18:12.997 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:18:12.997 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:18:12.997 Test: blockdev write read max offset ...passed 00:18:12.997 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:18:12.997 Test: blockdev writev readv 8 blocks ...passed 00:18:12.997 Test: blockdev writev readv 30 x 1block ...passed 00:18:12.997 Test: blockdev writev readv block ...passed 00:18:12.997 Test: blockdev writev readv size > 128k ...passed 00:18:12.997 Test: blockdev writev readv size > 128k in two iovs ...passed 00:18:12.997 Test: blockdev comparev and writev ...[2024-12-16 14:22:27.523490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:12.997 [2024-12-16 14:22:27.523517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:18:12.997 [2024-12-16 14:22:27.523530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:12.997 [2024-12-16 14:22:27.523539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:18:12.997 [2024-12-16 14:22:27.523780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:12.997 [2024-12-16 14:22:27.523792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:18:12.997 [2024-12-16 14:22:27.523803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:12.997 [2024-12-16 14:22:27.523809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:18:12.997 [2024-12-16 14:22:27.524064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:12.997 [2024-12-16 14:22:27.524076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:18:12.997 [2024-12-16 14:22:27.524088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:12.997 [2024-12-16 14:22:27.524095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:18:12.997 [2024-12-16 14:22:27.524325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:12.997 [2024-12-16 14:22:27.524341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:18:12.997 [2024-12-16 14:22:27.524353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:12.997 [2024-12-16 14:22:27.524360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:18:12.997 passed 00:18:13.254 Test: blockdev nvme passthru rw ...passed 00:18:13.254 Test: blockdev nvme passthru vendor specific ...[2024-12-16 14:22:27.606163] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:13.254 [2024-12-16 14:22:27.606179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:18:13.254 [2024-12-16 14:22:27.606294] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:13.254 [2024-12-16 14:22:27.606304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:18:13.254 [2024-12-16 14:22:27.606414] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:13.254 [2024-12-16 14:22:27.606423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:18:13.254 [2024-12-16 14:22:27.606527] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:13.254 [2024-12-16 14:22:27.606537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:18:13.254 passed 00:18:13.254 Test: blockdev nvme admin passthru ...passed 00:18:13.254 Test: blockdev copy ...passed 00:18:13.254 00:18:13.254 Run Summary: Type Total Ran Passed Failed Inactive 00:18:13.254 suites 1 1 n/a 0 0 00:18:13.254 tests 23 23 23 0 0 00:18:13.254 asserts 152 152 152 0 n/a 00:18:13.254 00:18:13.254 Elapsed time = 1.274 seconds 00:18:13.511 14:22:27 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:13.511 14:22:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:13.512 14:22:27 -- common/autotest_common.sh@10 -- # set +x 00:18:13.512 14:22:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:13.512 14:22:27 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:18:13.512 14:22:27 -- target/bdevio.sh@30 -- # nvmftestfini 00:18:13.512 14:22:27 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:13.512 14:22:27 -- nvmf/common.sh@116 -- # sync 00:18:13.512 14:22:27 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:13.512 14:22:27 -- nvmf/common.sh@119 -- # set +e 00:18:13.512 14:22:27 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:13.512 14:22:27 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:13.512 rmmod nvme_tcp 00:18:13.512 rmmod nvme_fabrics 00:18:13.512 rmmod nvme_keyring 00:18:13.512 14:22:27 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:13.512 14:22:27 -- nvmf/common.sh@123 -- # set -e 00:18:13.512 14:22:27 -- nvmf/common.sh@124 -- # return 0 00:18:13.512 14:22:27 -- nvmf/common.sh@477 -- # '[' -n 389386 ']' 00:18:13.512 14:22:27 -- nvmf/common.sh@478 -- # killprocess 389386 00:18:13.512 14:22:27 -- common/autotest_common.sh@936 -- # '[' -z 389386 ']' 00:18:13.512 14:22:27 -- common/autotest_common.sh@940 -- # kill -0 389386 00:18:13.512 14:22:27 -- common/autotest_common.sh@941 -- # uname 00:18:13.512 14:22:27 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:13.512 14:22:27 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 389386 00:18:13.512 14:22:27 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:18:13.512 14:22:27 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:18:13.512 14:22:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 389386' 00:18:13.512 killing process with pid 389386 00:18:13.512 14:22:27 -- common/autotest_common.sh@955 -- # kill 389386 00:18:13.512 14:22:27 -- common/autotest_common.sh@960 -- # wait 389386 00:18:13.770 14:22:28 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:13.770 14:22:28 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:13.770 14:22:28 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:13.770 14:22:28 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:13.770 14:22:28 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:13.770 14:22:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:13.770 14:22:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:13.770 14:22:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:16.306 14:22:30 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:16.306 00:18:16.306 real 0m10.400s 00:18:16.306 user 0m13.747s 00:18:16.306 sys 0m4.557s 00:18:16.306 14:22:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:16.306 14:22:30 -- common/autotest_common.sh@10 -- # set +x 00:18:16.306 ************************************ 00:18:16.306 END TEST nvmf_bdevio 00:18:16.306 ************************************ 00:18:16.306 14:22:30 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:18:16.306 14:22:30 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:18:16.306 14:22:30 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:18:16.306 14:22:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:16.306 14:22:30 -- common/autotest_common.sh@10 -- # set +x 00:18:16.306 ************************************ 00:18:16.306 START TEST nvmf_bdevio_no_huge 00:18:16.306 ************************************ 00:18:16.306 14:22:30 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:18:16.306 * Looking for test storage... 00:18:16.306 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:16.306 14:22:30 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:16.306 14:22:30 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:16.306 14:22:30 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:16.306 14:22:30 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:16.306 14:22:30 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:16.306 14:22:30 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:16.306 14:22:30 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:16.306 14:22:30 -- scripts/common.sh@335 -- # IFS=.-: 00:18:16.306 14:22:30 -- scripts/common.sh@335 -- # read -ra ver1 00:18:16.306 14:22:30 -- scripts/common.sh@336 -- # IFS=.-: 00:18:16.306 14:22:30 -- scripts/common.sh@336 -- # read -ra ver2 00:18:16.306 14:22:30 -- scripts/common.sh@337 -- # local 'op=<' 00:18:16.306 14:22:30 -- scripts/common.sh@339 -- # ver1_l=2 00:18:16.306 14:22:30 -- scripts/common.sh@340 -- # ver2_l=1 00:18:16.306 14:22:30 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:16.306 14:22:30 -- scripts/common.sh@343 -- # case "$op" in 00:18:16.306 14:22:30 -- scripts/common.sh@344 -- # : 1 00:18:16.306 14:22:30 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:16.306 14:22:30 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:16.306 14:22:30 -- scripts/common.sh@364 -- # decimal 1 00:18:16.306 14:22:30 -- scripts/common.sh@352 -- # local d=1 00:18:16.306 14:22:30 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:16.306 14:22:30 -- scripts/common.sh@354 -- # echo 1 00:18:16.306 14:22:30 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:16.306 14:22:30 -- scripts/common.sh@365 -- # decimal 2 00:18:16.306 14:22:30 -- scripts/common.sh@352 -- # local d=2 00:18:16.306 14:22:30 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:16.306 14:22:30 -- scripts/common.sh@354 -- # echo 2 00:18:16.306 14:22:30 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:16.306 14:22:30 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:16.306 14:22:30 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:16.306 14:22:30 -- scripts/common.sh@367 -- # return 0 00:18:16.306 14:22:30 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:16.306 14:22:30 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:16.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.306 --rc genhtml_branch_coverage=1 00:18:16.306 --rc genhtml_function_coverage=1 00:18:16.306 --rc genhtml_legend=1 00:18:16.306 --rc geninfo_all_blocks=1 00:18:16.306 --rc geninfo_unexecuted_blocks=1 00:18:16.306 00:18:16.306 ' 00:18:16.306 14:22:30 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:16.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.306 --rc genhtml_branch_coverage=1 00:18:16.306 --rc genhtml_function_coverage=1 00:18:16.306 --rc genhtml_legend=1 00:18:16.306 --rc geninfo_all_blocks=1 00:18:16.306 --rc geninfo_unexecuted_blocks=1 00:18:16.306 00:18:16.306 ' 00:18:16.306 14:22:30 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:16.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.306 --rc genhtml_branch_coverage=1 00:18:16.306 --rc genhtml_function_coverage=1 00:18:16.306 --rc genhtml_legend=1 00:18:16.306 --rc geninfo_all_blocks=1 00:18:16.306 --rc geninfo_unexecuted_blocks=1 00:18:16.306 00:18:16.306 ' 00:18:16.306 14:22:30 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:16.306 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:16.306 --rc genhtml_branch_coverage=1 00:18:16.306 --rc genhtml_function_coverage=1 00:18:16.306 --rc genhtml_legend=1 00:18:16.306 --rc geninfo_all_blocks=1 00:18:16.306 --rc geninfo_unexecuted_blocks=1 00:18:16.306 00:18:16.306 ' 00:18:16.306 14:22:30 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:16.306 14:22:30 -- nvmf/common.sh@7 -- # uname -s 00:18:16.306 14:22:30 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:16.306 14:22:30 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:16.306 14:22:30 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:16.306 14:22:30 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:16.306 14:22:30 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:16.306 14:22:30 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:16.306 14:22:30 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:16.306 14:22:30 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:16.306 14:22:30 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:16.306 14:22:30 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:16.306 14:22:30 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:18:16.306 14:22:30 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:18:16.306 14:22:30 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:16.306 14:22:30 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:16.306 14:22:30 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:16.306 14:22:30 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:16.306 14:22:30 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:16.306 14:22:30 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:16.306 14:22:30 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:16.306 14:22:30 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.306 14:22:30 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.306 14:22:30 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.306 14:22:30 -- paths/export.sh@5 -- # export PATH 00:18:16.307 14:22:30 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:16.307 14:22:30 -- nvmf/common.sh@46 -- # : 0 00:18:16.307 14:22:30 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:16.307 14:22:30 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:16.307 14:22:30 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:16.307 14:22:30 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:16.307 14:22:30 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:16.307 14:22:30 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:16.307 14:22:30 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:16.307 14:22:30 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:16.307 14:22:30 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:16.307 14:22:30 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:16.307 14:22:30 -- target/bdevio.sh@14 -- # nvmftestinit 00:18:16.307 14:22:30 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:16.307 14:22:30 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:16.307 14:22:30 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:16.307 14:22:30 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:16.307 14:22:30 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:16.307 14:22:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:16.307 14:22:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:16.307 14:22:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:16.307 14:22:30 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:16.307 14:22:30 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:16.307 14:22:30 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:16.307 14:22:30 -- common/autotest_common.sh@10 -- # set +x 00:18:21.757 14:22:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:21.757 14:22:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:21.757 14:22:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:21.757 14:22:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:21.757 14:22:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:21.757 14:22:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:21.757 14:22:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:21.757 14:22:35 -- nvmf/common.sh@294 -- # net_devs=() 00:18:21.757 14:22:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:21.757 14:22:35 -- nvmf/common.sh@295 -- # e810=() 00:18:21.757 14:22:35 -- nvmf/common.sh@295 -- # local -ga e810 00:18:21.757 14:22:35 -- nvmf/common.sh@296 -- # x722=() 00:18:21.757 14:22:35 -- nvmf/common.sh@296 -- # local -ga x722 00:18:21.757 14:22:35 -- nvmf/common.sh@297 -- # mlx=() 00:18:21.757 14:22:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:21.757 14:22:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:21.757 14:22:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:21.757 14:22:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:21.757 14:22:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:21.757 14:22:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:21.757 14:22:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:18:21.757 Found 0000:af:00.0 (0x8086 - 0x159b) 00:18:21.757 14:22:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:21.757 14:22:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:18:21.757 Found 0000:af:00.1 (0x8086 - 0x159b) 00:18:21.757 14:22:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:21.757 14:22:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:21.757 14:22:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:21.757 14:22:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:21.757 14:22:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:21.757 14:22:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:18:21.757 Found net devices under 0000:af:00.0: cvl_0_0 00:18:21.757 14:22:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:21.757 14:22:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:21.757 14:22:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:21.757 14:22:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:21.757 14:22:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:21.757 14:22:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:18:21.757 Found net devices under 0000:af:00.1: cvl_0_1 00:18:21.757 14:22:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:21.757 14:22:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:21.757 14:22:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:21.757 14:22:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:21.757 14:22:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:21.757 14:22:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:21.757 14:22:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:21.757 14:22:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:21.757 14:22:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:21.757 14:22:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:21.757 14:22:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:21.757 14:22:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:21.757 14:22:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:21.757 14:22:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:21.757 14:22:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:21.757 14:22:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:21.757 14:22:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:21.757 14:22:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:21.757 14:22:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:21.757 14:22:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:21.757 14:22:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:21.757 14:22:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:21.757 14:22:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:21.757 14:22:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:21.757 14:22:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:21.757 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:21.757 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.411 ms 00:18:21.757 00:18:21.757 --- 10.0.0.2 ping statistics --- 00:18:21.757 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:21.757 rtt min/avg/max/mdev = 0.411/0.411/0.411/0.000 ms 00:18:21.758 14:22:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:21.758 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:21.758 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.206 ms 00:18:21.758 00:18:21.758 --- 10.0.0.1 ping statistics --- 00:18:21.758 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:21.758 rtt min/avg/max/mdev = 0.206/0.206/0.206/0.000 ms 00:18:21.758 14:22:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:21.758 14:22:35 -- nvmf/common.sh@410 -- # return 0 00:18:21.758 14:22:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:21.758 14:22:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:21.758 14:22:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:21.758 14:22:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:21.758 14:22:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:21.758 14:22:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:21.758 14:22:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:21.758 14:22:35 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:18:21.758 14:22:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:21.758 14:22:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:21.758 14:22:35 -- common/autotest_common.sh@10 -- # set +x 00:18:21.758 14:22:35 -- nvmf/common.sh@469 -- # nvmfpid=393175 00:18:21.758 14:22:35 -- nvmf/common.sh@470 -- # waitforlisten 393175 00:18:21.758 14:22:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:18:21.758 14:22:35 -- common/autotest_common.sh@829 -- # '[' -z 393175 ']' 00:18:21.758 14:22:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:21.758 14:22:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:21.758 14:22:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:21.758 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:21.758 14:22:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:21.758 14:22:35 -- common/autotest_common.sh@10 -- # set +x 00:18:21.758 [2024-12-16 14:22:35.948280] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:21.758 [2024-12-16 14:22:35.948343] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:18:21.758 [2024-12-16 14:22:36.014278] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:21.758 [2024-12-16 14:22:36.097071] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:21.758 [2024-12-16 14:22:36.097173] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:21.758 [2024-12-16 14:22:36.097180] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:21.758 [2024-12-16 14:22:36.097186] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:21.758 [2024-12-16 14:22:36.097298] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:21.758 [2024-12-16 14:22:36.097403] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:21.758 [2024-12-16 14:22:36.097511] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:21.758 [2024-12-16 14:22:36.097513] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:22.322 14:22:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:22.322 14:22:36 -- common/autotest_common.sh@862 -- # return 0 00:18:22.322 14:22:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:22.322 14:22:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:22.322 14:22:36 -- common/autotest_common.sh@10 -- # set +x 00:18:22.322 14:22:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:22.322 14:22:36 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:22.322 14:22:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.322 14:22:36 -- common/autotest_common.sh@10 -- # set +x 00:18:22.322 [2024-12-16 14:22:36.788930] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:22.322 14:22:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.322 14:22:36 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:22.322 14:22:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.322 14:22:36 -- common/autotest_common.sh@10 -- # set +x 00:18:22.322 Malloc0 00:18:22.322 14:22:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.322 14:22:36 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:22.322 14:22:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.322 14:22:36 -- common/autotest_common.sh@10 -- # set +x 00:18:22.322 14:22:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.322 14:22:36 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:22.322 14:22:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.322 14:22:36 -- common/autotest_common.sh@10 -- # set +x 00:18:22.322 14:22:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.322 14:22:36 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:22.322 14:22:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:22.322 14:22:36 -- common/autotest_common.sh@10 -- # set +x 00:18:22.322 [2024-12-16 14:22:36.833194] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:22.322 14:22:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:22.322 14:22:36 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:18:22.322 14:22:36 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:18:22.322 14:22:36 -- nvmf/common.sh@520 -- # config=() 00:18:22.322 14:22:36 -- nvmf/common.sh@520 -- # local subsystem config 00:18:22.322 14:22:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:22.322 14:22:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:22.322 { 00:18:22.322 "params": { 00:18:22.322 "name": "Nvme$subsystem", 00:18:22.322 "trtype": "$TEST_TRANSPORT", 00:18:22.322 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:22.322 "adrfam": "ipv4", 00:18:22.322 "trsvcid": "$NVMF_PORT", 00:18:22.322 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:22.322 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:22.322 "hdgst": ${hdgst:-false}, 00:18:22.322 "ddgst": ${ddgst:-false} 00:18:22.322 }, 00:18:22.322 "method": "bdev_nvme_attach_controller" 00:18:22.322 } 00:18:22.322 EOF 00:18:22.322 )") 00:18:22.322 14:22:36 -- nvmf/common.sh@542 -- # cat 00:18:22.322 14:22:36 -- nvmf/common.sh@544 -- # jq . 00:18:22.322 14:22:36 -- nvmf/common.sh@545 -- # IFS=, 00:18:22.322 14:22:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:22.322 "params": { 00:18:22.322 "name": "Nvme1", 00:18:22.322 "trtype": "tcp", 00:18:22.322 "traddr": "10.0.0.2", 00:18:22.322 "adrfam": "ipv4", 00:18:22.322 "trsvcid": "4420", 00:18:22.322 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:22.322 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:22.322 "hdgst": false, 00:18:22.322 "ddgst": false 00:18:22.322 }, 00:18:22.322 "method": "bdev_nvme_attach_controller" 00:18:22.322 }' 00:18:22.322 [2024-12-16 14:22:36.880617] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:22.322 [2024-12-16 14:22:36.880664] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid393388 ] 00:18:22.579 [2024-12-16 14:22:36.940255] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:18:22.579 [2024-12-16 14:22:37.022947] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:22.579 [2024-12-16 14:22:37.023047] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:22.579 [2024-12-16 14:22:37.023048] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:22.836 [2024-12-16 14:22:37.322474] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:18:22.836 [2024-12-16 14:22:37.322503] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:18:22.836 I/O targets: 00:18:22.836 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:18:22.836 00:18:22.836 00:18:22.836 CUnit - A unit testing framework for C - Version 2.1-3 00:18:22.836 http://cunit.sourceforge.net/ 00:18:22.836 00:18:22.836 00:18:22.836 Suite: bdevio tests on: Nvme1n1 00:18:22.836 Test: blockdev write read block ...passed 00:18:23.093 Test: blockdev write zeroes read block ...passed 00:18:23.093 Test: blockdev write zeroes read no split ...passed 00:18:23.093 Test: blockdev write zeroes read split ...passed 00:18:23.093 Test: blockdev write zeroes read split partial ...passed 00:18:23.093 Test: blockdev reset ...[2024-12-16 14:22:37.483053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:18:23.093 [2024-12-16 14:22:37.483107] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2412240 (9): Bad file descriptor 00:18:23.093 [2024-12-16 14:22:37.621857] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:18:23.093 passed 00:18:23.093 Test: blockdev write read 8 blocks ...passed 00:18:23.093 Test: blockdev write read size > 128k ...passed 00:18:23.093 Test: blockdev write read invalid size ...passed 00:18:23.093 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:18:23.093 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:18:23.093 Test: blockdev write read max offset ...passed 00:18:23.350 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:18:23.350 Test: blockdev writev readv 8 blocks ...passed 00:18:23.350 Test: blockdev writev readv 30 x 1block ...passed 00:18:23.350 Test: blockdev writev readv block ...passed 00:18:23.350 Test: blockdev writev readv size > 128k ...passed 00:18:23.350 Test: blockdev writev readv size > 128k in two iovs ...passed 00:18:23.350 Test: blockdev comparev and writev ...[2024-12-16 14:22:37.793361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:23.350 [2024-12-16 14:22:37.793388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.793400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:23.350 [2024-12-16 14:22:37.793408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.793642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:23.350 [2024-12-16 14:22:37.793653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.793665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:23.350 [2024-12-16 14:22:37.793672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.793914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:23.350 [2024-12-16 14:22:37.793924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.793935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:23.350 [2024-12-16 14:22:37.793943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.794171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:23.350 [2024-12-16 14:22:37.794181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.794192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:18:23.350 [2024-12-16 14:22:37.794199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:18:23.350 passed 00:18:23.350 Test: blockdev nvme passthru rw ...passed 00:18:23.350 Test: blockdev nvme passthru vendor specific ...[2024-12-16 14:22:37.876152] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:23.350 [2024-12-16 14:22:37.876168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.876279] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:23.350 [2024-12-16 14:22:37.876289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.876403] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:23.350 [2024-12-16 14:22:37.876413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:18:23.350 [2024-12-16 14:22:37.876524] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:18:23.350 [2024-12-16 14:22:37.876535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:18:23.350 passed 00:18:23.350 Test: blockdev nvme admin passthru ...passed 00:18:23.607 Test: blockdev copy ...passed 00:18:23.607 00:18:23.607 Run Summary: Type Total Ran Passed Failed Inactive 00:18:23.607 suites 1 1 n/a 0 0 00:18:23.607 tests 23 23 23 0 0 00:18:23.607 asserts 152 152 152 0 n/a 00:18:23.607 00:18:23.607 Elapsed time = 1.226 seconds 00:18:23.865 14:22:38 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:23.865 14:22:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.865 14:22:38 -- common/autotest_common.sh@10 -- # set +x 00:18:23.865 14:22:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.865 14:22:38 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:18:23.865 14:22:38 -- target/bdevio.sh@30 -- # nvmftestfini 00:18:23.865 14:22:38 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:23.865 14:22:38 -- nvmf/common.sh@116 -- # sync 00:18:23.865 14:22:38 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:23.865 14:22:38 -- nvmf/common.sh@119 -- # set +e 00:18:23.865 14:22:38 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:23.865 14:22:38 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:23.865 rmmod nvme_tcp 00:18:23.865 rmmod nvme_fabrics 00:18:23.865 rmmod nvme_keyring 00:18:23.865 14:22:38 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:23.865 14:22:38 -- nvmf/common.sh@123 -- # set -e 00:18:23.865 14:22:38 -- nvmf/common.sh@124 -- # return 0 00:18:23.865 14:22:38 -- nvmf/common.sh@477 -- # '[' -n 393175 ']' 00:18:23.865 14:22:38 -- nvmf/common.sh@478 -- # killprocess 393175 00:18:23.865 14:22:38 -- common/autotest_common.sh@936 -- # '[' -z 393175 ']' 00:18:23.865 14:22:38 -- common/autotest_common.sh@940 -- # kill -0 393175 00:18:23.865 14:22:38 -- common/autotest_common.sh@941 -- # uname 00:18:23.865 14:22:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:23.865 14:22:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 393175 00:18:23.865 14:22:38 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:18:23.865 14:22:38 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:18:23.865 14:22:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 393175' 00:18:23.865 killing process with pid 393175 00:18:23.865 14:22:38 -- common/autotest_common.sh@955 -- # kill 393175 00:18:23.865 14:22:38 -- common/autotest_common.sh@960 -- # wait 393175 00:18:24.122 14:22:38 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:24.122 14:22:38 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:24.122 14:22:38 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:24.122 14:22:38 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:24.122 14:22:38 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:24.122 14:22:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:24.122 14:22:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:24.122 14:22:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:26.653 14:22:40 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:26.653 00:18:26.653 real 0m10.457s 00:18:26.653 user 0m14.335s 00:18:26.653 sys 0m4.831s 00:18:26.653 14:22:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:26.653 14:22:40 -- common/autotest_common.sh@10 -- # set +x 00:18:26.653 ************************************ 00:18:26.653 END TEST nvmf_bdevio_no_huge 00:18:26.653 ************************************ 00:18:26.653 14:22:40 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:18:26.653 14:22:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:26.653 14:22:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:26.653 14:22:40 -- common/autotest_common.sh@10 -- # set +x 00:18:26.653 ************************************ 00:18:26.653 START TEST nvmf_tls 00:18:26.653 ************************************ 00:18:26.653 14:22:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:18:26.653 * Looking for test storage... 00:18:26.653 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:26.653 14:22:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:26.653 14:22:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:26.653 14:22:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:26.653 14:22:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:26.653 14:22:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:26.653 14:22:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:26.653 14:22:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:26.653 14:22:40 -- scripts/common.sh@335 -- # IFS=.-: 00:18:26.653 14:22:40 -- scripts/common.sh@335 -- # read -ra ver1 00:18:26.653 14:22:40 -- scripts/common.sh@336 -- # IFS=.-: 00:18:26.653 14:22:40 -- scripts/common.sh@336 -- # read -ra ver2 00:18:26.653 14:22:40 -- scripts/common.sh@337 -- # local 'op=<' 00:18:26.653 14:22:40 -- scripts/common.sh@339 -- # ver1_l=2 00:18:26.653 14:22:40 -- scripts/common.sh@340 -- # ver2_l=1 00:18:26.653 14:22:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:26.653 14:22:40 -- scripts/common.sh@343 -- # case "$op" in 00:18:26.653 14:22:40 -- scripts/common.sh@344 -- # : 1 00:18:26.653 14:22:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:26.653 14:22:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:26.653 14:22:40 -- scripts/common.sh@364 -- # decimal 1 00:18:26.653 14:22:40 -- scripts/common.sh@352 -- # local d=1 00:18:26.653 14:22:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:26.653 14:22:40 -- scripts/common.sh@354 -- # echo 1 00:18:26.653 14:22:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:26.654 14:22:40 -- scripts/common.sh@365 -- # decimal 2 00:18:26.654 14:22:40 -- scripts/common.sh@352 -- # local d=2 00:18:26.654 14:22:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:26.654 14:22:40 -- scripts/common.sh@354 -- # echo 2 00:18:26.654 14:22:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:26.654 14:22:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:26.654 14:22:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:26.654 14:22:40 -- scripts/common.sh@367 -- # return 0 00:18:26.654 14:22:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:26.654 14:22:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:26.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.654 --rc genhtml_branch_coverage=1 00:18:26.654 --rc genhtml_function_coverage=1 00:18:26.654 --rc genhtml_legend=1 00:18:26.654 --rc geninfo_all_blocks=1 00:18:26.654 --rc geninfo_unexecuted_blocks=1 00:18:26.654 00:18:26.654 ' 00:18:26.654 14:22:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:26.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.654 --rc genhtml_branch_coverage=1 00:18:26.654 --rc genhtml_function_coverage=1 00:18:26.654 --rc genhtml_legend=1 00:18:26.654 --rc geninfo_all_blocks=1 00:18:26.654 --rc geninfo_unexecuted_blocks=1 00:18:26.654 00:18:26.654 ' 00:18:26.654 14:22:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:26.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.654 --rc genhtml_branch_coverage=1 00:18:26.654 --rc genhtml_function_coverage=1 00:18:26.654 --rc genhtml_legend=1 00:18:26.654 --rc geninfo_all_blocks=1 00:18:26.654 --rc geninfo_unexecuted_blocks=1 00:18:26.654 00:18:26.654 ' 00:18:26.654 14:22:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:26.654 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:26.654 --rc genhtml_branch_coverage=1 00:18:26.654 --rc genhtml_function_coverage=1 00:18:26.654 --rc genhtml_legend=1 00:18:26.654 --rc geninfo_all_blocks=1 00:18:26.654 --rc geninfo_unexecuted_blocks=1 00:18:26.654 00:18:26.654 ' 00:18:26.654 14:22:40 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:26.654 14:22:40 -- nvmf/common.sh@7 -- # uname -s 00:18:26.654 14:22:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:26.654 14:22:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:26.654 14:22:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:26.654 14:22:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:26.654 14:22:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:26.654 14:22:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:26.654 14:22:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:26.654 14:22:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:26.654 14:22:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:26.654 14:22:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:26.654 14:22:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:18:26.654 14:22:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:18:26.654 14:22:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:26.654 14:22:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:26.654 14:22:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:26.654 14:22:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:26.654 14:22:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:26.654 14:22:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:26.654 14:22:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:26.654 14:22:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.654 14:22:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.654 14:22:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.654 14:22:40 -- paths/export.sh@5 -- # export PATH 00:18:26.654 14:22:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:26.654 14:22:40 -- nvmf/common.sh@46 -- # : 0 00:18:26.654 14:22:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:26.654 14:22:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:26.654 14:22:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:26.654 14:22:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:26.654 14:22:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:26.654 14:22:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:26.654 14:22:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:26.654 14:22:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:26.654 14:22:40 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:26.654 14:22:40 -- target/tls.sh@71 -- # nvmftestinit 00:18:26.654 14:22:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:26.654 14:22:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:26.654 14:22:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:26.654 14:22:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:26.654 14:22:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:26.654 14:22:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:26.654 14:22:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:26.654 14:22:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:26.654 14:22:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:26.654 14:22:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:26.654 14:22:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:26.654 14:22:40 -- common/autotest_common.sh@10 -- # set +x 00:18:31.915 14:22:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:31.915 14:22:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:31.915 14:22:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:31.915 14:22:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:31.915 14:22:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:31.915 14:22:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:31.915 14:22:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:31.915 14:22:45 -- nvmf/common.sh@294 -- # net_devs=() 00:18:31.915 14:22:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:31.915 14:22:45 -- nvmf/common.sh@295 -- # e810=() 00:18:31.915 14:22:45 -- nvmf/common.sh@295 -- # local -ga e810 00:18:31.915 14:22:45 -- nvmf/common.sh@296 -- # x722=() 00:18:31.915 14:22:45 -- nvmf/common.sh@296 -- # local -ga x722 00:18:31.915 14:22:45 -- nvmf/common.sh@297 -- # mlx=() 00:18:31.915 14:22:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:31.915 14:22:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:31.915 14:22:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:31.915 14:22:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:31.915 14:22:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:31.915 14:22:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:31.915 14:22:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:18:31.915 Found 0000:af:00.0 (0x8086 - 0x159b) 00:18:31.915 14:22:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:31.915 14:22:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:18:31.915 Found 0000:af:00.1 (0x8086 - 0x159b) 00:18:31.915 14:22:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:31.915 14:22:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:31.915 14:22:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:31.915 14:22:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:31.915 14:22:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:31.915 14:22:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:18:31.915 Found net devices under 0000:af:00.0: cvl_0_0 00:18:31.915 14:22:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:31.915 14:22:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:31.915 14:22:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:31.915 14:22:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:31.915 14:22:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:31.915 14:22:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:18:31.915 Found net devices under 0000:af:00.1: cvl_0_1 00:18:31.915 14:22:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:31.915 14:22:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:31.915 14:22:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:31.915 14:22:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:31.915 14:22:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:31.915 14:22:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:31.916 14:22:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:31.916 14:22:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:31.916 14:22:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:31.916 14:22:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:31.916 14:22:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:31.916 14:22:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:31.916 14:22:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:31.916 14:22:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:31.916 14:22:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:31.916 14:22:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:31.916 14:22:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:31.916 14:22:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:31.916 14:22:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:31.916 14:22:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:31.916 14:22:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:31.916 14:22:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:31.916 14:22:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:31.916 14:22:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:31.916 14:22:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:31.916 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:31.916 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.443 ms 00:18:31.916 00:18:31.916 --- 10.0.0.2 ping statistics --- 00:18:31.916 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:31.916 rtt min/avg/max/mdev = 0.443/0.443/0.443/0.000 ms 00:18:31.916 14:22:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:31.916 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:31.916 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.217 ms 00:18:31.916 00:18:31.916 --- 10.0.0.1 ping statistics --- 00:18:31.916 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:31.916 rtt min/avg/max/mdev = 0.217/0.217/0.217/0.000 ms 00:18:31.916 14:22:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:31.916 14:22:46 -- nvmf/common.sh@410 -- # return 0 00:18:31.916 14:22:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:31.916 14:22:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:31.916 14:22:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:31.916 14:22:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:31.916 14:22:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:31.916 14:22:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:31.916 14:22:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:31.916 14:22:46 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:18:31.916 14:22:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:31.916 14:22:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:31.916 14:22:46 -- common/autotest_common.sh@10 -- # set +x 00:18:31.916 14:22:46 -- nvmf/common.sh@469 -- # nvmfpid=397094 00:18:31.916 14:22:46 -- nvmf/common.sh@470 -- # waitforlisten 397094 00:18:31.916 14:22:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:18:31.916 14:22:46 -- common/autotest_common.sh@829 -- # '[' -z 397094 ']' 00:18:31.916 14:22:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:31.916 14:22:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:31.916 14:22:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:31.916 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:31.916 14:22:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:31.916 14:22:46 -- common/autotest_common.sh@10 -- # set +x 00:18:31.916 [2024-12-16 14:22:46.301582] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:31.916 [2024-12-16 14:22:46.301629] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:31.916 EAL: No free 2048 kB hugepages reported on node 1 00:18:31.916 [2024-12-16 14:22:46.361013] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:31.916 [2024-12-16 14:22:46.433814] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:31.916 [2024-12-16 14:22:46.433921] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:31.916 [2024-12-16 14:22:46.433937] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:31.916 [2024-12-16 14:22:46.433945] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:31.916 [2024-12-16 14:22:46.433962] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:32.849 14:22:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:32.849 14:22:47 -- common/autotest_common.sh@862 -- # return 0 00:18:32.849 14:22:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:32.849 14:22:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:32.849 14:22:47 -- common/autotest_common.sh@10 -- # set +x 00:18:32.849 14:22:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:32.849 14:22:47 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:18:32.849 14:22:47 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:18:32.849 true 00:18:32.849 14:22:47 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:32.849 14:22:47 -- target/tls.sh@82 -- # jq -r .tls_version 00:18:33.106 14:22:47 -- target/tls.sh@82 -- # version=0 00:18:33.106 14:22:47 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:18:33.106 14:22:47 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:18:33.107 14:22:47 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:33.107 14:22:47 -- target/tls.sh@90 -- # jq -r .tls_version 00:18:33.364 14:22:47 -- target/tls.sh@90 -- # version=13 00:18:33.364 14:22:47 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:18:33.364 14:22:47 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:18:33.622 14:22:48 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:33.622 14:22:48 -- target/tls.sh@98 -- # jq -r .tls_version 00:18:33.622 14:22:48 -- target/tls.sh@98 -- # version=7 00:18:33.622 14:22:48 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:18:33.881 14:22:48 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:18:33.881 14:22:48 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:33.881 14:22:48 -- target/tls.sh@105 -- # ktls=false 00:18:33.881 14:22:48 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:18:33.881 14:22:48 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:18:34.139 14:22:48 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:34.139 14:22:48 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:18:34.397 14:22:48 -- target/tls.sh@113 -- # ktls=true 00:18:34.397 14:22:48 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:18:34.397 14:22:48 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:18:34.397 14:22:48 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:18:34.397 14:22:48 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:18:34.655 14:22:49 -- target/tls.sh@121 -- # ktls=false 00:18:34.655 14:22:49 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:18:34.655 14:22:49 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:18:34.655 14:22:49 -- target/tls.sh@49 -- # local key hash crc 00:18:34.655 14:22:49 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:18:34.655 14:22:49 -- target/tls.sh@51 -- # hash=01 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # gzip -1 -c 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # tail -c8 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # head -c 4 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # crc='p$H�' 00:18:34.655 14:22:49 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:18:34.655 14:22:49 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:18:34.655 14:22:49 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:18:34.655 14:22:49 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:18:34.655 14:22:49 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:18:34.655 14:22:49 -- target/tls.sh@49 -- # local key hash crc 00:18:34.655 14:22:49 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:18:34.655 14:22:49 -- target/tls.sh@51 -- # hash=01 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # gzip -1 -c 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # tail -c8 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # head -c 4 00:18:34.655 14:22:49 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:18:34.655 14:22:49 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:18:34.655 14:22:49 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:18:34.655 14:22:49 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:18:34.655 14:22:49 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:18:34.655 14:22:49 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:34.655 14:22:49 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:34.655 14:22:49 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:18:34.655 14:22:49 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:18:34.655 14:22:49 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:34.655 14:22:49 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:34.655 14:22:49 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:18:34.913 14:22:49 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:18:35.171 14:22:49 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:35.171 14:22:49 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:35.171 14:22:49 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:18:35.171 [2024-12-16 14:22:49.666134] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:35.171 14:22:49 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:18:35.430 14:22:49 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:18:35.687 [2024-12-16 14:22:50.019072] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:18:35.687 [2024-12-16 14:22:50.019276] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:35.687 14:22:50 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:18:35.687 malloc0 00:18:35.687 14:22:50 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:35.945 14:22:50 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:36.202 14:22:50 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:36.202 EAL: No free 2048 kB hugepages reported on node 1 00:18:46.168 Initializing NVMe Controllers 00:18:46.168 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:18:46.168 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:18:46.168 Initialization complete. Launching workers. 00:18:46.168 ======================================================== 00:18:46.168 Latency(us) 00:18:46.168 Device Information : IOPS MiB/s Average min max 00:18:46.168 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 17577.97 68.66 3641.25 779.08 5351.14 00:18:46.168 ======================================================== 00:18:46.168 Total : 17577.97 68.66 3641.25 779.08 5351.14 00:18:46.168 00:18:46.168 14:23:00 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:46.168 14:23:00 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:46.168 14:23:00 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:46.168 14:23:00 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:46.168 14:23:00 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:18:46.168 14:23:00 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:46.168 14:23:00 -- target/tls.sh@28 -- # bdevperf_pid=399432 00:18:46.168 14:23:00 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:46.168 14:23:00 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:46.168 14:23:00 -- target/tls.sh@31 -- # waitforlisten 399432 /var/tmp/bdevperf.sock 00:18:46.168 14:23:00 -- common/autotest_common.sh@829 -- # '[' -z 399432 ']' 00:18:46.168 14:23:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:46.168 14:23:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:46.168 14:23:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:46.168 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:46.168 14:23:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:46.168 14:23:00 -- common/autotest_common.sh@10 -- # set +x 00:18:46.168 [2024-12-16 14:23:00.720065] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:46.168 [2024-12-16 14:23:00.720112] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid399432 ] 00:18:46.426 EAL: No free 2048 kB hugepages reported on node 1 00:18:46.426 [2024-12-16 14:23:00.768641] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:46.426 [2024-12-16 14:23:00.837241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:46.991 14:23:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:46.991 14:23:01 -- common/autotest_common.sh@862 -- # return 0 00:18:46.991 14:23:01 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:47.249 [2024-12-16 14:23:01.703198] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:47.249 TLSTESTn1 00:18:47.249 14:23:01 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:18:47.507 Running I/O for 10 seconds... 00:18:57.471 00:18:57.471 Latency(us) 00:18:57.471 [2024-12-16T13:23:12.045Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:57.471 [2024-12-16T13:23:12.045Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:18:57.471 Verification LBA range: start 0x0 length 0x2000 00:18:57.471 TLSTESTn1 : 10.01 6893.13 26.93 0.00 0.00 18548.33 4337.86 36200.84 00:18:57.471 [2024-12-16T13:23:12.045Z] =================================================================================================================== 00:18:57.471 [2024-12-16T13:23:12.045Z] Total : 6893.13 26.93 0.00 0.00 18548.33 4337.86 36200.84 00:18:57.471 0 00:18:57.471 14:23:11 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:57.471 14:23:11 -- target/tls.sh@45 -- # killprocess 399432 00:18:57.471 14:23:11 -- common/autotest_common.sh@936 -- # '[' -z 399432 ']' 00:18:57.471 14:23:11 -- common/autotest_common.sh@940 -- # kill -0 399432 00:18:57.471 14:23:11 -- common/autotest_common.sh@941 -- # uname 00:18:57.471 14:23:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:57.471 14:23:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 399432 00:18:57.471 14:23:11 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:57.471 14:23:11 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:57.471 14:23:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 399432' 00:18:57.471 killing process with pid 399432 00:18:57.471 14:23:11 -- common/autotest_common.sh@955 -- # kill 399432 00:18:57.471 Received shutdown signal, test time was about 10.000000 seconds 00:18:57.471 00:18:57.471 Latency(us) 00:18:57.471 [2024-12-16T13:23:12.045Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:57.471 [2024-12-16T13:23:12.045Z] =================================================================================================================== 00:18:57.471 [2024-12-16T13:23:12.045Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:57.471 14:23:11 -- common/autotest_common.sh@960 -- # wait 399432 00:18:57.729 14:23:12 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:57.729 14:23:12 -- common/autotest_common.sh@650 -- # local es=0 00:18:57.729 14:23:12 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:57.729 14:23:12 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:57.729 14:23:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:57.729 14:23:12 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:57.729 14:23:12 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:57.729 14:23:12 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:57.729 14:23:12 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:57.729 14:23:12 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:57.729 14:23:12 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:18:57.729 14:23:12 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:18:57.729 14:23:12 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:57.729 14:23:12 -- target/tls.sh@28 -- # bdevperf_pid=401368 00:18:57.729 14:23:12 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:57.729 14:23:12 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:57.729 14:23:12 -- target/tls.sh@31 -- # waitforlisten 401368 /var/tmp/bdevperf.sock 00:18:57.729 14:23:12 -- common/autotest_common.sh@829 -- # '[' -z 401368 ']' 00:18:57.729 14:23:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:57.729 14:23:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:57.729 14:23:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:57.729 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:57.729 14:23:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:57.729 14:23:12 -- common/autotest_common.sh@10 -- # set +x 00:18:57.729 [2024-12-16 14:23:12.232290] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:57.729 [2024-12-16 14:23:12.232336] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid401368 ] 00:18:57.729 EAL: No free 2048 kB hugepages reported on node 1 00:18:57.729 [2024-12-16 14:23:12.280503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:57.987 [2024-12-16 14:23:12.355010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:58.552 14:23:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:58.552 14:23:13 -- common/autotest_common.sh@862 -- # return 0 00:18:58.552 14:23:13 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:18:58.810 [2024-12-16 14:23:13.213791] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:18:58.810 [2024-12-16 14:23:13.222991] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:18:58.810 [2024-12-16 14:23:13.223827] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f8f7c0 (107): Transport endpoint is not connected 00:18:58.810 [2024-12-16 14:23:13.224820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f8f7c0 (9): Bad file descriptor 00:18:58.810 [2024-12-16 14:23:13.225822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:18:58.810 [2024-12-16 14:23:13.225832] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:18:58.810 [2024-12-16 14:23:13.225839] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:18:58.810 request: 00:18:58.810 { 00:18:58.810 "name": "TLSTEST", 00:18:58.810 "trtype": "tcp", 00:18:58.810 "traddr": "10.0.0.2", 00:18:58.810 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:58.810 "adrfam": "ipv4", 00:18:58.810 "trsvcid": "4420", 00:18:58.810 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:58.810 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:18:58.810 "method": "bdev_nvme_attach_controller", 00:18:58.810 "req_id": 1 00:18:58.810 } 00:18:58.810 Got JSON-RPC error response 00:18:58.810 response: 00:18:58.810 { 00:18:58.810 "code": -32602, 00:18:58.810 "message": "Invalid parameters" 00:18:58.810 } 00:18:58.810 14:23:13 -- target/tls.sh@36 -- # killprocess 401368 00:18:58.810 14:23:13 -- common/autotest_common.sh@936 -- # '[' -z 401368 ']' 00:18:58.810 14:23:13 -- common/autotest_common.sh@940 -- # kill -0 401368 00:18:58.810 14:23:13 -- common/autotest_common.sh@941 -- # uname 00:18:58.810 14:23:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:58.810 14:23:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 401368 00:18:58.810 14:23:13 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:18:58.810 14:23:13 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:18:58.810 14:23:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 401368' 00:18:58.810 killing process with pid 401368 00:18:58.810 14:23:13 -- common/autotest_common.sh@955 -- # kill 401368 00:18:58.810 Received shutdown signal, test time was about 10.000000 seconds 00:18:58.810 00:18:58.810 Latency(us) 00:18:58.810 [2024-12-16T13:23:13.384Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:58.810 [2024-12-16T13:23:13.384Z] =================================================================================================================== 00:18:58.810 [2024-12-16T13:23:13.384Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:18:58.810 14:23:13 -- common/autotest_common.sh@960 -- # wait 401368 00:18:59.068 14:23:13 -- target/tls.sh@37 -- # return 1 00:18:59.068 14:23:13 -- common/autotest_common.sh@653 -- # es=1 00:18:59.068 14:23:13 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:59.068 14:23:13 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:59.068 14:23:13 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:59.068 14:23:13 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:59.068 14:23:13 -- common/autotest_common.sh@650 -- # local es=0 00:18:59.068 14:23:13 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:59.068 14:23:13 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:18:59.068 14:23:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:59.068 14:23:13 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:18:59.068 14:23:13 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:59.068 14:23:13 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:18:59.068 14:23:13 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:18:59.068 14:23:13 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:18:59.068 14:23:13 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:18:59.068 14:23:13 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:18:59.068 14:23:13 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:59.068 14:23:13 -- target/tls.sh@28 -- # bdevperf_pid=401568 00:18:59.068 14:23:13 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:18:59.068 14:23:13 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:18:59.068 14:23:13 -- target/tls.sh@31 -- # waitforlisten 401568 /var/tmp/bdevperf.sock 00:18:59.068 14:23:13 -- common/autotest_common.sh@829 -- # '[' -z 401568 ']' 00:18:59.068 14:23:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:59.068 14:23:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:59.068 14:23:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:59.068 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:59.068 14:23:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:59.068 14:23:13 -- common/autotest_common.sh@10 -- # set +x 00:18:59.068 [2024-12-16 14:23:13.550123] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:59.068 [2024-12-16 14:23:13.550171] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid401568 ] 00:18:59.068 EAL: No free 2048 kB hugepages reported on node 1 00:18:59.068 [2024-12-16 14:23:13.603620] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:59.325 [2024-12-16 14:23:13.682342] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:59.890 14:23:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:59.890 14:23:14 -- common/autotest_common.sh@862 -- # return 0 00:18:59.890 14:23:14 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:00.148 [2024-12-16 14:23:14.505151] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:00.148 [2024-12-16 14:23:14.516228] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:19:00.148 [2024-12-16 14:23:14.516250] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:19:00.148 [2024-12-16 14:23:14.516275] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:00.148 [2024-12-16 14:23:14.517264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x25277c0 (107): Transport endpoint is not connected 00:19:00.148 [2024-12-16 14:23:14.518258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x25277c0 (9): Bad file descriptor 00:19:00.148 [2024-12-16 14:23:14.519259] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:19:00.148 [2024-12-16 14:23:14.519269] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:00.148 [2024-12-16 14:23:14.519277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:00.148 request: 00:19:00.148 { 00:19:00.148 "name": "TLSTEST", 00:19:00.148 "trtype": "tcp", 00:19:00.148 "traddr": "10.0.0.2", 00:19:00.148 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:19:00.148 "adrfam": "ipv4", 00:19:00.148 "trsvcid": "4420", 00:19:00.148 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:00.148 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:19:00.148 "method": "bdev_nvme_attach_controller", 00:19:00.148 "req_id": 1 00:19:00.148 } 00:19:00.148 Got JSON-RPC error response 00:19:00.148 response: 00:19:00.148 { 00:19:00.148 "code": -32602, 00:19:00.148 "message": "Invalid parameters" 00:19:00.148 } 00:19:00.148 14:23:14 -- target/tls.sh@36 -- # killprocess 401568 00:19:00.148 14:23:14 -- common/autotest_common.sh@936 -- # '[' -z 401568 ']' 00:19:00.148 14:23:14 -- common/autotest_common.sh@940 -- # kill -0 401568 00:19:00.148 14:23:14 -- common/autotest_common.sh@941 -- # uname 00:19:00.148 14:23:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:00.148 14:23:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 401568 00:19:00.148 14:23:14 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:00.148 14:23:14 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:00.148 14:23:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 401568' 00:19:00.148 killing process with pid 401568 00:19:00.148 14:23:14 -- common/autotest_common.sh@955 -- # kill 401568 00:19:00.148 Received shutdown signal, test time was about 10.000000 seconds 00:19:00.148 00:19:00.148 Latency(us) 00:19:00.148 [2024-12-16T13:23:14.722Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:00.148 [2024-12-16T13:23:14.723Z] =================================================================================================================== 00:19:00.149 [2024-12-16T13:23:14.723Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:00.149 14:23:14 -- common/autotest_common.sh@960 -- # wait 401568 00:19:00.407 14:23:14 -- target/tls.sh@37 -- # return 1 00:19:00.407 14:23:14 -- common/autotest_common.sh@653 -- # es=1 00:19:00.407 14:23:14 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:00.407 14:23:14 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:00.407 14:23:14 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:00.407 14:23:14 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:00.407 14:23:14 -- common/autotest_common.sh@650 -- # local es=0 00:19:00.407 14:23:14 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:00.407 14:23:14 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:19:00.407 14:23:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:00.407 14:23:14 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:19:00.407 14:23:14 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:00.407 14:23:14 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:00.407 14:23:14 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:00.407 14:23:14 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:19:00.407 14:23:14 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:00.407 14:23:14 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:19:00.407 14:23:14 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:00.407 14:23:14 -- target/tls.sh@28 -- # bdevperf_pid=401754 00:19:00.407 14:23:14 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:00.407 14:23:14 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:00.407 14:23:14 -- target/tls.sh@31 -- # waitforlisten 401754 /var/tmp/bdevperf.sock 00:19:00.407 14:23:14 -- common/autotest_common.sh@829 -- # '[' -z 401754 ']' 00:19:00.407 14:23:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:00.407 14:23:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:00.407 14:23:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:00.407 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:00.407 14:23:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:00.407 14:23:14 -- common/autotest_common.sh@10 -- # set +x 00:19:00.407 [2024-12-16 14:23:14.832808] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:00.407 [2024-12-16 14:23:14.832861] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid401754 ] 00:19:00.407 EAL: No free 2048 kB hugepages reported on node 1 00:19:00.407 [2024-12-16 14:23:14.887823] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:00.407 [2024-12-16 14:23:14.959617] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:01.341 14:23:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:01.341 14:23:15 -- common/autotest_common.sh@862 -- # return 0 00:19:01.341 14:23:15 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:19:01.341 [2024-12-16 14:23:15.785952] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:01.341 [2024-12-16 14:23:15.790266] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:19:01.342 [2024-12-16 14:23:15.790289] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:19:01.342 [2024-12-16 14:23:15.790313] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:01.342 [2024-12-16 14:23:15.790981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x237a7c0 (107): Transport endpoint is not connected 00:19:01.342 [2024-12-16 14:23:15.791973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x237a7c0 (9): Bad file descriptor 00:19:01.342 [2024-12-16 14:23:15.792974] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:19:01.342 [2024-12-16 14:23:15.792984] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:01.342 [2024-12-16 14:23:15.792991] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:19:01.342 request: 00:19:01.342 { 00:19:01.342 "name": "TLSTEST", 00:19:01.342 "trtype": "tcp", 00:19:01.342 "traddr": "10.0.0.2", 00:19:01.342 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:01.342 "adrfam": "ipv4", 00:19:01.342 "trsvcid": "4420", 00:19:01.342 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:19:01.342 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:19:01.342 "method": "bdev_nvme_attach_controller", 00:19:01.342 "req_id": 1 00:19:01.342 } 00:19:01.342 Got JSON-RPC error response 00:19:01.342 response: 00:19:01.342 { 00:19:01.342 "code": -32602, 00:19:01.342 "message": "Invalid parameters" 00:19:01.342 } 00:19:01.342 14:23:15 -- target/tls.sh@36 -- # killprocess 401754 00:19:01.342 14:23:15 -- common/autotest_common.sh@936 -- # '[' -z 401754 ']' 00:19:01.342 14:23:15 -- common/autotest_common.sh@940 -- # kill -0 401754 00:19:01.342 14:23:15 -- common/autotest_common.sh@941 -- # uname 00:19:01.342 14:23:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:01.342 14:23:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 401754 00:19:01.342 14:23:15 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:01.342 14:23:15 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:01.342 14:23:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 401754' 00:19:01.342 killing process with pid 401754 00:19:01.342 14:23:15 -- common/autotest_common.sh@955 -- # kill 401754 00:19:01.342 Received shutdown signal, test time was about 10.000000 seconds 00:19:01.342 00:19:01.342 Latency(us) 00:19:01.342 [2024-12-16T13:23:15.916Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:01.342 [2024-12-16T13:23:15.916Z] =================================================================================================================== 00:19:01.342 [2024-12-16T13:23:15.916Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:01.342 14:23:15 -- common/autotest_common.sh@960 -- # wait 401754 00:19:01.600 14:23:16 -- target/tls.sh@37 -- # return 1 00:19:01.600 14:23:16 -- common/autotest_common.sh@653 -- # es=1 00:19:01.600 14:23:16 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:01.600 14:23:16 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:01.600 14:23:16 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:01.600 14:23:16 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:01.600 14:23:16 -- common/autotest_common.sh@650 -- # local es=0 00:19:01.600 14:23:16 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:01.600 14:23:16 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:19:01.600 14:23:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:01.600 14:23:16 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:19:01.600 14:23:16 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:01.600 14:23:16 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:19:01.600 14:23:16 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:01.600 14:23:16 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:01.600 14:23:16 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:01.600 14:23:16 -- target/tls.sh@23 -- # psk= 00:19:01.600 14:23:16 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:01.600 14:23:16 -- target/tls.sh@28 -- # bdevperf_pid=401965 00:19:01.600 14:23:16 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:01.600 14:23:16 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:01.600 14:23:16 -- target/tls.sh@31 -- # waitforlisten 401965 /var/tmp/bdevperf.sock 00:19:01.600 14:23:16 -- common/autotest_common.sh@829 -- # '[' -z 401965 ']' 00:19:01.600 14:23:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:01.600 14:23:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:01.600 14:23:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:01.600 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:01.600 14:23:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:01.600 14:23:16 -- common/autotest_common.sh@10 -- # set +x 00:19:01.600 [2024-12-16 14:23:16.100391] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:01.600 [2024-12-16 14:23:16.100438] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid401965 ] 00:19:01.600 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.600 [2024-12-16 14:23:16.152246] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:01.858 [2024-12-16 14:23:16.221102] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:02.423 14:23:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:02.423 14:23:16 -- common/autotest_common.sh@862 -- # return 0 00:19:02.423 14:23:16 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:19:02.681 [2024-12-16 14:23:17.073168] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:19:02.681 [2024-12-16 14:23:17.075119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2015170 (9): Bad file descriptor 00:19:02.681 [2024-12-16 14:23:17.076118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:19:02.681 [2024-12-16 14:23:17.076128] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:19:02.681 [2024-12-16 14:23:17.076135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:19:02.681 request: 00:19:02.681 { 00:19:02.681 "name": "TLSTEST", 00:19:02.681 "trtype": "tcp", 00:19:02.681 "traddr": "10.0.0.2", 00:19:02.681 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:02.681 "adrfam": "ipv4", 00:19:02.681 "trsvcid": "4420", 00:19:02.681 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:02.681 "method": "bdev_nvme_attach_controller", 00:19:02.681 "req_id": 1 00:19:02.681 } 00:19:02.681 Got JSON-RPC error response 00:19:02.681 response: 00:19:02.681 { 00:19:02.681 "code": -32602, 00:19:02.681 "message": "Invalid parameters" 00:19:02.681 } 00:19:02.681 14:23:17 -- target/tls.sh@36 -- # killprocess 401965 00:19:02.681 14:23:17 -- common/autotest_common.sh@936 -- # '[' -z 401965 ']' 00:19:02.681 14:23:17 -- common/autotest_common.sh@940 -- # kill -0 401965 00:19:02.681 14:23:17 -- common/autotest_common.sh@941 -- # uname 00:19:02.681 14:23:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:02.681 14:23:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 401965 00:19:02.681 14:23:17 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:02.681 14:23:17 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:02.681 14:23:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 401965' 00:19:02.681 killing process with pid 401965 00:19:02.681 14:23:17 -- common/autotest_common.sh@955 -- # kill 401965 00:19:02.681 Received shutdown signal, test time was about 10.000000 seconds 00:19:02.681 00:19:02.681 Latency(us) 00:19:02.681 [2024-12-16T13:23:17.255Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:02.681 [2024-12-16T13:23:17.255Z] =================================================================================================================== 00:19:02.681 [2024-12-16T13:23:17.255Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:02.681 14:23:17 -- common/autotest_common.sh@960 -- # wait 401965 00:19:02.939 14:23:17 -- target/tls.sh@37 -- # return 1 00:19:02.939 14:23:17 -- common/autotest_common.sh@653 -- # es=1 00:19:02.939 14:23:17 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:02.939 14:23:17 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:02.939 14:23:17 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:02.939 14:23:17 -- target/tls.sh@167 -- # killprocess 397094 00:19:02.939 14:23:17 -- common/autotest_common.sh@936 -- # '[' -z 397094 ']' 00:19:02.939 14:23:17 -- common/autotest_common.sh@940 -- # kill -0 397094 00:19:02.939 14:23:17 -- common/autotest_common.sh@941 -- # uname 00:19:02.939 14:23:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:02.939 14:23:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 397094 00:19:02.939 14:23:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:02.939 14:23:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:02.939 14:23:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 397094' 00:19:02.939 killing process with pid 397094 00:19:02.939 14:23:17 -- common/autotest_common.sh@955 -- # kill 397094 00:19:02.939 14:23:17 -- common/autotest_common.sh@960 -- # wait 397094 00:19:03.197 14:23:17 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:19:03.197 14:23:17 -- target/tls.sh@49 -- # local key hash crc 00:19:03.197 14:23:17 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:19:03.197 14:23:17 -- target/tls.sh@51 -- # hash=02 00:19:03.197 14:23:17 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:19:03.197 14:23:17 -- target/tls.sh@52 -- # gzip -1 -c 00:19:03.197 14:23:17 -- target/tls.sh@52 -- # head -c 4 00:19:03.197 14:23:17 -- target/tls.sh@52 -- # tail -c8 00:19:03.197 14:23:17 -- target/tls.sh@52 -- # crc='�e�'\''' 00:19:03.197 14:23:17 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:19:03.197 14:23:17 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:19:03.197 14:23:17 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:19:03.197 14:23:17 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:19:03.197 14:23:17 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:03.197 14:23:17 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:19:03.197 14:23:17 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:03.197 14:23:17 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:19:03.197 14:23:17 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:03.197 14:23:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:03.197 14:23:17 -- common/autotest_common.sh@10 -- # set +x 00:19:03.197 14:23:17 -- nvmf/common.sh@469 -- # nvmfpid=402290 00:19:03.197 14:23:17 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:03.197 14:23:17 -- nvmf/common.sh@470 -- # waitforlisten 402290 00:19:03.197 14:23:17 -- common/autotest_common.sh@829 -- # '[' -z 402290 ']' 00:19:03.198 14:23:17 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:03.198 14:23:17 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:03.198 14:23:17 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:03.198 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:03.198 14:23:17 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:03.198 14:23:17 -- common/autotest_common.sh@10 -- # set +x 00:19:03.198 [2024-12-16 14:23:17.668693] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:03.198 [2024-12-16 14:23:17.668741] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:03.198 EAL: No free 2048 kB hugepages reported on node 1 00:19:03.198 [2024-12-16 14:23:17.729579] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:03.455 [2024-12-16 14:23:17.799979] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:03.455 [2024-12-16 14:23:17.800095] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:03.455 [2024-12-16 14:23:17.800105] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:03.455 [2024-12-16 14:23:17.800112] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:03.455 [2024-12-16 14:23:17.800134] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:04.019 14:23:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:04.019 14:23:18 -- common/autotest_common.sh@862 -- # return 0 00:19:04.019 14:23:18 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:04.019 14:23:18 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:04.019 14:23:18 -- common/autotest_common.sh@10 -- # set +x 00:19:04.019 14:23:18 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:04.019 14:23:18 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:04.019 14:23:18 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:04.019 14:23:18 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:04.277 [2024-12-16 14:23:18.671057] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:04.277 14:23:18 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:04.534 14:23:18 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:04.534 [2024-12-16 14:23:19.015956] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:04.534 [2024-12-16 14:23:19.016163] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:04.534 14:23:19 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:04.792 malloc0 00:19:04.792 14:23:19 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:05.050 14:23:19 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:05.050 14:23:19 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:05.050 14:23:19 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:05.050 14:23:19 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:05.050 14:23:19 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:05.050 14:23:19 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:19:05.050 14:23:19 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:05.050 14:23:19 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:05.050 14:23:19 -- target/tls.sh@28 -- # bdevperf_pid=402694 00:19:05.050 14:23:19 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:05.050 14:23:19 -- target/tls.sh@31 -- # waitforlisten 402694 /var/tmp/bdevperf.sock 00:19:05.050 14:23:19 -- common/autotest_common.sh@829 -- # '[' -z 402694 ']' 00:19:05.050 14:23:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:05.050 14:23:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:05.050 14:23:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:05.050 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:05.050 14:23:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:05.050 14:23:19 -- common/autotest_common.sh@10 -- # set +x 00:19:05.050 [2024-12-16 14:23:19.592816] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:05.050 [2024-12-16 14:23:19.592869] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid402694 ] 00:19:05.050 EAL: No free 2048 kB hugepages reported on node 1 00:19:05.307 [2024-12-16 14:23:19.642137] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:05.307 [2024-12-16 14:23:19.712173] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:05.872 14:23:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:05.872 14:23:20 -- common/autotest_common.sh@862 -- # return 0 00:19:05.872 14:23:20 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:06.130 [2024-12-16 14:23:20.594192] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:06.130 TLSTESTn1 00:19:06.130 14:23:20 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:06.387 Running I/O for 10 seconds... 00:19:16.352 00:19:16.352 Latency(us) 00:19:16.352 [2024-12-16T13:23:30.926Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:16.352 [2024-12-16T13:23:30.926Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:16.352 Verification LBA range: start 0x0 length 0x2000 00:19:16.352 TLSTESTn1 : 10.01 6696.69 26.16 0.00 0.00 19094.29 3698.10 38697.45 00:19:16.352 [2024-12-16T13:23:30.926Z] =================================================================================================================== 00:19:16.352 [2024-12-16T13:23:30.926Z] Total : 6696.69 26.16 0.00 0.00 19094.29 3698.10 38697.45 00:19:16.352 0 00:19:16.352 14:23:30 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:16.352 14:23:30 -- target/tls.sh@45 -- # killprocess 402694 00:19:16.352 14:23:30 -- common/autotest_common.sh@936 -- # '[' -z 402694 ']' 00:19:16.352 14:23:30 -- common/autotest_common.sh@940 -- # kill -0 402694 00:19:16.352 14:23:30 -- common/autotest_common.sh@941 -- # uname 00:19:16.352 14:23:30 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:16.352 14:23:30 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 402694 00:19:16.352 14:23:30 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:16.352 14:23:30 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:16.352 14:23:30 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 402694' 00:19:16.352 killing process with pid 402694 00:19:16.352 14:23:30 -- common/autotest_common.sh@955 -- # kill 402694 00:19:16.352 Received shutdown signal, test time was about 10.000000 seconds 00:19:16.352 00:19:16.352 Latency(us) 00:19:16.352 [2024-12-16T13:23:30.926Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:16.352 [2024-12-16T13:23:30.926Z] =================================================================================================================== 00:19:16.352 [2024-12-16T13:23:30.926Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:16.352 14:23:30 -- common/autotest_common.sh@960 -- # wait 402694 00:19:16.609 14:23:31 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:16.609 14:23:31 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:16.609 14:23:31 -- common/autotest_common.sh@650 -- # local es=0 00:19:16.609 14:23:31 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:16.609 14:23:31 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:19:16.609 14:23:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:16.609 14:23:31 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:19:16.609 14:23:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:16.609 14:23:31 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:16.609 14:23:31 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:19:16.609 14:23:31 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:19:16.609 14:23:31 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:19:16.609 14:23:31 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:19:16.609 14:23:31 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:16.609 14:23:31 -- target/tls.sh@28 -- # bdevperf_pid=404513 00:19:16.609 14:23:31 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:16.609 14:23:31 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:16.609 14:23:31 -- target/tls.sh@31 -- # waitforlisten 404513 /var/tmp/bdevperf.sock 00:19:16.609 14:23:31 -- common/autotest_common.sh@829 -- # '[' -z 404513 ']' 00:19:16.609 14:23:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:16.609 14:23:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:16.609 14:23:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:16.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:16.609 14:23:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:16.609 14:23:31 -- common/autotest_common.sh@10 -- # set +x 00:19:16.609 [2024-12-16 14:23:31.113996] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:16.609 [2024-12-16 14:23:31.114047] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid404513 ] 00:19:16.609 EAL: No free 2048 kB hugepages reported on node 1 00:19:16.609 [2024-12-16 14:23:31.164670] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:16.867 [2024-12-16 14:23:31.233396] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:17.432 14:23:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:17.432 14:23:31 -- common/autotest_common.sh@862 -- # return 0 00:19:17.432 14:23:31 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:17.690 [2024-12-16 14:23:32.079630] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:17.690 [2024-12-16 14:23:32.079664] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:19:17.690 request: 00:19:17.690 { 00:19:17.690 "name": "TLSTEST", 00:19:17.690 "trtype": "tcp", 00:19:17.690 "traddr": "10.0.0.2", 00:19:17.690 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:17.690 "adrfam": "ipv4", 00:19:17.690 "trsvcid": "4420", 00:19:17.690 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:17.690 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:19:17.690 "method": "bdev_nvme_attach_controller", 00:19:17.690 "req_id": 1 00:19:17.690 } 00:19:17.690 Got JSON-RPC error response 00:19:17.690 response: 00:19:17.690 { 00:19:17.690 "code": -22, 00:19:17.690 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:19:17.690 } 00:19:17.690 14:23:32 -- target/tls.sh@36 -- # killprocess 404513 00:19:17.690 14:23:32 -- common/autotest_common.sh@936 -- # '[' -z 404513 ']' 00:19:17.690 14:23:32 -- common/autotest_common.sh@940 -- # kill -0 404513 00:19:17.690 14:23:32 -- common/autotest_common.sh@941 -- # uname 00:19:17.690 14:23:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:17.690 14:23:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 404513 00:19:17.690 14:23:32 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:17.690 14:23:32 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:17.690 14:23:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 404513' 00:19:17.690 killing process with pid 404513 00:19:17.690 14:23:32 -- common/autotest_common.sh@955 -- # kill 404513 00:19:17.690 Received shutdown signal, test time was about 10.000000 seconds 00:19:17.690 00:19:17.690 Latency(us) 00:19:17.690 [2024-12-16T13:23:32.264Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:17.690 [2024-12-16T13:23:32.264Z] =================================================================================================================== 00:19:17.690 [2024-12-16T13:23:32.264Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:17.690 14:23:32 -- common/autotest_common.sh@960 -- # wait 404513 00:19:17.948 14:23:32 -- target/tls.sh@37 -- # return 1 00:19:17.948 14:23:32 -- common/autotest_common.sh@653 -- # es=1 00:19:17.948 14:23:32 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:17.948 14:23:32 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:17.948 14:23:32 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:17.948 14:23:32 -- target/tls.sh@183 -- # killprocess 402290 00:19:17.948 14:23:32 -- common/autotest_common.sh@936 -- # '[' -z 402290 ']' 00:19:17.948 14:23:32 -- common/autotest_common.sh@940 -- # kill -0 402290 00:19:17.948 14:23:32 -- common/autotest_common.sh@941 -- # uname 00:19:17.948 14:23:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:17.948 14:23:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 402290 00:19:17.948 14:23:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:17.948 14:23:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:17.948 14:23:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 402290' 00:19:17.948 killing process with pid 402290 00:19:17.948 14:23:32 -- common/autotest_common.sh@955 -- # kill 402290 00:19:17.948 14:23:32 -- common/autotest_common.sh@960 -- # wait 402290 00:19:18.206 14:23:32 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:19:18.206 14:23:32 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:18.206 14:23:32 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:18.206 14:23:32 -- common/autotest_common.sh@10 -- # set +x 00:19:18.206 14:23:32 -- nvmf/common.sh@469 -- # nvmfpid=404756 00:19:18.206 14:23:32 -- nvmf/common.sh@470 -- # waitforlisten 404756 00:19:18.206 14:23:32 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:18.206 14:23:32 -- common/autotest_common.sh@829 -- # '[' -z 404756 ']' 00:19:18.206 14:23:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:18.206 14:23:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:18.206 14:23:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:18.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:18.206 14:23:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:18.206 14:23:32 -- common/autotest_common.sh@10 -- # set +x 00:19:18.206 [2024-12-16 14:23:32.653912] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:18.206 [2024-12-16 14:23:32.653958] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:18.206 EAL: No free 2048 kB hugepages reported on node 1 00:19:18.206 [2024-12-16 14:23:32.713603] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:18.206 [2024-12-16 14:23:32.775133] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:18.206 [2024-12-16 14:23:32.775257] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:18.206 [2024-12-16 14:23:32.775265] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:18.206 [2024-12-16 14:23:32.775272] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:18.207 [2024-12-16 14:23:32.775290] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:19.140 14:23:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:19.140 14:23:33 -- common/autotest_common.sh@862 -- # return 0 00:19:19.140 14:23:33 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:19.140 14:23:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:19.140 14:23:33 -- common/autotest_common.sh@10 -- # set +x 00:19:19.140 14:23:33 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:19.140 14:23:33 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:19.140 14:23:33 -- common/autotest_common.sh@650 -- # local es=0 00:19:19.140 14:23:33 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:19.140 14:23:33 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:19:19.140 14:23:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:19.140 14:23:33 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:19:19.140 14:23:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:19.140 14:23:33 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:19.140 14:23:33 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:19.140 14:23:33 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:19.140 [2024-12-16 14:23:33.662121] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:19.140 14:23:33 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:19.397 14:23:33 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:19.654 [2024-12-16 14:23:34.011042] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:19.654 [2024-12-16 14:23:34.011264] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:19.654 14:23:34 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:19.654 malloc0 00:19:19.654 14:23:34 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:19.912 14:23:34 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:20.169 [2024-12-16 14:23:34.520408] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:19:20.169 [2024-12-16 14:23:34.520437] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:19:20.169 [2024-12-16 14:23:34.520452] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:19:20.169 request: 00:19:20.169 { 00:19:20.169 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:20.169 "host": "nqn.2016-06.io.spdk:host1", 00:19:20.169 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:19:20.169 "method": "nvmf_subsystem_add_host", 00:19:20.169 "req_id": 1 00:19:20.169 } 00:19:20.169 Got JSON-RPC error response 00:19:20.169 response: 00:19:20.169 { 00:19:20.169 "code": -32603, 00:19:20.169 "message": "Internal error" 00:19:20.169 } 00:19:20.169 14:23:34 -- common/autotest_common.sh@653 -- # es=1 00:19:20.169 14:23:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:20.169 14:23:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:20.169 14:23:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:20.169 14:23:34 -- target/tls.sh@189 -- # killprocess 404756 00:19:20.169 14:23:34 -- common/autotest_common.sh@936 -- # '[' -z 404756 ']' 00:19:20.169 14:23:34 -- common/autotest_common.sh@940 -- # kill -0 404756 00:19:20.169 14:23:34 -- common/autotest_common.sh@941 -- # uname 00:19:20.170 14:23:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:20.170 14:23:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 404756 00:19:20.170 14:23:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:20.170 14:23:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:20.170 14:23:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 404756' 00:19:20.170 killing process with pid 404756 00:19:20.170 14:23:34 -- common/autotest_common.sh@955 -- # kill 404756 00:19:20.170 14:23:34 -- common/autotest_common.sh@960 -- # wait 404756 00:19:20.427 14:23:34 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:20.427 14:23:34 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:19:20.427 14:23:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:20.427 14:23:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:20.427 14:23:34 -- common/autotest_common.sh@10 -- # set +x 00:19:20.427 14:23:34 -- nvmf/common.sh@469 -- # nvmfpid=405236 00:19:20.427 14:23:34 -- nvmf/common.sh@470 -- # waitforlisten 405236 00:19:20.427 14:23:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:20.427 14:23:34 -- common/autotest_common.sh@829 -- # '[' -z 405236 ']' 00:19:20.427 14:23:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:20.427 14:23:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:20.427 14:23:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:20.427 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:20.427 14:23:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:20.427 14:23:34 -- common/autotest_common.sh@10 -- # set +x 00:19:20.427 [2024-12-16 14:23:34.845869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:20.427 [2024-12-16 14:23:34.845915] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:20.427 EAL: No free 2048 kB hugepages reported on node 1 00:19:20.427 [2024-12-16 14:23:34.903868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:20.427 [2024-12-16 14:23:34.974273] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:20.427 [2024-12-16 14:23:34.974381] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:20.427 [2024-12-16 14:23:34.974389] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:20.427 [2024-12-16 14:23:34.974395] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:20.427 [2024-12-16 14:23:34.974411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:21.360 14:23:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:21.360 14:23:35 -- common/autotest_common.sh@862 -- # return 0 00:19:21.360 14:23:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:21.360 14:23:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:21.360 14:23:35 -- common/autotest_common.sh@10 -- # set +x 00:19:21.360 14:23:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:21.360 14:23:35 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:21.360 14:23:35 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:21.360 14:23:35 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:19:21.360 [2024-12-16 14:23:35.865254] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:21.360 14:23:35 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:19:21.674 14:23:36 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:19:21.674 [2024-12-16 14:23:36.210142] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:21.674 [2024-12-16 14:23:36.210333] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:21.674 14:23:36 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:19:21.980 malloc0 00:19:21.980 14:23:36 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:19:22.262 14:23:36 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:22.262 14:23:36 -- target/tls.sh@197 -- # bdevperf_pid=405507 00:19:22.262 14:23:36 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:19:22.262 14:23:36 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:22.262 14:23:36 -- target/tls.sh@200 -- # waitforlisten 405507 /var/tmp/bdevperf.sock 00:19:22.262 14:23:36 -- common/autotest_common.sh@829 -- # '[' -z 405507 ']' 00:19:22.262 14:23:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:22.262 14:23:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:22.262 14:23:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:22.262 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:22.262 14:23:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:22.262 14:23:36 -- common/autotest_common.sh@10 -- # set +x 00:19:22.262 [2024-12-16 14:23:36.779592] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:22.262 [2024-12-16 14:23:36.779642] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid405507 ] 00:19:22.262 EAL: No free 2048 kB hugepages reported on node 1 00:19:22.262 [2024-12-16 14:23:36.829388] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:22.519 [2024-12-16 14:23:36.899686] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:23.084 14:23:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:23.084 14:23:37 -- common/autotest_common.sh@862 -- # return 0 00:19:23.084 14:23:37 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:23.342 [2024-12-16 14:23:37.753042] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:23.342 TLSTESTn1 00:19:23.342 14:23:37 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:19:23.601 14:23:38 -- target/tls.sh@205 -- # tgtconf='{ 00:19:23.601 "subsystems": [ 00:19:23.601 { 00:19:23.601 "subsystem": "iobuf", 00:19:23.601 "config": [ 00:19:23.601 { 00:19:23.601 "method": "iobuf_set_options", 00:19:23.601 "params": { 00:19:23.601 "small_pool_count": 8192, 00:19:23.601 "large_pool_count": 1024, 00:19:23.601 "small_bufsize": 8192, 00:19:23.601 "large_bufsize": 135168 00:19:23.601 } 00:19:23.601 } 00:19:23.601 ] 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "subsystem": "sock", 00:19:23.601 "config": [ 00:19:23.601 { 00:19:23.601 "method": "sock_impl_set_options", 00:19:23.601 "params": { 00:19:23.601 "impl_name": "posix", 00:19:23.601 "recv_buf_size": 2097152, 00:19:23.601 "send_buf_size": 2097152, 00:19:23.601 "enable_recv_pipe": true, 00:19:23.601 "enable_quickack": false, 00:19:23.601 "enable_placement_id": 0, 00:19:23.601 "enable_zerocopy_send_server": true, 00:19:23.601 "enable_zerocopy_send_client": false, 00:19:23.601 "zerocopy_threshold": 0, 00:19:23.601 "tls_version": 0, 00:19:23.601 "enable_ktls": false 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "sock_impl_set_options", 00:19:23.601 "params": { 00:19:23.601 "impl_name": "ssl", 00:19:23.601 "recv_buf_size": 4096, 00:19:23.601 "send_buf_size": 4096, 00:19:23.601 "enable_recv_pipe": true, 00:19:23.601 "enable_quickack": false, 00:19:23.601 "enable_placement_id": 0, 00:19:23.601 "enable_zerocopy_send_server": true, 00:19:23.601 "enable_zerocopy_send_client": false, 00:19:23.601 "zerocopy_threshold": 0, 00:19:23.601 "tls_version": 0, 00:19:23.601 "enable_ktls": false 00:19:23.601 } 00:19:23.601 } 00:19:23.601 ] 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "subsystem": "vmd", 00:19:23.601 "config": [] 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "subsystem": "accel", 00:19:23.601 "config": [ 00:19:23.601 { 00:19:23.601 "method": "accel_set_options", 00:19:23.601 "params": { 00:19:23.601 "small_cache_size": 128, 00:19:23.601 "large_cache_size": 16, 00:19:23.601 "task_count": 2048, 00:19:23.601 "sequence_count": 2048, 00:19:23.601 "buf_count": 2048 00:19:23.601 } 00:19:23.601 } 00:19:23.601 ] 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "subsystem": "bdev", 00:19:23.601 "config": [ 00:19:23.601 { 00:19:23.601 "method": "bdev_set_options", 00:19:23.601 "params": { 00:19:23.601 "bdev_io_pool_size": 65535, 00:19:23.601 "bdev_io_cache_size": 256, 00:19:23.601 "bdev_auto_examine": true, 00:19:23.601 "iobuf_small_cache_size": 128, 00:19:23.601 "iobuf_large_cache_size": 16 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "bdev_raid_set_options", 00:19:23.601 "params": { 00:19:23.601 "process_window_size_kb": 1024 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "bdev_iscsi_set_options", 00:19:23.601 "params": { 00:19:23.601 "timeout_sec": 30 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "bdev_nvme_set_options", 00:19:23.601 "params": { 00:19:23.601 "action_on_timeout": "none", 00:19:23.601 "timeout_us": 0, 00:19:23.601 "timeout_admin_us": 0, 00:19:23.601 "keep_alive_timeout_ms": 10000, 00:19:23.601 "transport_retry_count": 4, 00:19:23.601 "arbitration_burst": 0, 00:19:23.601 "low_priority_weight": 0, 00:19:23.601 "medium_priority_weight": 0, 00:19:23.601 "high_priority_weight": 0, 00:19:23.601 "nvme_adminq_poll_period_us": 10000, 00:19:23.601 "nvme_ioq_poll_period_us": 0, 00:19:23.601 "io_queue_requests": 0, 00:19:23.601 "delay_cmd_submit": true, 00:19:23.601 "bdev_retry_count": 3, 00:19:23.601 "transport_ack_timeout": 0, 00:19:23.601 "ctrlr_loss_timeout_sec": 0, 00:19:23.601 "reconnect_delay_sec": 0, 00:19:23.601 "fast_io_fail_timeout_sec": 0, 00:19:23.601 "generate_uuids": false, 00:19:23.601 "transport_tos": 0, 00:19:23.601 "io_path_stat": false, 00:19:23.601 "allow_accel_sequence": false 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "bdev_nvme_set_hotplug", 00:19:23.601 "params": { 00:19:23.601 "period_us": 100000, 00:19:23.601 "enable": false 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "bdev_malloc_create", 00:19:23.601 "params": { 00:19:23.601 "name": "malloc0", 00:19:23.601 "num_blocks": 8192, 00:19:23.601 "block_size": 4096, 00:19:23.601 "physical_block_size": 4096, 00:19:23.601 "uuid": "a99177f3-f6db-4945-9746-277a93602581", 00:19:23.601 "optimal_io_boundary": 0 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "bdev_wait_for_examine" 00:19:23.601 } 00:19:23.601 ] 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "subsystem": "nbd", 00:19:23.601 "config": [] 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "subsystem": "scheduler", 00:19:23.601 "config": [ 00:19:23.601 { 00:19:23.601 "method": "framework_set_scheduler", 00:19:23.601 "params": { 00:19:23.601 "name": "static" 00:19:23.601 } 00:19:23.601 } 00:19:23.601 ] 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "subsystem": "nvmf", 00:19:23.601 "config": [ 00:19:23.601 { 00:19:23.601 "method": "nvmf_set_config", 00:19:23.601 "params": { 00:19:23.601 "discovery_filter": "match_any", 00:19:23.601 "admin_cmd_passthru": { 00:19:23.601 "identify_ctrlr": false 00:19:23.601 } 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "nvmf_set_max_subsystems", 00:19:23.601 "params": { 00:19:23.601 "max_subsystems": 1024 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "nvmf_set_crdt", 00:19:23.601 "params": { 00:19:23.601 "crdt1": 0, 00:19:23.601 "crdt2": 0, 00:19:23.601 "crdt3": 0 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "nvmf_create_transport", 00:19:23.601 "params": { 00:19:23.601 "trtype": "TCP", 00:19:23.601 "max_queue_depth": 128, 00:19:23.601 "max_io_qpairs_per_ctrlr": 127, 00:19:23.601 "in_capsule_data_size": 4096, 00:19:23.601 "max_io_size": 131072, 00:19:23.601 "io_unit_size": 131072, 00:19:23.601 "max_aq_depth": 128, 00:19:23.601 "num_shared_buffers": 511, 00:19:23.601 "buf_cache_size": 4294967295, 00:19:23.601 "dif_insert_or_strip": false, 00:19:23.601 "zcopy": false, 00:19:23.601 "c2h_success": false, 00:19:23.601 "sock_priority": 0, 00:19:23.601 "abort_timeout_sec": 1 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "nvmf_create_subsystem", 00:19:23.601 "params": { 00:19:23.601 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:23.601 "allow_any_host": false, 00:19:23.601 "serial_number": "SPDK00000000000001", 00:19:23.601 "model_number": "SPDK bdev Controller", 00:19:23.601 "max_namespaces": 10, 00:19:23.601 "min_cntlid": 1, 00:19:23.601 "max_cntlid": 65519, 00:19:23.601 "ana_reporting": false 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "nvmf_subsystem_add_host", 00:19:23.601 "params": { 00:19:23.601 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:23.601 "host": "nqn.2016-06.io.spdk:host1", 00:19:23.601 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.601 "method": "nvmf_subsystem_add_ns", 00:19:23.601 "params": { 00:19:23.601 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:23.601 "namespace": { 00:19:23.601 "nsid": 1, 00:19:23.601 "bdev_name": "malloc0", 00:19:23.601 "nguid": "A99177F3F6DB49459746277A93602581", 00:19:23.601 "uuid": "a99177f3-f6db-4945-9746-277a93602581" 00:19:23.601 } 00:19:23.601 } 00:19:23.601 }, 00:19:23.601 { 00:19:23.602 "method": "nvmf_subsystem_add_listener", 00:19:23.602 "params": { 00:19:23.602 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:23.602 "listen_address": { 00:19:23.602 "trtype": "TCP", 00:19:23.602 "adrfam": "IPv4", 00:19:23.602 "traddr": "10.0.0.2", 00:19:23.602 "trsvcid": "4420" 00:19:23.602 }, 00:19:23.602 "secure_channel": true 00:19:23.602 } 00:19:23.602 } 00:19:23.602 ] 00:19:23.602 } 00:19:23.602 ] 00:19:23.602 }' 00:19:23.602 14:23:38 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:19:23.860 14:23:38 -- target/tls.sh@206 -- # bdevperfconf='{ 00:19:23.860 "subsystems": [ 00:19:23.860 { 00:19:23.860 "subsystem": "iobuf", 00:19:23.860 "config": [ 00:19:23.860 { 00:19:23.860 "method": "iobuf_set_options", 00:19:23.860 "params": { 00:19:23.860 "small_pool_count": 8192, 00:19:23.860 "large_pool_count": 1024, 00:19:23.860 "small_bufsize": 8192, 00:19:23.860 "large_bufsize": 135168 00:19:23.860 } 00:19:23.860 } 00:19:23.860 ] 00:19:23.860 }, 00:19:23.860 { 00:19:23.860 "subsystem": "sock", 00:19:23.860 "config": [ 00:19:23.860 { 00:19:23.860 "method": "sock_impl_set_options", 00:19:23.860 "params": { 00:19:23.860 "impl_name": "posix", 00:19:23.860 "recv_buf_size": 2097152, 00:19:23.860 "send_buf_size": 2097152, 00:19:23.860 "enable_recv_pipe": true, 00:19:23.860 "enable_quickack": false, 00:19:23.860 "enable_placement_id": 0, 00:19:23.860 "enable_zerocopy_send_server": true, 00:19:23.860 "enable_zerocopy_send_client": false, 00:19:23.860 "zerocopy_threshold": 0, 00:19:23.860 "tls_version": 0, 00:19:23.860 "enable_ktls": false 00:19:23.860 } 00:19:23.860 }, 00:19:23.860 { 00:19:23.860 "method": "sock_impl_set_options", 00:19:23.860 "params": { 00:19:23.860 "impl_name": "ssl", 00:19:23.860 "recv_buf_size": 4096, 00:19:23.860 "send_buf_size": 4096, 00:19:23.860 "enable_recv_pipe": true, 00:19:23.860 "enable_quickack": false, 00:19:23.860 "enable_placement_id": 0, 00:19:23.860 "enable_zerocopy_send_server": true, 00:19:23.860 "enable_zerocopy_send_client": false, 00:19:23.860 "zerocopy_threshold": 0, 00:19:23.860 "tls_version": 0, 00:19:23.860 "enable_ktls": false 00:19:23.860 } 00:19:23.860 } 00:19:23.860 ] 00:19:23.860 }, 00:19:23.860 { 00:19:23.860 "subsystem": "vmd", 00:19:23.860 "config": [] 00:19:23.860 }, 00:19:23.860 { 00:19:23.860 "subsystem": "accel", 00:19:23.860 "config": [ 00:19:23.860 { 00:19:23.860 "method": "accel_set_options", 00:19:23.860 "params": { 00:19:23.860 "small_cache_size": 128, 00:19:23.860 "large_cache_size": 16, 00:19:23.860 "task_count": 2048, 00:19:23.860 "sequence_count": 2048, 00:19:23.860 "buf_count": 2048 00:19:23.860 } 00:19:23.860 } 00:19:23.860 ] 00:19:23.860 }, 00:19:23.860 { 00:19:23.860 "subsystem": "bdev", 00:19:23.860 "config": [ 00:19:23.860 { 00:19:23.860 "method": "bdev_set_options", 00:19:23.860 "params": { 00:19:23.860 "bdev_io_pool_size": 65535, 00:19:23.860 "bdev_io_cache_size": 256, 00:19:23.860 "bdev_auto_examine": true, 00:19:23.860 "iobuf_small_cache_size": 128, 00:19:23.860 "iobuf_large_cache_size": 16 00:19:23.860 } 00:19:23.860 }, 00:19:23.860 { 00:19:23.860 "method": "bdev_raid_set_options", 00:19:23.860 "params": { 00:19:23.860 "process_window_size_kb": 1024 00:19:23.860 } 00:19:23.860 }, 00:19:23.860 { 00:19:23.860 "method": "bdev_iscsi_set_options", 00:19:23.860 "params": { 00:19:23.860 "timeout_sec": 30 00:19:23.860 } 00:19:23.860 }, 00:19:23.860 { 00:19:23.860 "method": "bdev_nvme_set_options", 00:19:23.860 "params": { 00:19:23.860 "action_on_timeout": "none", 00:19:23.860 "timeout_us": 0, 00:19:23.860 "timeout_admin_us": 0, 00:19:23.860 "keep_alive_timeout_ms": 10000, 00:19:23.860 "transport_retry_count": 4, 00:19:23.860 "arbitration_burst": 0, 00:19:23.861 "low_priority_weight": 0, 00:19:23.861 "medium_priority_weight": 0, 00:19:23.861 "high_priority_weight": 0, 00:19:23.861 "nvme_adminq_poll_period_us": 10000, 00:19:23.861 "nvme_ioq_poll_period_us": 0, 00:19:23.861 "io_queue_requests": 512, 00:19:23.861 "delay_cmd_submit": true, 00:19:23.861 "bdev_retry_count": 3, 00:19:23.861 "transport_ack_timeout": 0, 00:19:23.861 "ctrlr_loss_timeout_sec": 0, 00:19:23.861 "reconnect_delay_sec": 0, 00:19:23.861 "fast_io_fail_timeout_sec": 0, 00:19:23.861 "generate_uuids": false, 00:19:23.861 "transport_tos": 0, 00:19:23.861 "io_path_stat": false, 00:19:23.861 "allow_accel_sequence": false 00:19:23.861 } 00:19:23.861 }, 00:19:23.861 { 00:19:23.861 "method": "bdev_nvme_attach_controller", 00:19:23.861 "params": { 00:19:23.861 "name": "TLSTEST", 00:19:23.861 "trtype": "TCP", 00:19:23.861 "adrfam": "IPv4", 00:19:23.861 "traddr": "10.0.0.2", 00:19:23.861 "trsvcid": "4420", 00:19:23.861 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:23.861 "prchk_reftag": false, 00:19:23.861 "prchk_guard": false, 00:19:23.861 "ctrlr_loss_timeout_sec": 0, 00:19:23.861 "reconnect_delay_sec": 0, 00:19:23.861 "fast_io_fail_timeout_sec": 0, 00:19:23.861 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:19:23.861 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:23.861 "hdgst": false, 00:19:23.861 "ddgst": false 00:19:23.861 } 00:19:23.861 }, 00:19:23.861 { 00:19:23.861 "method": "bdev_nvme_set_hotplug", 00:19:23.861 "params": { 00:19:23.861 "period_us": 100000, 00:19:23.861 "enable": false 00:19:23.861 } 00:19:23.861 }, 00:19:23.861 { 00:19:23.861 "method": "bdev_wait_for_examine" 00:19:23.861 } 00:19:23.861 ] 00:19:23.861 }, 00:19:23.861 { 00:19:23.861 "subsystem": "nbd", 00:19:23.861 "config": [] 00:19:23.861 } 00:19:23.861 ] 00:19:23.861 }' 00:19:23.861 14:23:38 -- target/tls.sh@208 -- # killprocess 405507 00:19:23.861 14:23:38 -- common/autotest_common.sh@936 -- # '[' -z 405507 ']' 00:19:23.861 14:23:38 -- common/autotest_common.sh@940 -- # kill -0 405507 00:19:23.861 14:23:38 -- common/autotest_common.sh@941 -- # uname 00:19:23.861 14:23:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:23.861 14:23:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 405507 00:19:23.861 14:23:38 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:23.861 14:23:38 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:23.861 14:23:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 405507' 00:19:23.861 killing process with pid 405507 00:19:23.861 14:23:38 -- common/autotest_common.sh@955 -- # kill 405507 00:19:23.861 Received shutdown signal, test time was about 10.000000 seconds 00:19:23.861 00:19:23.861 Latency(us) 00:19:23.861 [2024-12-16T13:23:38.435Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:23.861 [2024-12-16T13:23:38.435Z] =================================================================================================================== 00:19:23.861 [2024-12-16T13:23:38.435Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:19:23.861 14:23:38 -- common/autotest_common.sh@960 -- # wait 405507 00:19:24.120 14:23:38 -- target/tls.sh@209 -- # killprocess 405236 00:19:24.120 14:23:38 -- common/autotest_common.sh@936 -- # '[' -z 405236 ']' 00:19:24.120 14:23:38 -- common/autotest_common.sh@940 -- # kill -0 405236 00:19:24.120 14:23:38 -- common/autotest_common.sh@941 -- # uname 00:19:24.120 14:23:38 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:24.120 14:23:38 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 405236 00:19:24.120 14:23:38 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:24.120 14:23:38 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:24.120 14:23:38 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 405236' 00:19:24.120 killing process with pid 405236 00:19:24.120 14:23:38 -- common/autotest_common.sh@955 -- # kill 405236 00:19:24.120 14:23:38 -- common/autotest_common.sh@960 -- # wait 405236 00:19:24.377 14:23:38 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:19:24.377 14:23:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:24.377 14:23:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:24.377 14:23:38 -- target/tls.sh@212 -- # echo '{ 00:19:24.377 "subsystems": [ 00:19:24.377 { 00:19:24.377 "subsystem": "iobuf", 00:19:24.377 "config": [ 00:19:24.377 { 00:19:24.377 "method": "iobuf_set_options", 00:19:24.377 "params": { 00:19:24.377 "small_pool_count": 8192, 00:19:24.377 "large_pool_count": 1024, 00:19:24.377 "small_bufsize": 8192, 00:19:24.377 "large_bufsize": 135168 00:19:24.377 } 00:19:24.377 } 00:19:24.377 ] 00:19:24.377 }, 00:19:24.377 { 00:19:24.377 "subsystem": "sock", 00:19:24.377 "config": [ 00:19:24.377 { 00:19:24.377 "method": "sock_impl_set_options", 00:19:24.377 "params": { 00:19:24.377 "impl_name": "posix", 00:19:24.377 "recv_buf_size": 2097152, 00:19:24.377 "send_buf_size": 2097152, 00:19:24.377 "enable_recv_pipe": true, 00:19:24.377 "enable_quickack": false, 00:19:24.377 "enable_placement_id": 0, 00:19:24.377 "enable_zerocopy_send_server": true, 00:19:24.377 "enable_zerocopy_send_client": false, 00:19:24.377 "zerocopy_threshold": 0, 00:19:24.377 "tls_version": 0, 00:19:24.377 "enable_ktls": false 00:19:24.377 } 00:19:24.377 }, 00:19:24.377 { 00:19:24.377 "method": "sock_impl_set_options", 00:19:24.377 "params": { 00:19:24.377 "impl_name": "ssl", 00:19:24.377 "recv_buf_size": 4096, 00:19:24.377 "send_buf_size": 4096, 00:19:24.377 "enable_recv_pipe": true, 00:19:24.377 "enable_quickack": false, 00:19:24.377 "enable_placement_id": 0, 00:19:24.377 "enable_zerocopy_send_server": true, 00:19:24.377 "enable_zerocopy_send_client": false, 00:19:24.377 "zerocopy_threshold": 0, 00:19:24.377 "tls_version": 0, 00:19:24.377 "enable_ktls": false 00:19:24.377 } 00:19:24.377 } 00:19:24.377 ] 00:19:24.377 }, 00:19:24.377 { 00:19:24.377 "subsystem": "vmd", 00:19:24.377 "config": [] 00:19:24.377 }, 00:19:24.377 { 00:19:24.377 "subsystem": "accel", 00:19:24.377 "config": [ 00:19:24.377 { 00:19:24.377 "method": "accel_set_options", 00:19:24.377 "params": { 00:19:24.377 "small_cache_size": 128, 00:19:24.377 "large_cache_size": 16, 00:19:24.377 "task_count": 2048, 00:19:24.377 "sequence_count": 2048, 00:19:24.377 "buf_count": 2048 00:19:24.377 } 00:19:24.377 } 00:19:24.377 ] 00:19:24.377 }, 00:19:24.377 { 00:19:24.377 "subsystem": "bdev", 00:19:24.377 "config": [ 00:19:24.377 { 00:19:24.377 "method": "bdev_set_options", 00:19:24.377 "params": { 00:19:24.377 "bdev_io_pool_size": 65535, 00:19:24.377 "bdev_io_cache_size": 256, 00:19:24.377 "bdev_auto_examine": true, 00:19:24.377 "iobuf_small_cache_size": 128, 00:19:24.377 "iobuf_large_cache_size": 16 00:19:24.377 } 00:19:24.377 }, 00:19:24.377 { 00:19:24.377 "method": "bdev_raid_set_options", 00:19:24.377 "params": { 00:19:24.377 "process_window_size_kb": 1024 00:19:24.377 } 00:19:24.377 }, 00:19:24.377 { 00:19:24.377 "method": "bdev_iscsi_set_options", 00:19:24.377 "params": { 00:19:24.377 "timeout_sec": 30 00:19:24.377 } 00:19:24.377 }, 00:19:24.377 { 00:19:24.377 "method": "bdev_nvme_set_options", 00:19:24.377 "params": { 00:19:24.377 "action_on_timeout": "none", 00:19:24.377 "timeout_us": 0, 00:19:24.377 "timeout_admin_us": 0, 00:19:24.377 "keep_alive_timeout_ms": 10000, 00:19:24.377 "transport_retry_count": 4, 00:19:24.377 "arbitration_burst": 0, 00:19:24.377 "low_priority_weight": 0, 00:19:24.377 "medium_priority_weight": 0, 00:19:24.377 "high_priority_weight": 0, 00:19:24.377 "nvme_adminq_poll_period_us": 10000, 00:19:24.377 "nvme_ioq_poll_period_us": 0, 00:19:24.377 "io_queue_requests": 0, 00:19:24.377 "delay_cmd_submit": true, 00:19:24.377 "bdev_retry_count": 3, 00:19:24.377 "transport_ack_timeout": 0, 00:19:24.377 "ctrlr_loss_timeout_sec": 0, 00:19:24.377 "reconnect_delay_sec": 0, 00:19:24.377 "fast_io_fail_timeout_sec": 0, 00:19:24.378 "generate_uuids": false, 00:19:24.378 "transport_tos": 0, 00:19:24.378 "io_path_stat": false, 00:19:24.378 "allow_accel_sequence": false 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "bdev_nvme_set_hotplug", 00:19:24.378 "params": { 00:19:24.378 "period_us": 100000, 00:19:24.378 "enable": false 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "bdev_malloc_create", 00:19:24.378 "params": { 00:19:24.378 "name": "malloc0", 00:19:24.378 "num_blocks": 8192, 00:19:24.378 "block_size": 4096, 00:19:24.378 "physical_block_size": 4096, 00:19:24.378 "uuid": "a99177f3-f6db-4945-9746-277a93602581", 00:19:24.378 "optimal_io_boundary": 0 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "bdev_wait_for_examine" 00:19:24.378 } 00:19:24.378 ] 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "subsystem": "nbd", 00:19:24.378 "config": [] 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "subsystem": "scheduler", 00:19:24.378 "config": [ 00:19:24.378 { 00:19:24.378 "method": "framework_set_scheduler", 00:19:24.378 "params": { 00:19:24.378 "name": "static" 00:19:24.378 } 00:19:24.378 } 00:19:24.378 ] 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "subsystem": "nvmf", 00:19:24.378 "config": [ 00:19:24.378 { 00:19:24.378 "method": "nvmf_set_config", 00:19:24.378 "params": { 00:19:24.378 "discovery_filter": "match_any", 00:19:24.378 "admin_cmd_passthru": { 00:19:24.378 "identify_ctrlr": false 00:19:24.378 } 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "nvmf_set_max_subsystems", 00:19:24.378 "params": { 00:19:24.378 "max_subsystems": 1024 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "nvmf_set_crdt", 00:19:24.378 "params": { 00:19:24.378 "crdt1": 0, 00:19:24.378 "crdt2": 0, 00:19:24.378 "crdt3": 0 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "nvmf_create_transport", 00:19:24.378 "params": { 00:19:24.378 "trtype": "TCP", 00:19:24.378 "max_queue_depth": 128, 00:19:24.378 "max_io_qpairs_per_ctrlr": 127, 00:19:24.378 "in_capsule_data_size": 4096, 00:19:24.378 "max_io_size": 131072, 00:19:24.378 "io_unit_size": 131072, 00:19:24.378 "max_aq_depth": 128, 00:19:24.378 "num_shared_buffers": 511, 00:19:24.378 "buf_cache_size": 4294967295, 00:19:24.378 "dif_insert_or_strip": false, 00:19:24.378 "zcopy": false, 00:19:24.378 "c2h_success": false, 00:19:24.378 "sock_priority": 0, 00:19:24.378 "abort_timeout_sec": 1 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "nvmf_create_subsystem", 00:19:24.378 "params": { 00:19:24.378 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:24.378 "allow_any_host": false, 00:19:24.378 "serial_number": "SPDK00000000000001", 00:19:24.378 "model_number": "SPDK bdev Controller", 00:19:24.378 "max_namespaces": 10, 00:19:24.378 "min_cntlid": 1, 00:19:24.378 "max_cntlid": 65519, 00:19:24.378 "ana_reporting": false 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "nvmf_subsystem_add_host", 00:19:24.378 "params": { 00:19:24.378 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:24.378 "host": "nqn.2016-06.io.spdk:host1", 00:19:24.378 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "nvmf_subsystem_add_ns", 00:19:24.378 "params": { 00:19:24.378 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:24.378 "namespace": { 00:19:24.378 "nsid": 1, 00:19:24.378 "bdev_name": "malloc0", 00:19:24.378 "nguid": "A99177F3F6DB49459746277A93602581", 00:19:24.378 "uuid": "a99177f3-f6db-4945-9746-277a93602581" 00:19:24.378 } 00:19:24.378 } 00:19:24.378 }, 00:19:24.378 { 00:19:24.378 "method": "nvmf_subsystem_add_listener", 00:19:24.378 "params": { 00:19:24.378 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:19:24.378 "listen_address": { 00:19:24.378 "trtype": "TCP", 00:19:24.378 "adrfam": "IPv4", 00:19:24.378 "traddr": "10.0.0.2", 00:19:24.378 "trsvcid": "4420" 00:19:24.378 }, 00:19:24.378 "secure_channel": true 00:19:24.378 } 00:19:24.378 } 00:19:24.378 ] 00:19:24.378 } 00:19:24.378 ] 00:19:24.378 }' 00:19:24.378 14:23:38 -- common/autotest_common.sh@10 -- # set +x 00:19:24.378 14:23:38 -- nvmf/common.sh@469 -- # nvmfpid=405969 00:19:24.378 14:23:38 -- nvmf/common.sh@470 -- # waitforlisten 405969 00:19:24.378 14:23:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:19:24.378 14:23:38 -- common/autotest_common.sh@829 -- # '[' -z 405969 ']' 00:19:24.378 14:23:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:24.378 14:23:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:24.378 14:23:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:24.378 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:24.378 14:23:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:24.378 14:23:38 -- common/autotest_common.sh@10 -- # set +x 00:19:24.378 [2024-12-16 14:23:38.888073] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:24.378 [2024-12-16 14:23:38.888120] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:24.378 EAL: No free 2048 kB hugepages reported on node 1 00:19:24.378 [2024-12-16 14:23:38.944220] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:24.636 [2024-12-16 14:23:39.017508] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:24.636 [2024-12-16 14:23:39.017610] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:24.636 [2024-12-16 14:23:39.017617] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:24.636 [2024-12-16 14:23:39.017624] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:24.636 [2024-12-16 14:23:39.017643] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:24.636 [2024-12-16 14:23:39.209324] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:24.894 [2024-12-16 14:23:39.241358] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:24.894 [2024-12-16 14:23:39.241546] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:25.152 14:23:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:25.152 14:23:39 -- common/autotest_common.sh@862 -- # return 0 00:19:25.152 14:23:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:25.152 14:23:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:25.152 14:23:39 -- common/autotest_common.sh@10 -- # set +x 00:19:25.410 14:23:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:25.410 14:23:39 -- target/tls.sh@216 -- # bdevperf_pid=406001 00:19:25.410 14:23:39 -- target/tls.sh@217 -- # waitforlisten 406001 /var/tmp/bdevperf.sock 00:19:25.410 14:23:39 -- common/autotest_common.sh@829 -- # '[' -z 406001 ']' 00:19:25.410 14:23:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:25.410 14:23:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:25.410 14:23:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:25.410 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:25.410 14:23:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:25.410 14:23:39 -- common/autotest_common.sh@10 -- # set +x 00:19:25.410 14:23:39 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:19:25.410 14:23:39 -- target/tls.sh@213 -- # echo '{ 00:19:25.410 "subsystems": [ 00:19:25.410 { 00:19:25.410 "subsystem": "iobuf", 00:19:25.410 "config": [ 00:19:25.410 { 00:19:25.410 "method": "iobuf_set_options", 00:19:25.410 "params": { 00:19:25.410 "small_pool_count": 8192, 00:19:25.410 "large_pool_count": 1024, 00:19:25.410 "small_bufsize": 8192, 00:19:25.410 "large_bufsize": 135168 00:19:25.410 } 00:19:25.410 } 00:19:25.410 ] 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "subsystem": "sock", 00:19:25.410 "config": [ 00:19:25.410 { 00:19:25.410 "method": "sock_impl_set_options", 00:19:25.410 "params": { 00:19:25.410 "impl_name": "posix", 00:19:25.410 "recv_buf_size": 2097152, 00:19:25.410 "send_buf_size": 2097152, 00:19:25.410 "enable_recv_pipe": true, 00:19:25.410 "enable_quickack": false, 00:19:25.410 "enable_placement_id": 0, 00:19:25.410 "enable_zerocopy_send_server": true, 00:19:25.410 "enable_zerocopy_send_client": false, 00:19:25.410 "zerocopy_threshold": 0, 00:19:25.410 "tls_version": 0, 00:19:25.410 "enable_ktls": false 00:19:25.410 } 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "method": "sock_impl_set_options", 00:19:25.410 "params": { 00:19:25.410 "impl_name": "ssl", 00:19:25.410 "recv_buf_size": 4096, 00:19:25.410 "send_buf_size": 4096, 00:19:25.410 "enable_recv_pipe": true, 00:19:25.410 "enable_quickack": false, 00:19:25.410 "enable_placement_id": 0, 00:19:25.410 "enable_zerocopy_send_server": true, 00:19:25.410 "enable_zerocopy_send_client": false, 00:19:25.410 "zerocopy_threshold": 0, 00:19:25.410 "tls_version": 0, 00:19:25.410 "enable_ktls": false 00:19:25.410 } 00:19:25.410 } 00:19:25.410 ] 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "subsystem": "vmd", 00:19:25.410 "config": [] 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "subsystem": "accel", 00:19:25.410 "config": [ 00:19:25.410 { 00:19:25.410 "method": "accel_set_options", 00:19:25.410 "params": { 00:19:25.410 "small_cache_size": 128, 00:19:25.410 "large_cache_size": 16, 00:19:25.410 "task_count": 2048, 00:19:25.410 "sequence_count": 2048, 00:19:25.410 "buf_count": 2048 00:19:25.410 } 00:19:25.410 } 00:19:25.410 ] 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "subsystem": "bdev", 00:19:25.410 "config": [ 00:19:25.410 { 00:19:25.410 "method": "bdev_set_options", 00:19:25.410 "params": { 00:19:25.410 "bdev_io_pool_size": 65535, 00:19:25.410 "bdev_io_cache_size": 256, 00:19:25.410 "bdev_auto_examine": true, 00:19:25.410 "iobuf_small_cache_size": 128, 00:19:25.410 "iobuf_large_cache_size": 16 00:19:25.410 } 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "method": "bdev_raid_set_options", 00:19:25.410 "params": { 00:19:25.410 "process_window_size_kb": 1024 00:19:25.410 } 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "method": "bdev_iscsi_set_options", 00:19:25.410 "params": { 00:19:25.410 "timeout_sec": 30 00:19:25.410 } 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "method": "bdev_nvme_set_options", 00:19:25.410 "params": { 00:19:25.410 "action_on_timeout": "none", 00:19:25.410 "timeout_us": 0, 00:19:25.410 "timeout_admin_us": 0, 00:19:25.410 "keep_alive_timeout_ms": 10000, 00:19:25.410 "transport_retry_count": 4, 00:19:25.410 "arbitration_burst": 0, 00:19:25.410 "low_priority_weight": 0, 00:19:25.410 "medium_priority_weight": 0, 00:19:25.410 "high_priority_weight": 0, 00:19:25.410 "nvme_adminq_poll_period_us": 10000, 00:19:25.410 "nvme_ioq_poll_period_us": 0, 00:19:25.410 "io_queue_requests": 512, 00:19:25.410 "delay_cmd_submit": true, 00:19:25.410 "bdev_retry_count": 3, 00:19:25.410 "transport_ack_timeout": 0, 00:19:25.410 "ctrlr_loss_timeout_sec": 0, 00:19:25.410 "reconnect_delay_sec": 0, 00:19:25.410 "fast_io_fail_timeout_sec": 0, 00:19:25.410 "generate_uuids": false, 00:19:25.410 "transport_tos": 0, 00:19:25.410 "io_path_stat": false, 00:19:25.410 "allow_accel_sequence": false 00:19:25.410 } 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "method": "bdev_nvme_attach_controller", 00:19:25.410 "params": { 00:19:25.410 "name": "TLSTEST", 00:19:25.410 "trtype": "TCP", 00:19:25.410 "adrfam": "IPv4", 00:19:25.410 "traddr": "10.0.0.2", 00:19:25.410 "trsvcid": "4420", 00:19:25.410 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:25.410 "prchk_reftag": false, 00:19:25.410 "prchk_guard": false, 00:19:25.410 "ctrlr_loss_timeout_sec": 0, 00:19:25.410 "reconnect_delay_sec": 0, 00:19:25.410 "fast_io_fail_timeout_sec": 0, 00:19:25.410 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:19:25.410 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:25.410 "hdgst": false, 00:19:25.410 "ddgst": false 00:19:25.410 } 00:19:25.410 }, 00:19:25.410 { 00:19:25.410 "method": "bdev_nvme_set_hotplug", 00:19:25.411 "params": { 00:19:25.411 "period_us": 100000, 00:19:25.411 "enable": false 00:19:25.411 } 00:19:25.411 }, 00:19:25.411 { 00:19:25.411 "method": "bdev_wait_for_examine" 00:19:25.411 } 00:19:25.411 ] 00:19:25.411 }, 00:19:25.411 { 00:19:25.411 "subsystem": "nbd", 00:19:25.411 "config": [] 00:19:25.411 } 00:19:25.411 ] 00:19:25.411 }' 00:19:25.411 [2024-12-16 14:23:39.774898] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:25.411 [2024-12-16 14:23:39.774950] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid406001 ] 00:19:25.411 EAL: No free 2048 kB hugepages reported on node 1 00:19:25.411 [2024-12-16 14:23:39.827622] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:25.411 [2024-12-16 14:23:39.896797] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:25.669 [2024-12-16 14:23:40.032479] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:26.234 14:23:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:26.234 14:23:40 -- common/autotest_common.sh@862 -- # return 0 00:19:26.234 14:23:40 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:19:26.234 Running I/O for 10 seconds... 00:19:36.203 00:19:36.203 Latency(us) 00:19:36.203 [2024-12-16T13:23:50.777Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:36.203 [2024-12-16T13:23:50.777Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:36.203 Verification LBA range: start 0x0 length 0x2000 00:19:36.203 TLSTESTn1 : 10.02 6600.41 25.78 0.00 0.00 19369.72 3495.25 71902.35 00:19:36.203 [2024-12-16T13:23:50.777Z] =================================================================================================================== 00:19:36.203 [2024-12-16T13:23:50.777Z] Total : 6600.41 25.78 0.00 0.00 19369.72 3495.25 71902.35 00:19:36.203 0 00:19:36.203 14:23:50 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:19:36.203 14:23:50 -- target/tls.sh@223 -- # killprocess 406001 00:19:36.203 14:23:50 -- common/autotest_common.sh@936 -- # '[' -z 406001 ']' 00:19:36.203 14:23:50 -- common/autotest_common.sh@940 -- # kill -0 406001 00:19:36.203 14:23:50 -- common/autotest_common.sh@941 -- # uname 00:19:36.203 14:23:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:36.203 14:23:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 406001 00:19:36.461 14:23:50 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:36.461 14:23:50 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:36.461 14:23:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 406001' 00:19:36.461 killing process with pid 406001 00:19:36.461 14:23:50 -- common/autotest_common.sh@955 -- # kill 406001 00:19:36.461 Received shutdown signal, test time was about 10.000000 seconds 00:19:36.461 00:19:36.461 Latency(us) 00:19:36.461 [2024-12-16T13:23:51.035Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:36.461 [2024-12-16T13:23:51.035Z] =================================================================================================================== 00:19:36.461 [2024-12-16T13:23:51.035Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:36.461 14:23:50 -- common/autotest_common.sh@960 -- # wait 406001 00:19:36.461 14:23:50 -- target/tls.sh@224 -- # killprocess 405969 00:19:36.461 14:23:50 -- common/autotest_common.sh@936 -- # '[' -z 405969 ']' 00:19:36.461 14:23:50 -- common/autotest_common.sh@940 -- # kill -0 405969 00:19:36.461 14:23:50 -- common/autotest_common.sh@941 -- # uname 00:19:36.461 14:23:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:36.461 14:23:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 405969 00:19:36.720 14:23:51 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:36.720 14:23:51 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:36.720 14:23:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 405969' 00:19:36.720 killing process with pid 405969 00:19:36.720 14:23:51 -- common/autotest_common.sh@955 -- # kill 405969 00:19:36.720 14:23:51 -- common/autotest_common.sh@960 -- # wait 405969 00:19:36.720 14:23:51 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:19:36.720 14:23:51 -- target/tls.sh@227 -- # cleanup 00:19:36.720 14:23:51 -- target/tls.sh@15 -- # process_shm --id 0 00:19:36.720 14:23:51 -- common/autotest_common.sh@806 -- # type=--id 00:19:36.720 14:23:51 -- common/autotest_common.sh@807 -- # id=0 00:19:36.720 14:23:51 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:19:36.720 14:23:51 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:19:36.720 14:23:51 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:19:36.720 14:23:51 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:19:36.720 14:23:51 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:19:36.720 14:23:51 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:19:36.720 nvmf_trace.0 00:19:36.979 14:23:51 -- common/autotest_common.sh@821 -- # return 0 00:19:36.979 14:23:51 -- target/tls.sh@16 -- # killprocess 406001 00:19:36.979 14:23:51 -- common/autotest_common.sh@936 -- # '[' -z 406001 ']' 00:19:36.979 14:23:51 -- common/autotest_common.sh@940 -- # kill -0 406001 00:19:36.979 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (406001) - No such process 00:19:36.979 14:23:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 406001 is not found' 00:19:36.979 Process with pid 406001 is not found 00:19:36.979 14:23:51 -- target/tls.sh@17 -- # nvmftestfini 00:19:36.979 14:23:51 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:36.979 14:23:51 -- nvmf/common.sh@116 -- # sync 00:19:36.979 14:23:51 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:36.979 14:23:51 -- nvmf/common.sh@119 -- # set +e 00:19:36.979 14:23:51 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:36.979 14:23:51 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:36.979 rmmod nvme_tcp 00:19:36.979 rmmod nvme_fabrics 00:19:36.979 rmmod nvme_keyring 00:19:36.979 14:23:51 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:36.979 14:23:51 -- nvmf/common.sh@123 -- # set -e 00:19:36.979 14:23:51 -- nvmf/common.sh@124 -- # return 0 00:19:36.979 14:23:51 -- nvmf/common.sh@477 -- # '[' -n 405969 ']' 00:19:36.979 14:23:51 -- nvmf/common.sh@478 -- # killprocess 405969 00:19:36.979 14:23:51 -- common/autotest_common.sh@936 -- # '[' -z 405969 ']' 00:19:36.979 14:23:51 -- common/autotest_common.sh@940 -- # kill -0 405969 00:19:36.979 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (405969) - No such process 00:19:36.979 14:23:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 405969 is not found' 00:19:36.979 Process with pid 405969 is not found 00:19:36.979 14:23:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:36.979 14:23:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:36.979 14:23:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:36.979 14:23:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:36.979 14:23:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:36.979 14:23:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:36.979 14:23:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:36.979 14:23:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:38.883 14:23:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:38.883 14:23:53 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:19:39.142 00:19:39.142 real 1m12.665s 00:19:39.142 user 1m47.214s 00:19:39.142 sys 0m28.204s 00:19:39.142 14:23:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:39.142 14:23:53 -- common/autotest_common.sh@10 -- # set +x 00:19:39.142 ************************************ 00:19:39.142 END TEST nvmf_tls 00:19:39.142 ************************************ 00:19:39.142 14:23:53 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:19:39.142 14:23:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:39.142 14:23:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:39.142 14:23:53 -- common/autotest_common.sh@10 -- # set +x 00:19:39.142 ************************************ 00:19:39.142 START TEST nvmf_fips 00:19:39.142 ************************************ 00:19:39.142 14:23:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:19:39.142 * Looking for test storage... 00:19:39.142 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:19:39.142 14:23:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:39.142 14:23:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:39.142 14:23:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:39.142 14:23:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:39.142 14:23:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:39.142 14:23:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:39.142 14:23:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:39.142 14:23:53 -- scripts/common.sh@335 -- # IFS=.-: 00:19:39.142 14:23:53 -- scripts/common.sh@335 -- # read -ra ver1 00:19:39.142 14:23:53 -- scripts/common.sh@336 -- # IFS=.-: 00:19:39.142 14:23:53 -- scripts/common.sh@336 -- # read -ra ver2 00:19:39.142 14:23:53 -- scripts/common.sh@337 -- # local 'op=<' 00:19:39.142 14:23:53 -- scripts/common.sh@339 -- # ver1_l=2 00:19:39.142 14:23:53 -- scripts/common.sh@340 -- # ver2_l=1 00:19:39.142 14:23:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:39.142 14:23:53 -- scripts/common.sh@343 -- # case "$op" in 00:19:39.142 14:23:53 -- scripts/common.sh@344 -- # : 1 00:19:39.142 14:23:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:39.142 14:23:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:39.142 14:23:53 -- scripts/common.sh@364 -- # decimal 1 00:19:39.142 14:23:53 -- scripts/common.sh@352 -- # local d=1 00:19:39.142 14:23:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:39.142 14:23:53 -- scripts/common.sh@354 -- # echo 1 00:19:39.142 14:23:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:39.142 14:23:53 -- scripts/common.sh@365 -- # decimal 2 00:19:39.142 14:23:53 -- scripts/common.sh@352 -- # local d=2 00:19:39.142 14:23:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:39.142 14:23:53 -- scripts/common.sh@354 -- # echo 2 00:19:39.142 14:23:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:39.142 14:23:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:39.142 14:23:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:39.142 14:23:53 -- scripts/common.sh@367 -- # return 0 00:19:39.142 14:23:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:39.142 14:23:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:39.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:39.142 --rc genhtml_branch_coverage=1 00:19:39.142 --rc genhtml_function_coverage=1 00:19:39.142 --rc genhtml_legend=1 00:19:39.142 --rc geninfo_all_blocks=1 00:19:39.142 --rc geninfo_unexecuted_blocks=1 00:19:39.142 00:19:39.142 ' 00:19:39.142 14:23:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:39.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:39.142 --rc genhtml_branch_coverage=1 00:19:39.142 --rc genhtml_function_coverage=1 00:19:39.142 --rc genhtml_legend=1 00:19:39.142 --rc geninfo_all_blocks=1 00:19:39.142 --rc geninfo_unexecuted_blocks=1 00:19:39.142 00:19:39.142 ' 00:19:39.142 14:23:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:39.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:39.142 --rc genhtml_branch_coverage=1 00:19:39.142 --rc genhtml_function_coverage=1 00:19:39.142 --rc genhtml_legend=1 00:19:39.142 --rc geninfo_all_blocks=1 00:19:39.142 --rc geninfo_unexecuted_blocks=1 00:19:39.142 00:19:39.142 ' 00:19:39.142 14:23:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:39.142 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:39.142 --rc genhtml_branch_coverage=1 00:19:39.142 --rc genhtml_function_coverage=1 00:19:39.142 --rc genhtml_legend=1 00:19:39.142 --rc geninfo_all_blocks=1 00:19:39.142 --rc geninfo_unexecuted_blocks=1 00:19:39.142 00:19:39.142 ' 00:19:39.142 14:23:53 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:39.142 14:23:53 -- nvmf/common.sh@7 -- # uname -s 00:19:39.142 14:23:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:39.142 14:23:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:39.142 14:23:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:39.142 14:23:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:39.142 14:23:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:39.142 14:23:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:39.142 14:23:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:39.142 14:23:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:39.142 14:23:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:39.142 14:23:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:39.142 14:23:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:19:39.142 14:23:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:19:39.142 14:23:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:39.142 14:23:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:39.142 14:23:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:39.142 14:23:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:39.142 14:23:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:39.142 14:23:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:39.142 14:23:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:39.142 14:23:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.142 14:23:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.142 14:23:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.142 14:23:53 -- paths/export.sh@5 -- # export PATH 00:19:39.143 14:23:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:39.143 14:23:53 -- nvmf/common.sh@46 -- # : 0 00:19:39.143 14:23:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:39.143 14:23:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:39.143 14:23:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:39.143 14:23:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:39.143 14:23:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:39.143 14:23:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:39.143 14:23:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:39.143 14:23:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:39.143 14:23:53 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:39.143 14:23:53 -- fips/fips.sh@89 -- # check_openssl_version 00:19:39.143 14:23:53 -- fips/fips.sh@83 -- # local target=3.0.0 00:19:39.143 14:23:53 -- fips/fips.sh@85 -- # openssl version 00:19:39.143 14:23:53 -- fips/fips.sh@85 -- # awk '{print $2}' 00:19:39.143 14:23:53 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:19:39.143 14:23:53 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:19:39.143 14:23:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:39.143 14:23:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:39.143 14:23:53 -- scripts/common.sh@335 -- # IFS=.-: 00:19:39.143 14:23:53 -- scripts/common.sh@335 -- # read -ra ver1 00:19:39.143 14:23:53 -- scripts/common.sh@336 -- # IFS=.-: 00:19:39.143 14:23:53 -- scripts/common.sh@336 -- # read -ra ver2 00:19:39.143 14:23:53 -- scripts/common.sh@337 -- # local 'op=>=' 00:19:39.143 14:23:53 -- scripts/common.sh@339 -- # ver1_l=3 00:19:39.143 14:23:53 -- scripts/common.sh@340 -- # ver2_l=3 00:19:39.143 14:23:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:39.143 14:23:53 -- scripts/common.sh@343 -- # case "$op" in 00:19:39.143 14:23:53 -- scripts/common.sh@347 -- # : 1 00:19:39.143 14:23:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:39.143 14:23:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:39.143 14:23:53 -- scripts/common.sh@364 -- # decimal 3 00:19:39.143 14:23:53 -- scripts/common.sh@352 -- # local d=3 00:19:39.143 14:23:53 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:19:39.143 14:23:53 -- scripts/common.sh@354 -- # echo 3 00:19:39.143 14:23:53 -- scripts/common.sh@364 -- # ver1[v]=3 00:19:39.143 14:23:53 -- scripts/common.sh@365 -- # decimal 3 00:19:39.143 14:23:53 -- scripts/common.sh@352 -- # local d=3 00:19:39.143 14:23:53 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:19:39.143 14:23:53 -- scripts/common.sh@354 -- # echo 3 00:19:39.401 14:23:53 -- scripts/common.sh@365 -- # ver2[v]=3 00:19:39.401 14:23:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:39.401 14:23:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:39.401 14:23:53 -- scripts/common.sh@363 -- # (( v++ )) 00:19:39.401 14:23:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:39.401 14:23:53 -- scripts/common.sh@364 -- # decimal 1 00:19:39.401 14:23:53 -- scripts/common.sh@352 -- # local d=1 00:19:39.401 14:23:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:39.401 14:23:53 -- scripts/common.sh@354 -- # echo 1 00:19:39.401 14:23:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:39.401 14:23:53 -- scripts/common.sh@365 -- # decimal 0 00:19:39.401 14:23:53 -- scripts/common.sh@352 -- # local d=0 00:19:39.401 14:23:53 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:19:39.401 14:23:53 -- scripts/common.sh@354 -- # echo 0 00:19:39.401 14:23:53 -- scripts/common.sh@365 -- # ver2[v]=0 00:19:39.401 14:23:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:39.401 14:23:53 -- scripts/common.sh@366 -- # return 0 00:19:39.401 14:23:53 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:19:39.401 14:23:53 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:19:39.401 14:23:53 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:19:39.401 14:23:53 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:19:39.401 14:23:53 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:19:39.401 14:23:53 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:19:39.401 14:23:53 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:19:39.401 14:23:53 -- fips/fips.sh@113 -- # build_openssl_config 00:19:39.401 14:23:53 -- fips/fips.sh@37 -- # cat 00:19:39.401 14:23:53 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:19:39.401 14:23:53 -- fips/fips.sh@58 -- # cat - 00:19:39.401 14:23:53 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:19:39.401 14:23:53 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:19:39.401 14:23:53 -- fips/fips.sh@116 -- # mapfile -t providers 00:19:39.401 14:23:53 -- fips/fips.sh@116 -- # openssl list -providers 00:19:39.401 14:23:53 -- fips/fips.sh@116 -- # grep name 00:19:39.401 14:23:53 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:19:39.401 14:23:53 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:19:39.401 14:23:53 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:19:39.401 14:23:53 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:19:39.401 14:23:53 -- common/autotest_common.sh@650 -- # local es=0 00:19:39.401 14:23:53 -- fips/fips.sh@127 -- # : 00:19:39.401 14:23:53 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:19:39.401 14:23:53 -- common/autotest_common.sh@638 -- # local arg=openssl 00:19:39.401 14:23:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:39.401 14:23:53 -- common/autotest_common.sh@642 -- # type -t openssl 00:19:39.401 14:23:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:39.401 14:23:53 -- common/autotest_common.sh@644 -- # type -P openssl 00:19:39.401 14:23:53 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:19:39.401 14:23:53 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:19:39.401 14:23:53 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:19:39.401 14:23:53 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:19:39.401 Error setting digest 00:19:39.401 4082A9F00E7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:19:39.401 4082A9F00E7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:19:39.401 14:23:53 -- common/autotest_common.sh@653 -- # es=1 00:19:39.401 14:23:53 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:19:39.401 14:23:53 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:19:39.401 14:23:53 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:19:39.401 14:23:53 -- fips/fips.sh@130 -- # nvmftestinit 00:19:39.401 14:23:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:39.401 14:23:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:39.401 14:23:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:39.401 14:23:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:39.401 14:23:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:39.401 14:23:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:39.401 14:23:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:39.401 14:23:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:39.401 14:23:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:39.401 14:23:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:39.401 14:23:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:39.401 14:23:53 -- common/autotest_common.sh@10 -- # set +x 00:19:44.664 14:23:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:44.664 14:23:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:44.664 14:23:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:44.664 14:23:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:44.664 14:23:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:44.664 14:23:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:44.664 14:23:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:44.664 14:23:58 -- nvmf/common.sh@294 -- # net_devs=() 00:19:44.664 14:23:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:44.664 14:23:58 -- nvmf/common.sh@295 -- # e810=() 00:19:44.664 14:23:58 -- nvmf/common.sh@295 -- # local -ga e810 00:19:44.664 14:23:58 -- nvmf/common.sh@296 -- # x722=() 00:19:44.664 14:23:58 -- nvmf/common.sh@296 -- # local -ga x722 00:19:44.664 14:23:58 -- nvmf/common.sh@297 -- # mlx=() 00:19:44.664 14:23:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:44.664 14:23:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:44.664 14:23:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:44.664 14:23:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:44.664 14:23:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:44.664 14:23:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:44.664 14:23:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:19:44.664 Found 0000:af:00.0 (0x8086 - 0x159b) 00:19:44.664 14:23:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:44.664 14:23:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:19:44.664 Found 0000:af:00.1 (0x8086 - 0x159b) 00:19:44.664 14:23:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:44.664 14:23:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:44.665 14:23:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:44.665 14:23:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:44.665 14:23:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:44.665 14:23:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:44.665 14:23:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:19:44.665 Found net devices under 0000:af:00.0: cvl_0_0 00:19:44.665 14:23:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:44.665 14:23:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:44.665 14:23:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:44.665 14:23:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:44.665 14:23:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:44.665 14:23:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:19:44.665 Found net devices under 0000:af:00.1: cvl_0_1 00:19:44.665 14:23:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:44.665 14:23:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:44.665 14:23:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:44.665 14:23:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:44.665 14:23:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:44.665 14:23:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:44.665 14:23:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:44.665 14:23:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:44.665 14:23:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:44.665 14:23:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:44.665 14:23:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:44.665 14:23:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:44.665 14:23:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:44.665 14:23:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:44.665 14:23:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:44.665 14:23:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:44.665 14:23:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:44.665 14:23:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:44.665 14:23:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:44.665 14:23:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:44.665 14:23:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:44.665 14:23:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:44.665 14:23:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:44.665 14:23:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:44.665 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:44.665 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.403 ms 00:19:44.665 00:19:44.665 --- 10.0.0.2 ping statistics --- 00:19:44.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:44.665 rtt min/avg/max/mdev = 0.403/0.403/0.403/0.000 ms 00:19:44.665 14:23:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:44.665 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:44.665 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.237 ms 00:19:44.665 00:19:44.665 --- 10.0.0.1 ping statistics --- 00:19:44.665 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:44.665 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:19:44.665 14:23:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:44.665 14:23:58 -- nvmf/common.sh@410 -- # return 0 00:19:44.665 14:23:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:44.665 14:23:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:44.665 14:23:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:44.665 14:23:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:44.665 14:23:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:44.665 14:23:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:44.665 14:23:58 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:19:44.665 14:23:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:44.665 14:23:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:44.665 14:23:58 -- common/autotest_common.sh@10 -- # set +x 00:19:44.665 14:23:58 -- nvmf/common.sh@469 -- # nvmfpid=411317 00:19:44.665 14:23:58 -- nvmf/common.sh@470 -- # waitforlisten 411317 00:19:44.665 14:23:58 -- common/autotest_common.sh@829 -- # '[' -z 411317 ']' 00:19:44.665 14:23:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:44.665 14:23:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:44.665 14:23:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:44.665 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:44.665 14:23:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:44.665 14:23:58 -- common/autotest_common.sh@10 -- # set +x 00:19:44.665 14:23:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:19:44.665 [2024-12-16 14:23:58.925987] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:44.665 [2024-12-16 14:23:58.926035] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:44.665 EAL: No free 2048 kB hugepages reported on node 1 00:19:44.665 [2024-12-16 14:23:58.984285] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:44.665 [2024-12-16 14:23:59.056460] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:44.665 [2024-12-16 14:23:59.056560] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:44.665 [2024-12-16 14:23:59.056568] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:44.665 [2024-12-16 14:23:59.056578] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:44.665 [2024-12-16 14:23:59.056594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:45.295 14:23:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:45.295 14:23:59 -- common/autotest_common.sh@862 -- # return 0 00:19:45.295 14:23:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:45.295 14:23:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:45.295 14:23:59 -- common/autotest_common.sh@10 -- # set +x 00:19:45.295 14:23:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:45.295 14:23:59 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:19:45.295 14:23:59 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:19:45.295 14:23:59 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:45.295 14:23:59 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:19:45.295 14:23:59 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:45.295 14:23:59 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:45.295 14:23:59 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:45.295 14:23:59 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:45.553 [2024-12-16 14:23:59.906613] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:45.553 [2024-12-16 14:23:59.922622] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:19:45.553 [2024-12-16 14:23:59.922764] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:45.553 malloc0 00:19:45.553 14:23:59 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:19:45.553 14:23:59 -- fips/fips.sh@147 -- # bdevperf_pid=411561 00:19:45.553 14:23:59 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:19:45.553 14:23:59 -- fips/fips.sh@148 -- # waitforlisten 411561 /var/tmp/bdevperf.sock 00:19:45.553 14:23:59 -- common/autotest_common.sh@829 -- # '[' -z 411561 ']' 00:19:45.553 14:23:59 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:19:45.553 14:23:59 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:45.553 14:23:59 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:19:45.553 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:19:45.553 14:23:59 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:45.553 14:23:59 -- common/autotest_common.sh@10 -- # set +x 00:19:45.553 [2024-12-16 14:24:00.027406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:45.553 [2024-12-16 14:24:00.027460] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid411561 ] 00:19:45.553 EAL: No free 2048 kB hugepages reported on node 1 00:19:45.553 [2024-12-16 14:24:00.079071] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:19:45.811 [2024-12-16 14:24:00.151667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:46.376 14:24:00 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:46.376 14:24:00 -- common/autotest_common.sh@862 -- # return 0 00:19:46.376 14:24:00 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:46.634 [2024-12-16 14:24:00.994316] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:19:46.634 TLSTESTn1 00:19:46.634 14:24:01 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:19:46.634 Running I/O for 10 seconds... 00:19:58.838 00:19:58.838 Latency(us) 00:19:58.838 [2024-12-16T13:24:13.412Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:58.838 [2024-12-16T13:24:13.412Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:19:58.838 Verification LBA range: start 0x0 length 0x2000 00:19:58.838 TLSTESTn1 : 10.01 6730.41 26.29 0.00 0.00 18997.81 3885.35 39196.77 00:19:58.838 [2024-12-16T13:24:13.412Z] =================================================================================================================== 00:19:58.838 [2024-12-16T13:24:13.412Z] Total : 6730.41 26.29 0.00 0.00 18997.81 3885.35 39196.77 00:19:58.838 0 00:19:58.838 14:24:11 -- fips/fips.sh@1 -- # cleanup 00:19:58.838 14:24:11 -- fips/fips.sh@15 -- # process_shm --id 0 00:19:58.838 14:24:11 -- common/autotest_common.sh@806 -- # type=--id 00:19:58.838 14:24:11 -- common/autotest_common.sh@807 -- # id=0 00:19:58.838 14:24:11 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:19:58.838 14:24:11 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:19:58.838 14:24:11 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:19:58.838 14:24:11 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:19:58.838 14:24:11 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:19:58.838 14:24:11 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:19:58.838 nvmf_trace.0 00:19:58.838 14:24:11 -- common/autotest_common.sh@821 -- # return 0 00:19:58.838 14:24:11 -- fips/fips.sh@16 -- # killprocess 411561 00:19:58.838 14:24:11 -- common/autotest_common.sh@936 -- # '[' -z 411561 ']' 00:19:58.838 14:24:11 -- common/autotest_common.sh@940 -- # kill -0 411561 00:19:58.838 14:24:11 -- common/autotest_common.sh@941 -- # uname 00:19:58.838 14:24:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:58.838 14:24:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 411561 00:19:58.838 14:24:11 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:19:58.838 14:24:11 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:19:58.838 14:24:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 411561' 00:19:58.838 killing process with pid 411561 00:19:58.838 14:24:11 -- common/autotest_common.sh@955 -- # kill 411561 00:19:58.838 Received shutdown signal, test time was about 10.000000 seconds 00:19:58.838 00:19:58.838 Latency(us) 00:19:58.838 [2024-12-16T13:24:13.412Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:58.838 [2024-12-16T13:24:13.412Z] =================================================================================================================== 00:19:58.838 [2024-12-16T13:24:13.412Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:19:58.838 14:24:11 -- common/autotest_common.sh@960 -- # wait 411561 00:19:58.838 14:24:11 -- fips/fips.sh@17 -- # nvmftestfini 00:19:58.838 14:24:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:58.838 14:24:11 -- nvmf/common.sh@116 -- # sync 00:19:58.838 14:24:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:58.838 14:24:11 -- nvmf/common.sh@119 -- # set +e 00:19:58.838 14:24:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:58.838 14:24:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:58.838 rmmod nvme_tcp 00:19:58.838 rmmod nvme_fabrics 00:19:58.838 rmmod nvme_keyring 00:19:58.838 14:24:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:58.838 14:24:11 -- nvmf/common.sh@123 -- # set -e 00:19:58.838 14:24:11 -- nvmf/common.sh@124 -- # return 0 00:19:58.838 14:24:11 -- nvmf/common.sh@477 -- # '[' -n 411317 ']' 00:19:58.838 14:24:11 -- nvmf/common.sh@478 -- # killprocess 411317 00:19:58.838 14:24:11 -- common/autotest_common.sh@936 -- # '[' -z 411317 ']' 00:19:58.838 14:24:11 -- common/autotest_common.sh@940 -- # kill -0 411317 00:19:58.838 14:24:11 -- common/autotest_common.sh@941 -- # uname 00:19:58.838 14:24:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:58.838 14:24:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 411317 00:19:58.838 14:24:11 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:58.838 14:24:11 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:58.838 14:24:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 411317' 00:19:58.838 killing process with pid 411317 00:19:58.838 14:24:11 -- common/autotest_common.sh@955 -- # kill 411317 00:19:58.838 14:24:11 -- common/autotest_common.sh@960 -- # wait 411317 00:19:58.838 14:24:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:58.838 14:24:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:58.839 14:24:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:58.839 14:24:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:58.839 14:24:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:58.839 14:24:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:58.839 14:24:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:58.839 14:24:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:59.405 14:24:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:59.405 14:24:13 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:19:59.405 00:19:59.405 real 0m20.427s 00:19:59.405 user 0m21.572s 00:19:59.405 sys 0m9.513s 00:19:59.405 14:24:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:59.405 14:24:13 -- common/autotest_common.sh@10 -- # set +x 00:19:59.405 ************************************ 00:19:59.405 END TEST nvmf_fips 00:19:59.405 ************************************ 00:19:59.405 14:24:13 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:19:59.405 14:24:13 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:19:59.405 14:24:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:59.405 14:24:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:59.405 14:24:13 -- common/autotest_common.sh@10 -- # set +x 00:19:59.405 ************************************ 00:19:59.405 START TEST nvmf_fuzz 00:19:59.405 ************************************ 00:19:59.405 14:24:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:19:59.664 * Looking for test storage... 00:19:59.664 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:59.664 14:24:14 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:59.664 14:24:14 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:59.664 14:24:14 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:59.664 14:24:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:59.664 14:24:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:59.664 14:24:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:59.664 14:24:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:59.664 14:24:14 -- scripts/common.sh@335 -- # IFS=.-: 00:19:59.664 14:24:14 -- scripts/common.sh@335 -- # read -ra ver1 00:19:59.664 14:24:14 -- scripts/common.sh@336 -- # IFS=.-: 00:19:59.664 14:24:14 -- scripts/common.sh@336 -- # read -ra ver2 00:19:59.664 14:24:14 -- scripts/common.sh@337 -- # local 'op=<' 00:19:59.664 14:24:14 -- scripts/common.sh@339 -- # ver1_l=2 00:19:59.664 14:24:14 -- scripts/common.sh@340 -- # ver2_l=1 00:19:59.664 14:24:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:59.664 14:24:14 -- scripts/common.sh@343 -- # case "$op" in 00:19:59.664 14:24:14 -- scripts/common.sh@344 -- # : 1 00:19:59.664 14:24:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:59.664 14:24:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:59.664 14:24:14 -- scripts/common.sh@364 -- # decimal 1 00:19:59.664 14:24:14 -- scripts/common.sh@352 -- # local d=1 00:19:59.664 14:24:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:59.664 14:24:14 -- scripts/common.sh@354 -- # echo 1 00:19:59.664 14:24:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:59.664 14:24:14 -- scripts/common.sh@365 -- # decimal 2 00:19:59.664 14:24:14 -- scripts/common.sh@352 -- # local d=2 00:19:59.664 14:24:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:59.664 14:24:14 -- scripts/common.sh@354 -- # echo 2 00:19:59.664 14:24:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:59.664 14:24:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:59.664 14:24:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:59.664 14:24:14 -- scripts/common.sh@367 -- # return 0 00:19:59.664 14:24:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:59.664 14:24:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:59.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:59.664 --rc genhtml_branch_coverage=1 00:19:59.664 --rc genhtml_function_coverage=1 00:19:59.664 --rc genhtml_legend=1 00:19:59.664 --rc geninfo_all_blocks=1 00:19:59.664 --rc geninfo_unexecuted_blocks=1 00:19:59.664 00:19:59.664 ' 00:19:59.664 14:24:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:59.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:59.664 --rc genhtml_branch_coverage=1 00:19:59.664 --rc genhtml_function_coverage=1 00:19:59.664 --rc genhtml_legend=1 00:19:59.664 --rc geninfo_all_blocks=1 00:19:59.664 --rc geninfo_unexecuted_blocks=1 00:19:59.664 00:19:59.664 ' 00:19:59.664 14:24:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:59.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:59.664 --rc genhtml_branch_coverage=1 00:19:59.664 --rc genhtml_function_coverage=1 00:19:59.664 --rc genhtml_legend=1 00:19:59.664 --rc geninfo_all_blocks=1 00:19:59.664 --rc geninfo_unexecuted_blocks=1 00:19:59.664 00:19:59.664 ' 00:19:59.664 14:24:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:59.664 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:59.664 --rc genhtml_branch_coverage=1 00:19:59.664 --rc genhtml_function_coverage=1 00:19:59.664 --rc genhtml_legend=1 00:19:59.664 --rc geninfo_all_blocks=1 00:19:59.664 --rc geninfo_unexecuted_blocks=1 00:19:59.664 00:19:59.664 ' 00:19:59.664 14:24:14 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:59.664 14:24:14 -- nvmf/common.sh@7 -- # uname -s 00:19:59.664 14:24:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:59.664 14:24:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:59.664 14:24:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:59.665 14:24:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:59.665 14:24:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:59.665 14:24:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:59.665 14:24:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:59.665 14:24:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:59.665 14:24:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:59.665 14:24:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:59.665 14:24:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:19:59.665 14:24:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:19:59.665 14:24:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:59.665 14:24:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:59.665 14:24:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:59.665 14:24:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:59.665 14:24:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:59.665 14:24:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:59.665 14:24:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:59.665 14:24:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.665 14:24:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.665 14:24:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.665 14:24:14 -- paths/export.sh@5 -- # export PATH 00:19:59.665 14:24:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:59.665 14:24:14 -- nvmf/common.sh@46 -- # : 0 00:19:59.665 14:24:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:59.665 14:24:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:59.665 14:24:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:59.665 14:24:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:59.665 14:24:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:59.665 14:24:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:59.665 14:24:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:59.665 14:24:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:59.665 14:24:14 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:19:59.665 14:24:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:59.665 14:24:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:59.665 14:24:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:59.665 14:24:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:59.665 14:24:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:59.665 14:24:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:59.665 14:24:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:59.665 14:24:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:59.665 14:24:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:59.665 14:24:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:59.665 14:24:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:59.665 14:24:14 -- common/autotest_common.sh@10 -- # set +x 00:20:04.935 14:24:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:04.935 14:24:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:04.935 14:24:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:04.935 14:24:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:04.935 14:24:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:04.935 14:24:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:04.935 14:24:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:04.935 14:24:19 -- nvmf/common.sh@294 -- # net_devs=() 00:20:04.935 14:24:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:04.935 14:24:19 -- nvmf/common.sh@295 -- # e810=() 00:20:04.935 14:24:19 -- nvmf/common.sh@295 -- # local -ga e810 00:20:04.935 14:24:19 -- nvmf/common.sh@296 -- # x722=() 00:20:04.935 14:24:19 -- nvmf/common.sh@296 -- # local -ga x722 00:20:04.935 14:24:19 -- nvmf/common.sh@297 -- # mlx=() 00:20:04.935 14:24:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:04.935 14:24:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:04.935 14:24:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:04.935 14:24:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:04.935 14:24:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:04.935 14:24:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:04.935 14:24:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:20:04.935 Found 0000:af:00.0 (0x8086 - 0x159b) 00:20:04.935 14:24:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:04.935 14:24:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:20:04.935 Found 0000:af:00.1 (0x8086 - 0x159b) 00:20:04.935 14:24:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:04.935 14:24:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:04.935 14:24:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:04.935 14:24:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:04.935 14:24:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:04.935 14:24:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:20:04.935 Found net devices under 0000:af:00.0: cvl_0_0 00:20:04.935 14:24:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:04.935 14:24:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:04.935 14:24:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:04.935 14:24:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:04.935 14:24:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:04.935 14:24:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:20:04.935 Found net devices under 0000:af:00.1: cvl_0_1 00:20:04.935 14:24:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:04.935 14:24:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:04.935 14:24:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:04.935 14:24:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:04.935 14:24:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:04.935 14:24:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:04.935 14:24:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:04.935 14:24:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:04.935 14:24:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:04.935 14:24:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:04.935 14:24:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:04.936 14:24:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:04.936 14:24:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:04.936 14:24:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:04.936 14:24:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:04.936 14:24:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:04.936 14:24:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:04.936 14:24:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:04.936 14:24:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:04.936 14:24:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:04.936 14:24:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:04.936 14:24:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:04.936 14:24:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:04.936 14:24:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:04.936 14:24:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:04.936 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:04.936 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.428 ms 00:20:04.936 00:20:04.936 --- 10.0.0.2 ping statistics --- 00:20:04.936 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:04.936 rtt min/avg/max/mdev = 0.428/0.428/0.428/0.000 ms 00:20:04.936 14:24:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:04.936 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:04.936 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.197 ms 00:20:04.936 00:20:04.936 --- 10.0.0.1 ping statistics --- 00:20:04.936 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:04.936 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:20:04.936 14:24:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:04.936 14:24:19 -- nvmf/common.sh@410 -- # return 0 00:20:04.936 14:24:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:04.936 14:24:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:04.936 14:24:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:04.936 14:24:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:04.936 14:24:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:04.936 14:24:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:04.936 14:24:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:05.195 14:24:19 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=417380 00:20:05.195 14:24:19 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:20:05.195 14:24:19 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:20:05.195 14:24:19 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 417380 00:20:05.195 14:24:19 -- common/autotest_common.sh@829 -- # '[' -z 417380 ']' 00:20:05.195 14:24:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:05.195 14:24:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:05.195 14:24:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:05.195 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:05.195 14:24:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:05.195 14:24:19 -- common/autotest_common.sh@10 -- # set +x 00:20:06.140 14:24:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:06.140 14:24:20 -- common/autotest_common.sh@862 -- # return 0 00:20:06.140 14:24:20 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:06.140 14:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.140 14:24:20 -- common/autotest_common.sh@10 -- # set +x 00:20:06.140 14:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.140 14:24:20 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:20:06.140 14:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.140 14:24:20 -- common/autotest_common.sh@10 -- # set +x 00:20:06.140 Malloc0 00:20:06.140 14:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.140 14:24:20 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:20:06.140 14:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.140 14:24:20 -- common/autotest_common.sh@10 -- # set +x 00:20:06.140 14:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.140 14:24:20 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:20:06.140 14:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.140 14:24:20 -- common/autotest_common.sh@10 -- # set +x 00:20:06.140 14:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.140 14:24:20 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:06.140 14:24:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:06.140 14:24:20 -- common/autotest_common.sh@10 -- # set +x 00:20:06.140 14:24:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:06.140 14:24:20 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:20:06.140 14:24:20 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:20:38.213 Fuzzing completed. Shutting down the fuzz application 00:20:38.214 00:20:38.214 Dumping successful admin opcodes: 00:20:38.214 8, 9, 10, 24, 00:20:38.214 Dumping successful io opcodes: 00:20:38.214 0, 9, 00:20:38.214 NS: 0x200003aeff00 I/O qp, Total commands completed: 1000685, total successful commands: 5860, random_seed: 366816128 00:20:38.214 NS: 0x200003aeff00 admin qp, Total commands completed: 129148, total successful commands: 1047, random_seed: 1370615680 00:20:38.214 14:24:51 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:20:38.214 Fuzzing completed. Shutting down the fuzz application 00:20:38.214 00:20:38.214 Dumping successful admin opcodes: 00:20:38.214 24, 00:20:38.214 Dumping successful io opcodes: 00:20:38.214 00:20:38.214 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 418096150 00:20:38.214 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 418177594 00:20:38.214 14:24:52 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:20:38.214 14:24:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:38.214 14:24:52 -- common/autotest_common.sh@10 -- # set +x 00:20:38.214 14:24:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:38.214 14:24:52 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:20:38.214 14:24:52 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:20:38.214 14:24:52 -- nvmf/common.sh@476 -- # nvmfcleanup 00:20:38.214 14:24:52 -- nvmf/common.sh@116 -- # sync 00:20:38.214 14:24:52 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:20:38.214 14:24:52 -- nvmf/common.sh@119 -- # set +e 00:20:38.214 14:24:52 -- nvmf/common.sh@120 -- # for i in {1..20} 00:20:38.214 14:24:52 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:20:38.214 rmmod nvme_tcp 00:20:38.214 rmmod nvme_fabrics 00:20:38.214 rmmod nvme_keyring 00:20:38.214 14:24:52 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:20:38.214 14:24:52 -- nvmf/common.sh@123 -- # set -e 00:20:38.214 14:24:52 -- nvmf/common.sh@124 -- # return 0 00:20:38.214 14:24:52 -- nvmf/common.sh@477 -- # '[' -n 417380 ']' 00:20:38.214 14:24:52 -- nvmf/common.sh@478 -- # killprocess 417380 00:20:38.214 14:24:52 -- common/autotest_common.sh@936 -- # '[' -z 417380 ']' 00:20:38.214 14:24:52 -- common/autotest_common.sh@940 -- # kill -0 417380 00:20:38.214 14:24:52 -- common/autotest_common.sh@941 -- # uname 00:20:38.214 14:24:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:38.214 14:24:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 417380 00:20:38.214 14:24:52 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:20:38.214 14:24:52 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:20:38.214 14:24:52 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 417380' 00:20:38.214 killing process with pid 417380 00:20:38.214 14:24:52 -- common/autotest_common.sh@955 -- # kill 417380 00:20:38.214 14:24:52 -- common/autotest_common.sh@960 -- # wait 417380 00:20:38.214 14:24:52 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:20:38.214 14:24:52 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:20:38.214 14:24:52 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:20:38.214 14:24:52 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:20:38.214 14:24:52 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:20:38.214 14:24:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:38.214 14:24:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:38.214 14:24:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:40.749 14:24:54 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:40.749 14:24:54 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:20:40.749 00:20:40.749 real 0m40.891s 00:20:40.749 user 0m54.986s 00:20:40.749 sys 0m15.460s 00:20:40.749 14:24:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:40.749 14:24:54 -- common/autotest_common.sh@10 -- # set +x 00:20:40.749 ************************************ 00:20:40.749 END TEST nvmf_fuzz 00:20:40.749 ************************************ 00:20:40.749 14:24:54 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:20:40.749 14:24:54 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:40.749 14:24:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:40.749 14:24:54 -- common/autotest_common.sh@10 -- # set +x 00:20:40.749 ************************************ 00:20:40.749 START TEST nvmf_multiconnection 00:20:40.749 ************************************ 00:20:40.749 14:24:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:20:40.749 * Looking for test storage... 00:20:40.749 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:40.749 14:24:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:40.749 14:24:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:40.749 14:24:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:40.749 14:24:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:40.749 14:24:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:40.749 14:24:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:40.749 14:24:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:40.749 14:24:55 -- scripts/common.sh@335 -- # IFS=.-: 00:20:40.749 14:24:55 -- scripts/common.sh@335 -- # read -ra ver1 00:20:40.749 14:24:55 -- scripts/common.sh@336 -- # IFS=.-: 00:20:40.749 14:24:55 -- scripts/common.sh@336 -- # read -ra ver2 00:20:40.749 14:24:55 -- scripts/common.sh@337 -- # local 'op=<' 00:20:40.749 14:24:55 -- scripts/common.sh@339 -- # ver1_l=2 00:20:40.749 14:24:55 -- scripts/common.sh@340 -- # ver2_l=1 00:20:40.749 14:24:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:40.749 14:24:55 -- scripts/common.sh@343 -- # case "$op" in 00:20:40.749 14:24:55 -- scripts/common.sh@344 -- # : 1 00:20:40.749 14:24:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:40.749 14:24:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:40.749 14:24:55 -- scripts/common.sh@364 -- # decimal 1 00:20:40.749 14:24:55 -- scripts/common.sh@352 -- # local d=1 00:20:40.749 14:24:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:40.749 14:24:55 -- scripts/common.sh@354 -- # echo 1 00:20:40.749 14:24:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:40.749 14:24:55 -- scripts/common.sh@365 -- # decimal 2 00:20:40.749 14:24:55 -- scripts/common.sh@352 -- # local d=2 00:20:40.749 14:24:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:40.749 14:24:55 -- scripts/common.sh@354 -- # echo 2 00:20:40.749 14:24:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:40.749 14:24:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:40.749 14:24:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:40.749 14:24:55 -- scripts/common.sh@367 -- # return 0 00:20:40.749 14:24:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:40.749 14:24:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:40.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.749 --rc genhtml_branch_coverage=1 00:20:40.749 --rc genhtml_function_coverage=1 00:20:40.749 --rc genhtml_legend=1 00:20:40.749 --rc geninfo_all_blocks=1 00:20:40.749 --rc geninfo_unexecuted_blocks=1 00:20:40.749 00:20:40.749 ' 00:20:40.749 14:24:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:40.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.749 --rc genhtml_branch_coverage=1 00:20:40.749 --rc genhtml_function_coverage=1 00:20:40.749 --rc genhtml_legend=1 00:20:40.749 --rc geninfo_all_blocks=1 00:20:40.749 --rc geninfo_unexecuted_blocks=1 00:20:40.749 00:20:40.749 ' 00:20:40.749 14:24:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:40.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.749 --rc genhtml_branch_coverage=1 00:20:40.749 --rc genhtml_function_coverage=1 00:20:40.749 --rc genhtml_legend=1 00:20:40.749 --rc geninfo_all_blocks=1 00:20:40.749 --rc geninfo_unexecuted_blocks=1 00:20:40.749 00:20:40.749 ' 00:20:40.749 14:24:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:40.749 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:40.749 --rc genhtml_branch_coverage=1 00:20:40.749 --rc genhtml_function_coverage=1 00:20:40.749 --rc genhtml_legend=1 00:20:40.749 --rc geninfo_all_blocks=1 00:20:40.749 --rc geninfo_unexecuted_blocks=1 00:20:40.749 00:20:40.749 ' 00:20:40.749 14:24:55 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:40.749 14:24:55 -- nvmf/common.sh@7 -- # uname -s 00:20:40.749 14:24:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:40.749 14:24:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:40.749 14:24:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:40.749 14:24:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:40.750 14:24:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:40.750 14:24:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:40.750 14:24:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:40.750 14:24:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:40.750 14:24:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:40.750 14:24:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:40.750 14:24:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:20:40.750 14:24:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:20:40.750 14:24:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:40.750 14:24:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:40.750 14:24:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:40.750 14:24:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:40.750 14:24:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:40.750 14:24:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:40.750 14:24:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:40.750 14:24:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.750 14:24:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.750 14:24:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.750 14:24:55 -- paths/export.sh@5 -- # export PATH 00:20:40.750 14:24:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:40.750 14:24:55 -- nvmf/common.sh@46 -- # : 0 00:20:40.750 14:24:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:40.750 14:24:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:40.750 14:24:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:40.750 14:24:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:40.750 14:24:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:40.750 14:24:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:40.750 14:24:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:40.750 14:24:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:40.750 14:24:55 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:20:40.750 14:24:55 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:20:40.750 14:24:55 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:20:40.750 14:24:55 -- target/multiconnection.sh@16 -- # nvmftestinit 00:20:40.750 14:24:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:40.750 14:24:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:40.750 14:24:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:40.750 14:24:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:40.750 14:24:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:40.750 14:24:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:40.750 14:24:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:40.750 14:24:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:40.750 14:24:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:40.750 14:24:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:40.750 14:24:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:40.750 14:24:55 -- common/autotest_common.sh@10 -- # set +x 00:20:46.024 14:25:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:46.024 14:25:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:46.024 14:25:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:46.024 14:25:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:46.024 14:25:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:46.024 14:25:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:46.024 14:25:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:46.024 14:25:00 -- nvmf/common.sh@294 -- # net_devs=() 00:20:46.024 14:25:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:46.024 14:25:00 -- nvmf/common.sh@295 -- # e810=() 00:20:46.024 14:25:00 -- nvmf/common.sh@295 -- # local -ga e810 00:20:46.024 14:25:00 -- nvmf/common.sh@296 -- # x722=() 00:20:46.024 14:25:00 -- nvmf/common.sh@296 -- # local -ga x722 00:20:46.024 14:25:00 -- nvmf/common.sh@297 -- # mlx=() 00:20:46.024 14:25:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:46.024 14:25:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:46.024 14:25:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:46.024 14:25:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:46.024 14:25:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:46.024 14:25:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:46.024 14:25:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:20:46.024 Found 0000:af:00.0 (0x8086 - 0x159b) 00:20:46.024 14:25:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:46.024 14:25:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:20:46.024 Found 0000:af:00.1 (0x8086 - 0x159b) 00:20:46.024 14:25:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:46.024 14:25:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:46.024 14:25:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:46.024 14:25:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:46.024 14:25:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:46.024 14:25:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:20:46.024 Found net devices under 0000:af:00.0: cvl_0_0 00:20:46.024 14:25:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:46.024 14:25:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:46.024 14:25:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:46.024 14:25:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:46.024 14:25:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:46.024 14:25:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:20:46.024 Found net devices under 0000:af:00.1: cvl_0_1 00:20:46.024 14:25:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:46.024 14:25:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:46.024 14:25:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:46.024 14:25:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:46.024 14:25:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:46.024 14:25:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:46.024 14:25:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:46.024 14:25:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:46.024 14:25:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:46.024 14:25:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:46.024 14:25:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:46.024 14:25:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:46.024 14:25:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:46.024 14:25:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:46.024 14:25:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:46.024 14:25:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:46.024 14:25:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:46.283 14:25:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:46.283 14:25:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:46.283 14:25:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:46.283 14:25:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:46.283 14:25:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:46.283 14:25:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:46.283 14:25:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:46.283 14:25:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:46.283 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:46.283 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.161 ms 00:20:46.283 00:20:46.283 --- 10.0.0.2 ping statistics --- 00:20:46.283 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:46.283 rtt min/avg/max/mdev = 0.161/0.161/0.161/0.000 ms 00:20:46.283 14:25:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:46.283 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:46.283 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.220 ms 00:20:46.283 00:20:46.283 --- 10.0.0.1 ping statistics --- 00:20:46.283 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:46.283 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:20:46.283 14:25:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:46.283 14:25:00 -- nvmf/common.sh@410 -- # return 0 00:20:46.283 14:25:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:46.284 14:25:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:46.284 14:25:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:46.284 14:25:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:46.284 14:25:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:46.284 14:25:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:46.284 14:25:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:46.543 14:25:00 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:20:46.543 14:25:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:46.543 14:25:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:46.543 14:25:00 -- common/autotest_common.sh@10 -- # set +x 00:20:46.543 14:25:00 -- nvmf/common.sh@469 -- # nvmfpid=426294 00:20:46.543 14:25:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:20:46.543 14:25:00 -- nvmf/common.sh@470 -- # waitforlisten 426294 00:20:46.543 14:25:00 -- common/autotest_common.sh@829 -- # '[' -z 426294 ']' 00:20:46.543 14:25:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:46.543 14:25:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:46.543 14:25:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:46.543 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:46.543 14:25:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:46.543 14:25:00 -- common/autotest_common.sh@10 -- # set +x 00:20:46.543 [2024-12-16 14:25:00.920592] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:46.543 [2024-12-16 14:25:00.920643] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:46.543 EAL: No free 2048 kB hugepages reported on node 1 00:20:46.543 [2024-12-16 14:25:00.981390] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:20:46.543 [2024-12-16 14:25:01.053772] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:46.543 [2024-12-16 14:25:01.053891] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:46.543 [2024-12-16 14:25:01.053898] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:46.543 [2024-12-16 14:25:01.053921] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:46.543 [2024-12-16 14:25:01.053973] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:46.543 [2024-12-16 14:25:01.054098] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:46.543 [2024-12-16 14:25:01.054166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:20:46.543 [2024-12-16 14:25:01.054167] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:20:47.481 14:25:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:47.481 14:25:01 -- common/autotest_common.sh@862 -- # return 0 00:20:47.481 14:25:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:47.481 14:25:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:47.481 14:25:01 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 [2024-12-16 14:25:01.779190] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@21 -- # seq 1 11 00:20:47.481 14:25:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.481 14:25:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 Malloc1 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 [2024-12-16 14:25:01.834612] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.481 14:25:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 Malloc2 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.481 14:25:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 Malloc3 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.481 14:25:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 Malloc4 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.481 14:25:01 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 Malloc5 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:01 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:20:47.481 14:25:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:01 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.481 14:25:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:20:47.481 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 Malloc6 00:20:47.481 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:20:47.481 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:20:47.481 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:20:47.481 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.481 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.481 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.481 14:25:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.482 14:25:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:20:47.482 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.482 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 Malloc7 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.741 14:25:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 Malloc8 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.741 14:25:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 Malloc9 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.741 14:25:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 Malloc10 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.741 14:25:02 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 Malloc11 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:20:47.741 14:25:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:20:47.741 14:25:02 -- common/autotest_common.sh@10 -- # set +x 00:20:47.741 14:25:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:20:47.741 14:25:02 -- target/multiconnection.sh@28 -- # seq 1 11 00:20:47.741 14:25:02 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:47.741 14:25:02 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:20:49.119 14:25:03 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:20:49.119 14:25:03 -- common/autotest_common.sh@1187 -- # local i=0 00:20:49.119 14:25:03 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:49.119 14:25:03 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:49.119 14:25:03 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:51.022 14:25:05 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:51.022 14:25:05 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:51.022 14:25:05 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:20:51.022 14:25:05 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:51.022 14:25:05 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:51.022 14:25:05 -- common/autotest_common.sh@1197 -- # return 0 00:20:51.022 14:25:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:51.022 14:25:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:20:52.401 14:25:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:20:52.401 14:25:06 -- common/autotest_common.sh@1187 -- # local i=0 00:20:52.401 14:25:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:52.401 14:25:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:52.401 14:25:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:54.307 14:25:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:54.307 14:25:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:54.307 14:25:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:20:54.307 14:25:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:54.307 14:25:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:54.307 14:25:08 -- common/autotest_common.sh@1197 -- # return 0 00:20:54.307 14:25:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:54.307 14:25:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:20:55.761 14:25:09 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:20:55.761 14:25:09 -- common/autotest_common.sh@1187 -- # local i=0 00:20:55.761 14:25:09 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:55.761 14:25:09 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:55.762 14:25:09 -- common/autotest_common.sh@1194 -- # sleep 2 00:20:57.696 14:25:11 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:20:57.696 14:25:11 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:20:57.696 14:25:11 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:20:57.696 14:25:11 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:20:57.696 14:25:11 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:20:57.696 14:25:11 -- common/autotest_common.sh@1197 -- # return 0 00:20:57.696 14:25:11 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:20:57.696 14:25:11 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:20:58.632 14:25:13 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:20:58.632 14:25:13 -- common/autotest_common.sh@1187 -- # local i=0 00:20:58.632 14:25:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:20:58.632 14:25:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:20:58.632 14:25:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:01.168 14:25:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:01.168 14:25:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:01.168 14:25:15 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:21:01.168 14:25:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:01.168 14:25:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:01.168 14:25:15 -- common/autotest_common.sh@1197 -- # return 0 00:21:01.168 14:25:15 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:01.168 14:25:15 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:21:02.106 14:25:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:21:02.106 14:25:16 -- common/autotest_common.sh@1187 -- # local i=0 00:21:02.106 14:25:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:02.106 14:25:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:02.106 14:25:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:04.011 14:25:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:04.011 14:25:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:04.011 14:25:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:21:04.011 14:25:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:04.011 14:25:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:04.011 14:25:18 -- common/autotest_common.sh@1197 -- # return 0 00:21:04.011 14:25:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:04.011 14:25:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:21:05.391 14:25:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:21:05.391 14:25:19 -- common/autotest_common.sh@1187 -- # local i=0 00:21:05.391 14:25:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:05.391 14:25:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:05.391 14:25:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:07.296 14:25:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:07.296 14:25:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:07.296 14:25:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:21:07.296 14:25:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:07.296 14:25:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:07.296 14:25:21 -- common/autotest_common.sh@1197 -- # return 0 00:21:07.296 14:25:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:07.296 14:25:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:21:08.674 14:25:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:21:08.674 14:25:22 -- common/autotest_common.sh@1187 -- # local i=0 00:21:08.674 14:25:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:08.674 14:25:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:08.674 14:25:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:10.579 14:25:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:10.579 14:25:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:10.579 14:25:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:21:10.579 14:25:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:10.579 14:25:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:10.579 14:25:24 -- common/autotest_common.sh@1197 -- # return 0 00:21:10.579 14:25:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:10.579 14:25:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:21:11.959 14:25:26 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:21:11.959 14:25:26 -- common/autotest_common.sh@1187 -- # local i=0 00:21:11.959 14:25:26 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:11.959 14:25:26 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:11.959 14:25:26 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:13.863 14:25:28 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:13.863 14:25:28 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:13.863 14:25:28 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:21:13.863 14:25:28 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:13.863 14:25:28 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:13.863 14:25:28 -- common/autotest_common.sh@1197 -- # return 0 00:21:13.863 14:25:28 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:13.863 14:25:28 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:21:15.241 14:25:29 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:21:15.241 14:25:29 -- common/autotest_common.sh@1187 -- # local i=0 00:21:15.241 14:25:29 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:15.241 14:25:29 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:15.241 14:25:29 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:17.144 14:25:31 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:17.144 14:25:31 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:17.144 14:25:31 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:21:17.144 14:25:31 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:17.144 14:25:31 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:17.144 14:25:31 -- common/autotest_common.sh@1197 -- # return 0 00:21:17.144 14:25:31 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:17.144 14:25:31 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:21:18.522 14:25:33 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:21:18.522 14:25:33 -- common/autotest_common.sh@1187 -- # local i=0 00:21:18.522 14:25:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:18.522 14:25:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:18.522 14:25:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:21.056 14:25:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:21.056 14:25:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:21.056 14:25:35 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:21:21.056 14:25:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:21.056 14:25:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:21.056 14:25:35 -- common/autotest_common.sh@1197 -- # return 0 00:21:21.056 14:25:35 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:21.056 14:25:35 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:21:21.993 14:25:36 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:21:21.993 14:25:36 -- common/autotest_common.sh@1187 -- # local i=0 00:21:21.993 14:25:36 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:21.993 14:25:36 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:21.993 14:25:36 -- common/autotest_common.sh@1194 -- # sleep 2 00:21:24.527 14:25:38 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:21:24.527 14:25:38 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:21:24.527 14:25:38 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:21:24.527 14:25:38 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:21:24.527 14:25:38 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:21:24.528 14:25:38 -- common/autotest_common.sh@1197 -- # return 0 00:21:24.528 14:25:38 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:21:24.528 [global] 00:21:24.528 thread=1 00:21:24.528 invalidate=1 00:21:24.528 rw=read 00:21:24.528 time_based=1 00:21:24.528 runtime=10 00:21:24.528 ioengine=libaio 00:21:24.528 direct=1 00:21:24.528 bs=262144 00:21:24.528 iodepth=64 00:21:24.528 norandommap=1 00:21:24.528 numjobs=1 00:21:24.528 00:21:24.528 [job0] 00:21:24.528 filename=/dev/nvme0n1 00:21:24.528 [job1] 00:21:24.528 filename=/dev/nvme10n1 00:21:24.528 [job2] 00:21:24.528 filename=/dev/nvme1n1 00:21:24.528 [job3] 00:21:24.528 filename=/dev/nvme2n1 00:21:24.528 [job4] 00:21:24.528 filename=/dev/nvme3n1 00:21:24.528 [job5] 00:21:24.528 filename=/dev/nvme4n1 00:21:24.528 [job6] 00:21:24.528 filename=/dev/nvme5n1 00:21:24.528 [job7] 00:21:24.528 filename=/dev/nvme6n1 00:21:24.528 [job8] 00:21:24.528 filename=/dev/nvme7n1 00:21:24.528 [job9] 00:21:24.528 filename=/dev/nvme8n1 00:21:24.528 [job10] 00:21:24.528 filename=/dev/nvme9n1 00:21:24.528 Could not set queue depth (nvme0n1) 00:21:24.528 Could not set queue depth (nvme10n1) 00:21:24.528 Could not set queue depth (nvme1n1) 00:21:24.528 Could not set queue depth (nvme2n1) 00:21:24.528 Could not set queue depth (nvme3n1) 00:21:24.528 Could not set queue depth (nvme4n1) 00:21:24.528 Could not set queue depth (nvme5n1) 00:21:24.528 Could not set queue depth (nvme6n1) 00:21:24.528 Could not set queue depth (nvme7n1) 00:21:24.528 Could not set queue depth (nvme8n1) 00:21:24.528 Could not set queue depth (nvme9n1) 00:21:24.528 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:24.528 fio-3.35 00:21:24.528 Starting 11 threads 00:21:36.739 00:21:36.739 job0: (groupid=0, jobs=1): err= 0: pid=432935: Mon Dec 16 14:25:49 2024 00:21:36.739 read: IOPS=768, BW=192MiB/s (201MB/s)(1940MiB/10096msec) 00:21:36.739 slat (usec): min=9, max=121855, avg=620.21, stdev=3536.14 00:21:36.739 clat (usec): min=734, max=264991, avg=82578.65, stdev=44639.29 00:21:36.739 lat (usec): min=762, max=284301, avg=83198.86, stdev=45066.89 00:21:36.739 clat percentiles (msec): 00:21:36.739 | 1.00th=[ 3], 5.00th=[ 9], 10.00th=[ 17], 20.00th=[ 38], 00:21:36.739 | 30.00th=[ 58], 40.00th=[ 74], 50.00th=[ 87], 60.00th=[ 96], 00:21:36.739 | 70.00th=[ 107], 80.00th=[ 121], 90.00th=[ 142], 95.00th=[ 157], 00:21:36.739 | 99.00th=[ 180], 99.50th=[ 186], 99.90th=[ 197], 99.95th=[ 207], 00:21:36.739 | 99.99th=[ 266] 00:21:36.739 bw ( KiB/s): min=146944, max=264192, per=8.74%, avg=196966.40, stdev=32375.37, samples=20 00:21:36.739 iops : min= 574, max= 1032, avg=769.40, stdev=126.47, samples=20 00:21:36.739 lat (usec) : 750=0.01%, 1000=0.04% 00:21:36.739 lat (msec) : 2=0.19%, 4=1.66%, 10=3.69%, 20=6.10%, 50=14.73% 00:21:36.739 lat (msec) : 100=36.85%, 250=36.70%, 500=0.03% 00:21:36.739 cpu : usr=0.19%, sys=2.73%, ctx=1974, majf=0, minf=4097 00:21:36.739 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:36.739 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.739 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.739 issued rwts: total=7758,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.739 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.739 job1: (groupid=0, jobs=1): err= 0: pid=432936: Mon Dec 16 14:25:49 2024 00:21:36.739 read: IOPS=725, BW=181MiB/s (190MB/s)(1829MiB/10092msec) 00:21:36.739 slat (usec): min=14, max=69702, avg=926.86, stdev=3324.84 00:21:36.739 clat (usec): min=916, max=202686, avg=87250.55, stdev=38220.26 00:21:36.739 lat (usec): min=971, max=205636, avg=88177.41, stdev=38622.68 00:21:36.739 clat percentiles (msec): 00:21:36.739 | 1.00th=[ 3], 5.00th=[ 9], 10.00th=[ 24], 20.00th=[ 62], 00:21:36.739 | 30.00th=[ 73], 40.00th=[ 84], 50.00th=[ 92], 60.00th=[ 99], 00:21:36.739 | 70.00th=[ 107], 80.00th=[ 116], 90.00th=[ 132], 95.00th=[ 146], 00:21:36.739 | 99.00th=[ 169], 99.50th=[ 178], 99.90th=[ 199], 99.95th=[ 199], 00:21:36.739 | 99.99th=[ 203] 00:21:36.739 bw ( KiB/s): min=128512, max=272896, per=8.24%, avg=185676.80, stdev=34864.42, samples=20 00:21:36.739 iops : min= 502, max= 1066, avg=725.30, stdev=136.19, samples=20 00:21:36.739 lat (usec) : 1000=0.01% 00:21:36.739 lat (msec) : 2=0.31%, 4=1.50%, 10=3.95%, 20=3.27%, 50=6.12% 00:21:36.739 lat (msec) : 100=46.85%, 250=37.98% 00:21:36.739 cpu : usr=0.24%, sys=2.85%, ctx=1783, majf=0, minf=4097 00:21:36.739 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:21:36.739 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.739 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.739 issued rwts: total=7317,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.739 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.739 job2: (groupid=0, jobs=1): err= 0: pid=432937: Mon Dec 16 14:25:49 2024 00:21:36.739 read: IOPS=772, BW=193MiB/s (203MB/s)(1949MiB/10084msec) 00:21:36.739 slat (usec): min=9, max=118074, avg=752.88, stdev=3990.02 00:21:36.739 clat (usec): min=1663, max=264364, avg=81968.98, stdev=44192.14 00:21:36.739 lat (usec): min=1691, max=264404, avg=82721.86, stdev=44712.48 00:21:36.739 clat percentiles (msec): 00:21:36.739 | 1.00th=[ 8], 5.00th=[ 17], 10.00th=[ 25], 20.00th=[ 36], 00:21:36.739 | 30.00th=[ 51], 40.00th=[ 71], 50.00th=[ 84], 60.00th=[ 94], 00:21:36.739 | 70.00th=[ 107], 80.00th=[ 118], 90.00th=[ 138], 95.00th=[ 165], 00:21:36.739 | 99.00th=[ 192], 99.50th=[ 194], 99.90th=[ 201], 99.95th=[ 218], 00:21:36.739 | 99.99th=[ 266] 00:21:36.739 bw ( KiB/s): min=92672, max=336896, per=8.78%, avg=197932.95, stdev=58651.74, samples=20 00:21:36.739 iops : min= 362, max= 1316, avg=773.15, stdev=229.11, samples=20 00:21:36.739 lat (msec) : 2=0.01%, 4=0.19%, 10=1.31%, 20=5.52%, 50=22.61% 00:21:36.739 lat (msec) : 100=35.05%, 250=35.28%, 500=0.03% 00:21:36.739 cpu : usr=0.26%, sys=2.79%, ctx=1916, majf=0, minf=4097 00:21:36.739 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:36.739 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.739 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.739 issued rwts: total=7794,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.739 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.739 job3: (groupid=0, jobs=1): err= 0: pid=432938: Mon Dec 16 14:25:49 2024 00:21:36.739 read: IOPS=791, BW=198MiB/s (207MB/s)(1996MiB/10087msec) 00:21:36.739 slat (usec): min=12, max=74983, avg=801.77, stdev=3086.19 00:21:36.739 clat (usec): min=801, max=208404, avg=79985.74, stdev=36303.44 00:21:36.739 lat (usec): min=845, max=208433, avg=80787.51, stdev=36638.70 00:21:36.739 clat percentiles (msec): 00:21:36.739 | 1.00th=[ 4], 5.00th=[ 18], 10.00th=[ 32], 20.00th=[ 48], 00:21:36.739 | 30.00th=[ 62], 40.00th=[ 71], 50.00th=[ 83], 60.00th=[ 92], 00:21:36.739 | 70.00th=[ 101], 80.00th=[ 110], 90.00th=[ 123], 95.00th=[ 136], 00:21:36.739 | 99.00th=[ 171], 99.50th=[ 190], 99.90th=[ 205], 99.95th=[ 209], 00:21:36.739 | 99.99th=[ 209] 00:21:36.739 bw ( KiB/s): min=132608, max=359424, per=9.00%, avg=202742.80, stdev=61503.75, samples=20 00:21:36.739 iops : min= 518, max= 1404, avg=791.95, stdev=240.26, samples=20 00:21:36.739 lat (usec) : 1000=0.01% 00:21:36.739 lat (msec) : 2=0.18%, 4=0.94%, 10=2.04%, 20=2.42%, 50=16.60% 00:21:36.739 lat (msec) : 100=47.36%, 250=30.46% 00:21:36.739 cpu : usr=0.25%, sys=2.99%, ctx=1896, majf=0, minf=4097 00:21:36.739 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:36.739 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.739 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.739 issued rwts: total=7982,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.739 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.739 job4: (groupid=0, jobs=1): err= 0: pid=432939: Mon Dec 16 14:25:49 2024 00:21:36.739 read: IOPS=831, BW=208MiB/s (218MB/s)(2098MiB/10090msec) 00:21:36.739 slat (usec): min=9, max=127759, avg=806.00, stdev=3747.66 00:21:36.739 clat (usec): min=887, max=269024, avg=76065.45, stdev=41496.47 00:21:36.739 lat (usec): min=931, max=269059, avg=76871.45, stdev=41968.11 00:21:36.739 clat percentiles (msec): 00:21:36.739 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 22], 20.00th=[ 36], 00:21:36.739 | 30.00th=[ 50], 40.00th=[ 59], 50.00th=[ 77], 60.00th=[ 90], 00:21:36.739 | 70.00th=[ 102], 80.00th=[ 114], 90.00th=[ 129], 95.00th=[ 144], 00:21:36.739 | 99.00th=[ 180], 99.50th=[ 190], 99.90th=[ 192], 99.95th=[ 199], 00:21:36.739 | 99.99th=[ 271] 00:21:36.739 bw ( KiB/s): min=135680, max=294912, per=9.46%, avg=213196.80, stdev=52794.81, samples=20 00:21:36.739 iops : min= 530, max= 1152, avg=832.80, stdev=206.23, samples=20 00:21:36.739 lat (usec) : 1000=0.04% 00:21:36.739 lat (msec) : 2=0.43%, 4=0.79%, 10=3.12%, 20=4.83%, 50=20.98% 00:21:36.739 lat (msec) : 100=38.39%, 250=31.40%, 500=0.02% 00:21:36.739 cpu : usr=0.17%, sys=3.07%, ctx=1899, majf=0, minf=4097 00:21:36.739 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:36.739 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.739 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.739 issued rwts: total=8392,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.739 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.739 job5: (groupid=0, jobs=1): err= 0: pid=432940: Mon Dec 16 14:25:49 2024 00:21:36.739 read: IOPS=794, BW=199MiB/s (208MB/s)(2005MiB/10093msec) 00:21:36.739 slat (usec): min=9, max=106603, avg=805.73, stdev=3625.54 00:21:36.739 clat (usec): min=709, max=254817, avg=79660.15, stdev=44661.85 00:21:36.739 lat (usec): min=734, max=254855, avg=80465.88, stdev=45236.46 00:21:36.739 clat percentiles (msec): 00:21:36.739 | 1.00th=[ 4], 5.00th=[ 8], 10.00th=[ 15], 20.00th=[ 32], 00:21:36.739 | 30.00th=[ 55], 40.00th=[ 72], 50.00th=[ 86], 60.00th=[ 96], 00:21:36.739 | 70.00th=[ 105], 80.00th=[ 115], 90.00th=[ 136], 95.00th=[ 155], 00:21:36.739 | 99.00th=[ 180], 99.50th=[ 194], 99.90th=[ 205], 99.95th=[ 215], 00:21:36.739 | 99.99th=[ 255] 00:21:36.739 bw ( KiB/s): min=105472, max=403968, per=9.04%, avg=203648.00, stdev=70570.00, samples=20 00:21:36.739 iops : min= 412, max= 1578, avg=795.50, stdev=275.66, samples=20 00:21:36.739 lat (usec) : 750=0.04%, 1000=0.12% 00:21:36.739 lat (msec) : 2=0.29%, 4=1.36%, 10=5.09%, 20=6.60%, 50=15.15% 00:21:36.739 lat (msec) : 100=36.11%, 250=35.22%, 500=0.02% 00:21:36.739 cpu : usr=0.29%, sys=2.91%, ctx=1933, majf=0, minf=4097 00:21:36.739 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:36.739 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.739 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.739 issued rwts: total=8018,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.739 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.739 job6: (groupid=0, jobs=1): err= 0: pid=432941: Mon Dec 16 14:25:49 2024 00:21:36.739 read: IOPS=734, BW=184MiB/s (193MB/s)(1853MiB/10089msec) 00:21:36.739 slat (usec): min=11, max=103221, avg=995.81, stdev=4037.77 00:21:36.739 clat (usec): min=1587, max=210619, avg=86039.54, stdev=43422.67 00:21:36.739 lat (usec): min=1629, max=246768, avg=87035.35, stdev=44003.02 00:21:36.739 clat percentiles (msec): 00:21:36.739 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 23], 20.00th=[ 48], 00:21:36.739 | 30.00th=[ 66], 40.00th=[ 77], 50.00th=[ 86], 60.00th=[ 99], 00:21:36.739 | 70.00th=[ 110], 80.00th=[ 122], 90.00th=[ 144], 95.00th=[ 159], 00:21:36.739 | 99.00th=[ 190], 99.50th=[ 199], 99.90th=[ 201], 99.95th=[ 201], 00:21:36.739 | 99.99th=[ 211] 00:21:36.739 bw ( KiB/s): min=101888, max=312832, per=8.35%, avg=188108.80, stdev=60190.96, samples=20 00:21:36.739 iops : min= 398, max= 1222, avg=734.80, stdev=235.12, samples=20 00:21:36.739 lat (msec) : 2=0.12%, 4=1.15%, 10=2.01%, 20=5.37%, 50=12.54% 00:21:36.739 lat (msec) : 100=40.97%, 250=37.85% 00:21:36.739 cpu : usr=0.18%, sys=2.90%, ctx=1759, majf=0, minf=4097 00:21:36.739 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:21:36.739 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.739 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.739 issued rwts: total=7411,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.740 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.740 job7: (groupid=0, jobs=1): err= 0: pid=432942: Mon Dec 16 14:25:49 2024 00:21:36.740 read: IOPS=1046, BW=262MiB/s (274MB/s)(2640MiB/10096msec) 00:21:36.740 slat (usec): min=9, max=47508, avg=761.44, stdev=2687.22 00:21:36.740 clat (usec): min=966, max=216647, avg=60356.02, stdev=38876.89 00:21:36.740 lat (usec): min=1002, max=222455, avg=61117.46, stdev=39260.10 00:21:36.740 clat percentiles (msec): 00:21:36.740 | 1.00th=[ 6], 5.00th=[ 18], 10.00th=[ 26], 20.00th=[ 28], 00:21:36.740 | 30.00th=[ 31], 40.00th=[ 39], 50.00th=[ 50], 60.00th=[ 61], 00:21:36.740 | 70.00th=[ 75], 80.00th=[ 93], 90.00th=[ 116], 95.00th=[ 138], 00:21:36.740 | 99.00th=[ 180], 99.50th=[ 192], 99.90th=[ 209], 99.95th=[ 215], 00:21:36.740 | 99.99th=[ 218] 00:21:36.740 bw ( KiB/s): min=93696, max=549888, per=11.93%, avg=268723.20, stdev=127050.22, samples=20 00:21:36.740 iops : min= 366, max= 2148, avg=1049.70, stdev=496.29, samples=20 00:21:36.740 lat (usec) : 1000=0.01% 00:21:36.740 lat (msec) : 2=0.27%, 4=0.40%, 10=1.36%, 20=3.47%, 50=45.57% 00:21:36.740 lat (msec) : 100=32.15%, 250=16.78% 00:21:36.740 cpu : usr=0.36%, sys=3.89%, ctx=2094, majf=0, minf=4097 00:21:36.740 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:36.740 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.740 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.740 issued rwts: total=10561,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.740 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.740 job8: (groupid=0, jobs=1): err= 0: pid=432946: Mon Dec 16 14:25:49 2024 00:21:36.740 read: IOPS=826, BW=207MiB/s (217MB/s)(2070MiB/10014msec) 00:21:36.740 slat (usec): min=8, max=73725, avg=739.10, stdev=3035.20 00:21:36.740 clat (usec): min=827, max=215456, avg=76604.41, stdev=40526.84 00:21:36.740 lat (usec): min=869, max=215592, avg=77343.51, stdev=40839.29 00:21:36.740 clat percentiles (msec): 00:21:36.740 | 1.00th=[ 4], 5.00th=[ 14], 10.00th=[ 26], 20.00th=[ 34], 00:21:36.740 | 30.00th=[ 55], 40.00th=[ 65], 50.00th=[ 75], 60.00th=[ 87], 00:21:36.740 | 70.00th=[ 99], 80.00th=[ 109], 90.00th=[ 134], 95.00th=[ 150], 00:21:36.740 | 99.00th=[ 171], 99.50th=[ 180], 99.90th=[ 188], 99.95th=[ 188], 00:21:36.740 | 99.99th=[ 215] 00:21:36.740 bw ( KiB/s): min=103424, max=438272, per=9.33%, avg=210329.60, stdev=79154.78, samples=20 00:21:36.740 iops : min= 404, max= 1712, avg=821.60, stdev=309.20, samples=20 00:21:36.740 lat (usec) : 1000=0.07% 00:21:36.740 lat (msec) : 2=0.14%, 4=1.01%, 10=2.05%, 20=4.54%, 50=17.89% 00:21:36.740 lat (msec) : 100=46.35%, 250=27.94% 00:21:36.740 cpu : usr=0.28%, sys=3.09%, ctx=1946, majf=0, minf=4097 00:21:36.740 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:36.740 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.740 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.740 issued rwts: total=8279,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.740 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.740 job9: (groupid=0, jobs=1): err= 0: pid=432948: Mon Dec 16 14:25:49 2024 00:21:36.740 read: IOPS=784, BW=196MiB/s (206MB/s)(1971MiB/10046msec) 00:21:36.740 slat (usec): min=8, max=109036, avg=940.98, stdev=3934.02 00:21:36.740 clat (msec): min=2, max=245, avg=80.53, stdev=46.48 00:21:36.740 lat (msec): min=2, max=250, avg=81.47, stdev=47.14 00:21:36.740 clat percentiles (msec): 00:21:36.740 | 1.00th=[ 6], 5.00th=[ 14], 10.00th=[ 22], 20.00th=[ 34], 00:21:36.740 | 30.00th=[ 53], 40.00th=[ 65], 50.00th=[ 77], 60.00th=[ 88], 00:21:36.740 | 70.00th=[ 106], 80.00th=[ 121], 90.00th=[ 150], 95.00th=[ 167], 00:21:36.740 | 99.00th=[ 188], 99.50th=[ 194], 99.90th=[ 220], 99.95th=[ 226], 00:21:36.740 | 99.99th=[ 245] 00:21:36.740 bw ( KiB/s): min=94720, max=391168, per=8.89%, avg=200217.60, stdev=79429.85, samples=20 00:21:36.740 iops : min= 370, max= 1528, avg=782.10, stdev=310.27, samples=20 00:21:36.740 lat (msec) : 4=0.39%, 10=3.09%, 20=4.88%, 50=20.26%, 100=38.13% 00:21:36.740 lat (msec) : 250=33.24% 00:21:36.740 cpu : usr=0.23%, sys=3.06%, ctx=1729, majf=0, minf=3722 00:21:36.740 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:36.740 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.740 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.740 issued rwts: total=7884,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.740 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.740 job10: (groupid=0, jobs=1): err= 0: pid=432949: Mon Dec 16 14:25:49 2024 00:21:36.740 read: IOPS=742, BW=186MiB/s (195MB/s)(1866MiB/10050msec) 00:21:36.740 slat (usec): min=9, max=93587, avg=769.38, stdev=3242.16 00:21:36.740 clat (usec): min=1245, max=232892, avg=85319.43, stdev=42148.76 00:21:36.740 lat (usec): min=1271, max=239393, avg=86088.82, stdev=42633.78 00:21:36.740 clat percentiles (msec): 00:21:36.740 | 1.00th=[ 4], 5.00th=[ 15], 10.00th=[ 23], 20.00th=[ 45], 00:21:36.740 | 30.00th=[ 65], 40.00th=[ 81], 50.00th=[ 91], 60.00th=[ 101], 00:21:36.740 | 70.00th=[ 109], 80.00th=[ 118], 90.00th=[ 131], 95.00th=[ 153], 00:21:36.740 | 99.00th=[ 194], 99.50th=[ 201], 99.90th=[ 228], 99.95th=[ 232], 00:21:36.740 | 99.99th=[ 234] 00:21:36.740 bw ( KiB/s): min=98304, max=360960, per=8.41%, avg=189465.60, stdev=65325.02, samples=20 00:21:36.740 iops : min= 384, max= 1410, avg=740.10, stdev=255.18, samples=20 00:21:36.740 lat (msec) : 2=0.24%, 4=0.88%, 10=2.17%, 20=5.36%, 50=14.05% 00:21:36.740 lat (msec) : 100=37.35%, 250=39.94% 00:21:36.740 cpu : usr=0.25%, sys=2.87%, ctx=1911, majf=0, minf=4097 00:21:36.740 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:21:36.740 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:36.740 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:36.740 issued rwts: total=7464,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:36.740 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:36.740 00:21:36.740 Run status group 0 (all jobs): 00:21:36.740 READ: bw=2200MiB/s (2307MB/s), 181MiB/s-262MiB/s (190MB/s-274MB/s), io=21.7GiB (23.3GB), run=10014-10096msec 00:21:36.740 00:21:36.740 Disk stats (read/write): 00:21:36.740 nvme0n1: ios=15334/0, merge=0/0, ticks=1244548/0, in_queue=1244548, util=97.36% 00:21:36.740 nvme10n1: ios=14455/0, merge=0/0, ticks=1239367/0, in_queue=1239367, util=97.54% 00:21:36.740 nvme1n1: ios=15324/0, merge=0/0, ticks=1240874/0, in_queue=1240874, util=97.79% 00:21:36.740 nvme2n1: ios=15734/0, merge=0/0, ticks=1238010/0, in_queue=1238010, util=97.91% 00:21:36.740 nvme3n1: ios=16587/0, merge=0/0, ticks=1238845/0, in_queue=1238845, util=98.01% 00:21:36.740 nvme4n1: ios=15818/0, merge=0/0, ticks=1236769/0, in_queue=1236769, util=98.33% 00:21:36.740 nvme5n1: ios=14666/0, merge=0/0, ticks=1237996/0, in_queue=1237996, util=98.48% 00:21:36.740 nvme6n1: ios=20940/0, merge=0/0, ticks=1235228/0, in_queue=1235228, util=98.59% 00:21:36.740 nvme7n1: ios=16309/0, merge=0/0, ticks=1245591/0, in_queue=1245591, util=98.97% 00:21:36.740 nvme8n1: ios=15485/0, merge=0/0, ticks=1241167/0, in_queue=1241167, util=99.14% 00:21:36.740 nvme9n1: ios=14732/0, merge=0/0, ticks=1239145/0, in_queue=1239145, util=99.28% 00:21:36.740 14:25:49 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:21:36.740 [global] 00:21:36.740 thread=1 00:21:36.740 invalidate=1 00:21:36.740 rw=randwrite 00:21:36.740 time_based=1 00:21:36.740 runtime=10 00:21:36.740 ioengine=libaio 00:21:36.740 direct=1 00:21:36.740 bs=262144 00:21:36.740 iodepth=64 00:21:36.740 norandommap=1 00:21:36.740 numjobs=1 00:21:36.740 00:21:36.740 [job0] 00:21:36.740 filename=/dev/nvme0n1 00:21:36.740 [job1] 00:21:36.740 filename=/dev/nvme10n1 00:21:36.740 [job2] 00:21:36.740 filename=/dev/nvme1n1 00:21:36.740 [job3] 00:21:36.740 filename=/dev/nvme2n1 00:21:36.740 [job4] 00:21:36.740 filename=/dev/nvme3n1 00:21:36.740 [job5] 00:21:36.740 filename=/dev/nvme4n1 00:21:36.740 [job6] 00:21:36.740 filename=/dev/nvme5n1 00:21:36.740 [job7] 00:21:36.740 filename=/dev/nvme6n1 00:21:36.740 [job8] 00:21:36.740 filename=/dev/nvme7n1 00:21:36.740 [job9] 00:21:36.740 filename=/dev/nvme8n1 00:21:36.740 [job10] 00:21:36.740 filename=/dev/nvme9n1 00:21:36.740 Could not set queue depth (nvme0n1) 00:21:36.740 Could not set queue depth (nvme10n1) 00:21:36.740 Could not set queue depth (nvme1n1) 00:21:36.740 Could not set queue depth (nvme2n1) 00:21:36.740 Could not set queue depth (nvme3n1) 00:21:36.740 Could not set queue depth (nvme4n1) 00:21:36.740 Could not set queue depth (nvme5n1) 00:21:36.740 Could not set queue depth (nvme6n1) 00:21:36.740 Could not set queue depth (nvme7n1) 00:21:36.740 Could not set queue depth (nvme8n1) 00:21:36.740 Could not set queue depth (nvme9n1) 00:21:36.740 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:21:36.740 fio-3.35 00:21:36.740 Starting 11 threads 00:21:46.718 00:21:46.718 job0: (groupid=0, jobs=1): err= 0: pid=434464: Mon Dec 16 14:26:00 2024 00:21:46.718 write: IOPS=674, BW=169MiB/s (177MB/s)(1706MiB/10109msec); 0 zone resets 00:21:46.719 slat (usec): min=27, max=62037, avg=1268.75, stdev=3036.44 00:21:46.719 clat (usec): min=812, max=228331, avg=93513.53, stdev=54290.41 00:21:46.719 lat (usec): min=856, max=244476, avg=94782.28, stdev=54950.45 00:21:46.719 clat percentiles (msec): 00:21:46.719 | 1.00th=[ 4], 5.00th=[ 20], 10.00th=[ 37], 20.00th=[ 39], 00:21:46.719 | 30.00th=[ 66], 40.00th=[ 70], 50.00th=[ 71], 60.00th=[ 102], 00:21:46.719 | 70.00th=[ 128], 80.00th=[ 148], 90.00th=[ 178], 95.00th=[ 190], 00:21:46.719 | 99.00th=[ 213], 99.50th=[ 220], 99.90th=[ 228], 99.95th=[ 228], 00:21:46.719 | 99.99th=[ 228] 00:21:46.719 bw ( KiB/s): min=94208, max=425984, per=9.67%, avg=173042.90, stdev=86792.16, samples=20 00:21:46.719 iops : min= 368, max= 1664, avg=675.90, stdev=339.06, samples=20 00:21:46.719 lat (usec) : 1000=0.06% 00:21:46.719 lat (msec) : 2=0.43%, 4=0.81%, 10=1.22%, 20=2.80%, 50=20.14% 00:21:46.719 lat (msec) : 100=34.39%, 250=40.16% 00:21:46.719 cpu : usr=1.66%, sys=1.93%, ctx=2545, majf=0, minf=1 00:21:46.719 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:21:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.719 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.719 issued rwts: total=0,6822,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.719 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.719 job1: (groupid=0, jobs=1): err= 0: pid=434476: Mon Dec 16 14:26:00 2024 00:21:46.719 write: IOPS=464, BW=116MiB/s (122MB/s)(1171MiB/10074msec); 0 zone resets 00:21:46.719 slat (usec): min=23, max=56092, avg=1998.51, stdev=4227.31 00:21:46.719 clat (msec): min=5, max=211, avg=135.66, stdev=47.71 00:21:46.719 lat (msec): min=5, max=212, avg=137.66, stdev=48.35 00:21:46.719 clat percentiles (msec): 00:21:46.719 | 1.00th=[ 23], 5.00th=[ 67], 10.00th=[ 71], 20.00th=[ 73], 00:21:46.719 | 30.00th=[ 105], 40.00th=[ 138], 50.00th=[ 153], 60.00th=[ 163], 00:21:46.719 | 70.00th=[ 169], 80.00th=[ 178], 90.00th=[ 190], 95.00th=[ 194], 00:21:46.719 | 99.00th=[ 203], 99.50th=[ 205], 99.90th=[ 211], 99.95th=[ 213], 00:21:46.719 | 99.99th=[ 213] 00:21:46.719 bw ( KiB/s): min=86016, max=225280, per=6.61%, avg=118246.40, stdev=41806.98, samples=20 00:21:46.719 iops : min= 336, max= 880, avg=461.90, stdev=163.31, samples=20 00:21:46.719 lat (msec) : 10=0.23%, 20=0.56%, 50=2.56%, 100=24.24%, 250=72.40% 00:21:46.719 cpu : usr=1.12%, sys=1.15%, ctx=1520, majf=0, minf=1 00:21:46.719 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:21:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.719 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.719 issued rwts: total=0,4682,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.719 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.719 job2: (groupid=0, jobs=1): err= 0: pid=434485: Mon Dec 16 14:26:00 2024 00:21:46.719 write: IOPS=598, BW=150MiB/s (157MB/s)(1512MiB/10112msec); 0 zone resets 00:21:46.719 slat (usec): min=21, max=35348, avg=1557.96, stdev=3208.33 00:21:46.719 clat (usec): min=1888, max=239036, avg=105424.97, stdev=46729.34 00:21:46.719 lat (usec): min=1971, max=239075, avg=106982.93, stdev=47344.21 00:21:46.719 clat percentiles (msec): 00:21:46.719 | 1.00th=[ 14], 5.00th=[ 54], 10.00th=[ 69], 20.00th=[ 71], 00:21:46.719 | 30.00th=[ 73], 40.00th=[ 75], 50.00th=[ 77], 60.00th=[ 104], 00:21:46.719 | 70.00th=[ 142], 80.00th=[ 163], 90.00th=[ 174], 95.00th=[ 182], 00:21:46.719 | 99.00th=[ 197], 99.50th=[ 211], 99.90th=[ 226], 99.95th=[ 232], 00:21:46.719 | 99.99th=[ 239] 00:21:46.719 bw ( KiB/s): min=90112, max=238080, per=8.56%, avg=153190.40, stdev=58940.21, samples=20 00:21:46.719 iops : min= 352, max= 930, avg=598.40, stdev=230.24, samples=20 00:21:46.719 lat (msec) : 2=0.03%, 4=0.15%, 10=0.45%, 20=1.12%, 50=2.86% 00:21:46.719 lat (msec) : 100=53.70%, 250=41.69% 00:21:46.719 cpu : usr=1.27%, sys=1.67%, ctx=1881, majf=0, minf=1 00:21:46.719 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:21:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.719 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.719 issued rwts: total=0,6047,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.719 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.719 job3: (groupid=0, jobs=1): err= 0: pid=434487: Mon Dec 16 14:26:00 2024 00:21:46.719 write: IOPS=529, BW=132MiB/s (139MB/s)(1340MiB/10133msec); 0 zone resets 00:21:46.719 slat (usec): min=35, max=37083, avg=1829.01, stdev=3626.60 00:21:46.719 clat (msec): min=2, max=295, avg=119.05, stdev=44.46 00:21:46.719 lat (msec): min=3, max=295, avg=120.88, stdev=44.96 00:21:46.719 clat percentiles (msec): 00:21:46.719 | 1.00th=[ 22], 5.00th=[ 68], 10.00th=[ 72], 20.00th=[ 73], 00:21:46.719 | 30.00th=[ 96], 40.00th=[ 103], 50.00th=[ 106], 60.00th=[ 127], 00:21:46.719 | 70.00th=[ 153], 80.00th=[ 163], 90.00th=[ 176], 95.00th=[ 194], 00:21:46.719 | 99.00th=[ 213], 99.50th=[ 236], 99.90th=[ 288], 99.95th=[ 288], 00:21:46.719 | 99.99th=[ 296] 00:21:46.719 bw ( KiB/s): min=81920, max=227328, per=7.58%, avg=135628.80, stdev=44424.71, samples=20 00:21:46.719 iops : min= 320, max= 888, avg=529.80, stdev=173.53, samples=20 00:21:46.719 lat (msec) : 4=0.04%, 10=0.32%, 20=0.50%, 50=1.62%, 100=32.14% 00:21:46.719 lat (msec) : 250=64.97%, 500=0.41% 00:21:46.719 cpu : usr=1.32%, sys=1.80%, ctx=1458, majf=0, minf=1 00:21:46.719 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:21:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.719 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.719 issued rwts: total=0,5361,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.719 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.719 job4: (groupid=0, jobs=1): err= 0: pid=434488: Mon Dec 16 14:26:00 2024 00:21:46.719 write: IOPS=461, BW=115MiB/s (121MB/s)(1169MiB/10133msec); 0 zone resets 00:21:46.719 slat (usec): min=21, max=76763, avg=1915.10, stdev=4256.06 00:21:46.719 clat (msec): min=3, max=318, avg=136.74, stdev=49.35 00:21:46.719 lat (msec): min=3, max=318, avg=138.66, stdev=50.04 00:21:46.719 clat percentiles (msec): 00:21:46.719 | 1.00th=[ 15], 5.00th=[ 36], 10.00th=[ 70], 20.00th=[ 99], 00:21:46.719 | 30.00th=[ 109], 40.00th=[ 131], 50.00th=[ 150], 60.00th=[ 161], 00:21:46.719 | 70.00th=[ 169], 80.00th=[ 180], 90.00th=[ 188], 95.00th=[ 194], 00:21:46.719 | 99.00th=[ 230], 99.50th=[ 232], 99.90th=[ 309], 99.95th=[ 309], 00:21:46.719 | 99.99th=[ 317] 00:21:46.719 bw ( KiB/s): min=86016, max=216064, per=6.60%, avg=118067.20, stdev=36820.71, samples=20 00:21:46.719 iops : min= 336, max= 844, avg=461.20, stdev=143.83, samples=20 00:21:46.719 lat (msec) : 4=0.02%, 10=0.39%, 20=1.95%, 50=4.64%, 100=14.07% 00:21:46.719 lat (msec) : 250=78.55%, 500=0.39% 00:21:46.719 cpu : usr=1.18%, sys=1.30%, ctx=1762, majf=0, minf=1 00:21:46.719 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:21:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.719 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.719 issued rwts: total=0,4675,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.719 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.719 job5: (groupid=0, jobs=1): err= 0: pid=434489: Mon Dec 16 14:26:00 2024 00:21:46.719 write: IOPS=622, BW=156MiB/s (163MB/s)(1578MiB/10132msec); 0 zone resets 00:21:46.719 slat (usec): min=18, max=31948, avg=1474.79, stdev=3221.48 00:21:46.719 clat (usec): min=1769, max=279936, avg=101214.86, stdev=51450.37 00:21:46.719 lat (usec): min=1809, max=279979, avg=102689.65, stdev=52176.48 00:21:46.719 clat percentiles (msec): 00:21:46.719 | 1.00th=[ 11], 5.00th=[ 37], 10.00th=[ 40], 20.00th=[ 44], 00:21:46.719 | 30.00th=[ 70], 40.00th=[ 81], 50.00th=[ 102], 60.00th=[ 105], 00:21:46.719 | 70.00th=[ 131], 80.00th=[ 161], 90.00th=[ 174], 95.00th=[ 182], 00:21:46.719 | 99.00th=[ 201], 99.50th=[ 218], 99.90th=[ 268], 99.95th=[ 271], 00:21:46.719 | 99.99th=[ 279] 00:21:46.719 bw ( KiB/s): min=88064, max=362496, per=8.94%, avg=159974.40, stdev=80583.54, samples=20 00:21:46.719 iops : min= 344, max= 1416, avg=624.90, stdev=314.78, samples=20 00:21:46.719 lat (msec) : 2=0.02%, 4=0.11%, 10=0.79%, 20=1.58%, 50=20.25% 00:21:46.719 lat (msec) : 100=26.76%, 250=50.27%, 500=0.22% 00:21:46.719 cpu : usr=1.46%, sys=2.22%, ctx=1963, majf=0, minf=1 00:21:46.719 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:21:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.719 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.719 issued rwts: total=0,6312,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.719 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.719 job6: (groupid=0, jobs=1): err= 0: pid=434490: Mon Dec 16 14:26:00 2024 00:21:46.719 write: IOPS=997, BW=249MiB/s (262MB/s)(2522MiB/10111msec); 0 zone resets 00:21:46.719 slat (usec): min=20, max=60125, avg=916.79, stdev=2036.39 00:21:46.719 clat (usec): min=1392, max=266747, avg=63175.95, stdev=29249.98 00:21:46.719 lat (usec): min=1461, max=266991, avg=64092.73, stdev=29597.76 00:21:46.719 clat percentiles (msec): 00:21:46.719 | 1.00th=[ 8], 5.00th=[ 30], 10.00th=[ 38], 20.00th=[ 41], 00:21:46.719 | 30.00th=[ 43], 40.00th=[ 45], 50.00th=[ 70], 60.00th=[ 72], 00:21:46.719 | 70.00th=[ 74], 80.00th=[ 77], 90.00th=[ 96], 95.00th=[ 103], 00:21:46.719 | 99.00th=[ 201], 99.50th=[ 220], 99.90th=[ 234], 99.95th=[ 262], 00:21:46.719 | 99.99th=[ 268] 00:21:46.719 bw ( KiB/s): min=156160, max=432128, per=14.34%, avg=256665.60, stdev=84740.19, samples=20 00:21:46.719 iops : min= 610, max= 1688, avg=1002.60, stdev=331.02, samples=20 00:21:46.719 lat (msec) : 2=0.04%, 4=0.28%, 10=1.27%, 20=1.69%, 50=38.75% 00:21:46.719 lat (msec) : 100=49.87%, 250=8.05%, 500=0.07% 00:21:46.719 cpu : usr=2.19%, sys=3.43%, ctx=3301, majf=0, minf=1 00:21:46.719 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:21:46.719 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.719 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.719 issued rwts: total=0,10089,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.719 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.719 job7: (groupid=0, jobs=1): err= 0: pid=434491: Mon Dec 16 14:26:00 2024 00:21:46.719 write: IOPS=605, BW=151MiB/s (159MB/s)(1525MiB/10073msec); 0 zone resets 00:21:46.719 slat (usec): min=20, max=36114, avg=1574.04, stdev=3261.84 00:21:46.719 clat (msec): min=6, max=213, avg=104.05, stdev=46.29 00:21:46.719 lat (msec): min=8, max=213, avg=105.63, stdev=46.90 00:21:46.719 clat percentiles (msec): 00:21:46.719 | 1.00th=[ 26], 5.00th=[ 62], 10.00th=[ 67], 20.00th=[ 69], 00:21:46.719 | 30.00th=[ 71], 40.00th=[ 72], 50.00th=[ 74], 60.00th=[ 105], 00:21:46.719 | 70.00th=[ 128], 80.00th=[ 157], 90.00th=[ 180], 95.00th=[ 192], 00:21:46.720 | 99.00th=[ 205], 99.50th=[ 213], 99.90th=[ 213], 99.95th=[ 213], 00:21:46.720 | 99.99th=[ 213] 00:21:46.720 bw ( KiB/s): min=79872, max=246272, per=8.64%, avg=154572.80, stdev=61270.42, samples=20 00:21:46.720 iops : min= 312, max= 962, avg=603.80, stdev=239.34, samples=20 00:21:46.720 lat (msec) : 10=0.08%, 20=0.52%, 50=2.08%, 100=55.74%, 250=41.57% 00:21:46.720 cpu : usr=1.61%, sys=1.95%, ctx=1771, majf=0, minf=1 00:21:46.720 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:21:46.720 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.720 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.720 issued rwts: total=0,6101,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.720 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.720 job8: (groupid=0, jobs=1): err= 0: pid=434493: Mon Dec 16 14:26:00 2024 00:21:46.720 write: IOPS=588, BW=147MiB/s (154MB/s)(1492MiB/10137msec); 0 zone resets 00:21:46.720 slat (usec): min=21, max=44281, avg=1348.76, stdev=3248.19 00:21:46.720 clat (usec): min=1053, max=283550, avg=107300.17, stdev=54479.90 00:21:46.720 lat (usec): min=1091, max=283596, avg=108648.93, stdev=55122.80 00:21:46.720 clat percentiles (msec): 00:21:46.720 | 1.00th=[ 7], 5.00th=[ 24], 10.00th=[ 50], 20.00th=[ 68], 00:21:46.720 | 30.00th=[ 71], 40.00th=[ 72], 50.00th=[ 95], 60.00th=[ 107], 00:21:46.720 | 70.00th=[ 153], 80.00th=[ 169], 90.00th=[ 182], 95.00th=[ 199], 00:21:46.720 | 99.00th=[ 213], 99.50th=[ 228], 99.90th=[ 275], 99.95th=[ 275], 00:21:46.720 | 99.99th=[ 284] 00:21:46.720 bw ( KiB/s): min=81920, max=229376, per=8.44%, avg=151091.20, stdev=51475.71, samples=20 00:21:46.720 iops : min= 320, max= 896, avg=590.20, stdev=201.08, samples=20 00:21:46.720 lat (msec) : 2=0.25%, 4=0.49%, 10=0.77%, 20=2.53%, 50=6.00% 00:21:46.720 lat (msec) : 100=43.08%, 250=46.58%, 500=0.30% 00:21:46.720 cpu : usr=1.50%, sys=1.75%, ctx=2533, majf=0, minf=2 00:21:46.720 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:21:46.720 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.720 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.720 issued rwts: total=0,5966,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.720 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.720 job9: (groupid=0, jobs=1): err= 0: pid=434494: Mon Dec 16 14:26:00 2024 00:21:46.720 write: IOPS=522, BW=131MiB/s (137MB/s)(1325MiB/10141msec); 0 zone resets 00:21:46.720 slat (usec): min=24, max=40566, avg=1876.17, stdev=3668.36 00:21:46.720 clat (msec): min=7, max=269, avg=120.56, stdev=43.17 00:21:46.720 lat (msec): min=7, max=269, avg=122.43, stdev=43.67 00:21:46.720 clat percentiles (msec): 00:21:46.720 | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 72], 20.00th=[ 73], 00:21:46.720 | 30.00th=[ 97], 40.00th=[ 103], 50.00th=[ 106], 60.00th=[ 128], 00:21:46.720 | 70.00th=[ 153], 80.00th=[ 165], 90.00th=[ 180], 95.00th=[ 199], 00:21:46.720 | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 259], 99.95th=[ 259], 00:21:46.720 | 99.99th=[ 271] 00:21:46.720 bw ( KiB/s): min=86016, max=227328, per=7.49%, avg=134016.00, stdev=45723.78, samples=20 00:21:46.720 iops : min= 336, max= 888, avg=523.50, stdev=178.61, samples=20 00:21:46.720 lat (msec) : 10=0.04%, 20=0.36%, 50=0.57%, 100=33.48%, 250=65.37% 00:21:46.720 lat (msec) : 500=0.19% 00:21:46.720 cpu : usr=1.34%, sys=1.68%, ctx=1355, majf=0, minf=1 00:21:46.720 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:21:46.720 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.720 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.720 issued rwts: total=0,5299,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.720 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.720 job10: (groupid=0, jobs=1): err= 0: pid=434495: Mon Dec 16 14:26:00 2024 00:21:46.720 write: IOPS=945, BW=236MiB/s (248MB/s)(2387MiB/10096msec); 0 zone resets 00:21:46.720 slat (usec): min=29, max=74798, avg=929.10, stdev=2372.18 00:21:46.720 clat (usec): min=1452, max=238813, avg=66711.99, stdev=42377.25 00:21:46.720 lat (usec): min=1535, max=238859, avg=67641.09, stdev=42926.69 00:21:46.720 clat percentiles (msec): 00:21:46.720 | 1.00th=[ 9], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 39], 00:21:46.720 | 30.00th=[ 40], 40.00th=[ 41], 50.00th=[ 55], 60.00th=[ 69], 00:21:46.720 | 70.00th=[ 72], 80.00th=[ 77], 90.00th=[ 142], 95.00th=[ 161], 00:21:46.720 | 99.00th=[ 222], 99.50th=[ 228], 99.90th=[ 232], 99.95th=[ 232], 00:21:46.720 | 99.99th=[ 239] 00:21:46.720 bw ( KiB/s): min=73728, max=421888, per=13.57%, avg=242816.00, stdev=105136.31, samples=20 00:21:46.720 iops : min= 288, max= 1648, avg=948.50, stdev=410.69, samples=20 00:21:46.720 lat (msec) : 2=0.02%, 4=0.20%, 10=1.09%, 20=1.61%, 50=45.03% 00:21:46.720 lat (msec) : 100=38.47%, 250=13.58% 00:21:46.720 cpu : usr=2.08%, sys=2.48%, ctx=3277, majf=0, minf=1 00:21:46.720 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:21:46.720 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:21:46.720 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:21:46.720 issued rwts: total=0,9548,0,0 short=0,0,0,0 dropped=0,0,0,0 00:21:46.720 latency : target=0, window=0, percentile=100.00%, depth=64 00:21:46.720 00:21:46.720 Run status group 0 (all jobs): 00:21:46.720 WRITE: bw=1748MiB/s (1833MB/s), 115MiB/s-249MiB/s (121MB/s-262MB/s), io=17.3GiB (18.6GB), run=10073-10141msec 00:21:46.720 00:21:46.720 Disk stats (read/write): 00:21:46.720 nvme0n1: ios=41/13595, merge=0/0, ticks=973/1230391, in_queue=1231364, util=100.00% 00:21:46.720 nvme10n1: ios=0/9027, merge=0/0, ticks=0/1197114, in_queue=1197114, util=94.30% 00:21:46.720 nvme1n1: ios=0/12040, merge=0/0, ticks=0/1226108, in_queue=1226108, util=95.06% 00:21:46.720 nvme2n1: ios=37/10664, merge=0/0, ticks=904/1221715, in_queue=1222619, util=99.87% 00:21:46.720 nvme3n1: ios=0/9291, merge=0/0, ticks=0/1227283, in_queue=1227283, util=95.68% 00:21:46.720 nvme4n1: ios=0/12566, merge=0/0, ticks=0/1224577, in_queue=1224577, util=96.51% 00:21:46.720 nvme5n1: ios=36/20128, merge=0/0, ticks=1492/1218676, in_queue=1220168, util=100.00% 00:21:46.720 nvme6n1: ios=0/11857, merge=0/0, ticks=0/1196112, in_queue=1196112, util=97.16% 00:21:46.720 nvme7n1: ios=34/11867, merge=0/0, ticks=580/1228202, in_queue=1228782, util=99.93% 00:21:46.720 nvme8n1: ios=0/10519, merge=0/0, ticks=0/1221249, in_queue=1221249, util=98.72% 00:21:46.720 nvme9n1: ios=35/19069, merge=0/0, ticks=1037/1230090, in_queue=1231127, util=99.90% 00:21:46.720 14:26:00 -- target/multiconnection.sh@36 -- # sync 00:21:46.720 14:26:00 -- target/multiconnection.sh@37 -- # seq 1 11 00:21:46.720 14:26:00 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:46.720 14:26:00 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:21:46.720 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:21:46.720 14:26:01 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:21:46.720 14:26:01 -- common/autotest_common.sh@1208 -- # local i=0 00:21:46.720 14:26:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:46.720 14:26:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:21:46.720 14:26:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:46.720 14:26:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:21:46.720 14:26:01 -- common/autotest_common.sh@1220 -- # return 0 00:21:46.720 14:26:01 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:21:46.720 14:26:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.720 14:26:01 -- common/autotest_common.sh@10 -- # set +x 00:21:46.720 14:26:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.720 14:26:01 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:46.720 14:26:01 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:21:46.979 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:21:46.979 14:26:01 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:21:46.979 14:26:01 -- common/autotest_common.sh@1208 -- # local i=0 00:21:46.979 14:26:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:46.979 14:26:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:21:46.979 14:26:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:46.979 14:26:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:21:46.979 14:26:01 -- common/autotest_common.sh@1220 -- # return 0 00:21:46.979 14:26:01 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:21:46.979 14:26:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:46.979 14:26:01 -- common/autotest_common.sh@10 -- # set +x 00:21:46.979 14:26:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:46.979 14:26:01 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:46.979 14:26:01 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:21:47.238 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:21:47.238 14:26:01 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:21:47.238 14:26:01 -- common/autotest_common.sh@1208 -- # local i=0 00:21:47.238 14:26:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:47.238 14:26:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:21:47.238 14:26:01 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:47.238 14:26:01 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:21:47.238 14:26:01 -- common/autotest_common.sh@1220 -- # return 0 00:21:47.238 14:26:01 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:21:47.238 14:26:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.238 14:26:01 -- common/autotest_common.sh@10 -- # set +x 00:21:47.238 14:26:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.238 14:26:01 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:47.238 14:26:01 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:21:47.497 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:21:47.497 14:26:01 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:21:47.497 14:26:01 -- common/autotest_common.sh@1208 -- # local i=0 00:21:47.497 14:26:01 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:47.497 14:26:01 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:21:47.497 14:26:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:47.497 14:26:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:21:47.497 14:26:02 -- common/autotest_common.sh@1220 -- # return 0 00:21:47.497 14:26:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:21:47.497 14:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.497 14:26:02 -- common/autotest_common.sh@10 -- # set +x 00:21:47.497 14:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.497 14:26:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:47.497 14:26:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:21:47.756 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:21:47.756 14:26:02 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:21:47.756 14:26:02 -- common/autotest_common.sh@1208 -- # local i=0 00:21:47.756 14:26:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:47.756 14:26:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:21:47.756 14:26:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:47.756 14:26:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:21:47.756 14:26:02 -- common/autotest_common.sh@1220 -- # return 0 00:21:47.756 14:26:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:21:47.756 14:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:47.756 14:26:02 -- common/autotest_common.sh@10 -- # set +x 00:21:47.756 14:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:47.756 14:26:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:47.756 14:26:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:21:48.323 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:21:48.323 14:26:02 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:21:48.323 14:26:02 -- common/autotest_common.sh@1208 -- # local i=0 00:21:48.323 14:26:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:48.323 14:26:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:21:48.323 14:26:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:48.323 14:26:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:21:48.323 14:26:02 -- common/autotest_common.sh@1220 -- # return 0 00:21:48.323 14:26:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:21:48.323 14:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.323 14:26:02 -- common/autotest_common.sh@10 -- # set +x 00:21:48.323 14:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.323 14:26:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:48.323 14:26:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:21:48.323 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:21:48.323 14:26:02 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:21:48.323 14:26:02 -- common/autotest_common.sh@1208 -- # local i=0 00:21:48.323 14:26:02 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:48.323 14:26:02 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:21:48.323 14:26:02 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:48.323 14:26:02 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:21:48.323 14:26:02 -- common/autotest_common.sh@1220 -- # return 0 00:21:48.323 14:26:02 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:21:48.323 14:26:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.323 14:26:02 -- common/autotest_common.sh@10 -- # set +x 00:21:48.323 14:26:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.323 14:26:02 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:48.323 14:26:02 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:21:48.582 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:21:48.582 14:26:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:21:48.582 14:26:03 -- common/autotest_common.sh@1208 -- # local i=0 00:21:48.582 14:26:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:48.582 14:26:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:21:48.582 14:26:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:48.582 14:26:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:21:48.582 14:26:03 -- common/autotest_common.sh@1220 -- # return 0 00:21:48.582 14:26:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:21:48.582 14:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.583 14:26:03 -- common/autotest_common.sh@10 -- # set +x 00:21:48.583 14:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.583 14:26:03 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:48.583 14:26:03 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:21:48.842 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:21:48.842 14:26:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:21:48.842 14:26:03 -- common/autotest_common.sh@1208 -- # local i=0 00:21:48.842 14:26:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:48.842 14:26:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:21:48.842 14:26:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:21:48.842 14:26:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:48.842 14:26:03 -- common/autotest_common.sh@1220 -- # return 0 00:21:48.842 14:26:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:21:48.842 14:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.842 14:26:03 -- common/autotest_common.sh@10 -- # set +x 00:21:48.842 14:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.842 14:26:03 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:48.842 14:26:03 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:21:48.842 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:21:48.842 14:26:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:21:48.842 14:26:03 -- common/autotest_common.sh@1208 -- # local i=0 00:21:48.842 14:26:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:48.842 14:26:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:21:48.842 14:26:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:48.842 14:26:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:21:48.842 14:26:03 -- common/autotest_common.sh@1220 -- # return 0 00:21:48.842 14:26:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:21:48.842 14:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:48.842 14:26:03 -- common/autotest_common.sh@10 -- # set +x 00:21:48.842 14:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:48.842 14:26:03 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:21:48.842 14:26:03 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:21:49.101 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:21:49.101 14:26:03 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:21:49.101 14:26:03 -- common/autotest_common.sh@1208 -- # local i=0 00:21:49.101 14:26:03 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:21:49.101 14:26:03 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:21:49.101 14:26:03 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:21:49.101 14:26:03 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:21:49.101 14:26:03 -- common/autotest_common.sh@1220 -- # return 0 00:21:49.101 14:26:03 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:21:49.101 14:26:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:49.101 14:26:03 -- common/autotest_common.sh@10 -- # set +x 00:21:49.101 14:26:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:49.101 14:26:03 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:21:49.101 14:26:03 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:21:49.101 14:26:03 -- target/multiconnection.sh@47 -- # nvmftestfini 00:21:49.101 14:26:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:49.101 14:26:03 -- nvmf/common.sh@116 -- # sync 00:21:49.102 14:26:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:49.102 14:26:03 -- nvmf/common.sh@119 -- # set +e 00:21:49.102 14:26:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:49.102 14:26:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:49.102 rmmod nvme_tcp 00:21:49.102 rmmod nvme_fabrics 00:21:49.102 rmmod nvme_keyring 00:21:49.102 14:26:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:49.102 14:26:03 -- nvmf/common.sh@123 -- # set -e 00:21:49.102 14:26:03 -- nvmf/common.sh@124 -- # return 0 00:21:49.102 14:26:03 -- nvmf/common.sh@477 -- # '[' -n 426294 ']' 00:21:49.102 14:26:03 -- nvmf/common.sh@478 -- # killprocess 426294 00:21:49.102 14:26:03 -- common/autotest_common.sh@936 -- # '[' -z 426294 ']' 00:21:49.102 14:26:03 -- common/autotest_common.sh@940 -- # kill -0 426294 00:21:49.102 14:26:03 -- common/autotest_common.sh@941 -- # uname 00:21:49.102 14:26:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:49.102 14:26:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 426294 00:21:49.102 14:26:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:21:49.102 14:26:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:21:49.102 14:26:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 426294' 00:21:49.102 killing process with pid 426294 00:21:49.102 14:26:03 -- common/autotest_common.sh@955 -- # kill 426294 00:21:49.102 14:26:03 -- common/autotest_common.sh@960 -- # wait 426294 00:21:49.669 14:26:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:49.669 14:26:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:49.669 14:26:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:49.669 14:26:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:49.669 14:26:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:49.669 14:26:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:49.669 14:26:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:49.669 14:26:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:51.574 14:26:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:51.833 00:21:51.833 real 1m11.249s 00:21:51.833 user 4m11.088s 00:21:51.833 sys 0m26.107s 00:21:51.833 14:26:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:51.833 14:26:06 -- common/autotest_common.sh@10 -- # set +x 00:21:51.833 ************************************ 00:21:51.833 END TEST nvmf_multiconnection 00:21:51.833 ************************************ 00:21:51.833 14:26:06 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:21:51.833 14:26:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:51.833 14:26:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:51.833 14:26:06 -- common/autotest_common.sh@10 -- # set +x 00:21:51.833 ************************************ 00:21:51.833 START TEST nvmf_initiator_timeout 00:21:51.833 ************************************ 00:21:51.833 14:26:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:21:51.833 * Looking for test storage... 00:21:51.833 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:51.833 14:26:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:51.833 14:26:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:51.833 14:26:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:51.833 14:26:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:51.833 14:26:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:51.833 14:26:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:51.833 14:26:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:51.833 14:26:06 -- scripts/common.sh@335 -- # IFS=.-: 00:21:51.833 14:26:06 -- scripts/common.sh@335 -- # read -ra ver1 00:21:51.833 14:26:06 -- scripts/common.sh@336 -- # IFS=.-: 00:21:51.833 14:26:06 -- scripts/common.sh@336 -- # read -ra ver2 00:21:51.833 14:26:06 -- scripts/common.sh@337 -- # local 'op=<' 00:21:51.833 14:26:06 -- scripts/common.sh@339 -- # ver1_l=2 00:21:51.833 14:26:06 -- scripts/common.sh@340 -- # ver2_l=1 00:21:51.833 14:26:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:51.833 14:26:06 -- scripts/common.sh@343 -- # case "$op" in 00:21:51.833 14:26:06 -- scripts/common.sh@344 -- # : 1 00:21:51.833 14:26:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:51.833 14:26:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:51.833 14:26:06 -- scripts/common.sh@364 -- # decimal 1 00:21:51.833 14:26:06 -- scripts/common.sh@352 -- # local d=1 00:21:51.833 14:26:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:51.833 14:26:06 -- scripts/common.sh@354 -- # echo 1 00:21:51.833 14:26:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:51.833 14:26:06 -- scripts/common.sh@365 -- # decimal 2 00:21:51.833 14:26:06 -- scripts/common.sh@352 -- # local d=2 00:21:51.833 14:26:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:51.833 14:26:06 -- scripts/common.sh@354 -- # echo 2 00:21:51.833 14:26:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:51.833 14:26:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:51.833 14:26:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:51.833 14:26:06 -- scripts/common.sh@367 -- # return 0 00:21:51.833 14:26:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:51.833 14:26:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:51.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:51.833 --rc genhtml_branch_coverage=1 00:21:51.833 --rc genhtml_function_coverage=1 00:21:51.833 --rc genhtml_legend=1 00:21:51.833 --rc geninfo_all_blocks=1 00:21:51.833 --rc geninfo_unexecuted_blocks=1 00:21:51.833 00:21:51.833 ' 00:21:51.833 14:26:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:51.833 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:51.834 --rc genhtml_branch_coverage=1 00:21:51.834 --rc genhtml_function_coverage=1 00:21:51.834 --rc genhtml_legend=1 00:21:51.834 --rc geninfo_all_blocks=1 00:21:51.834 --rc geninfo_unexecuted_blocks=1 00:21:51.834 00:21:51.834 ' 00:21:51.834 14:26:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:51.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:51.834 --rc genhtml_branch_coverage=1 00:21:51.834 --rc genhtml_function_coverage=1 00:21:51.834 --rc genhtml_legend=1 00:21:51.834 --rc geninfo_all_blocks=1 00:21:51.834 --rc geninfo_unexecuted_blocks=1 00:21:51.834 00:21:51.834 ' 00:21:51.834 14:26:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:51.834 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:51.834 --rc genhtml_branch_coverage=1 00:21:51.834 --rc genhtml_function_coverage=1 00:21:51.834 --rc genhtml_legend=1 00:21:51.834 --rc geninfo_all_blocks=1 00:21:51.834 --rc geninfo_unexecuted_blocks=1 00:21:51.834 00:21:51.834 ' 00:21:51.834 14:26:06 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:51.834 14:26:06 -- nvmf/common.sh@7 -- # uname -s 00:21:51.834 14:26:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:51.834 14:26:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:51.834 14:26:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:51.834 14:26:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:51.834 14:26:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:51.834 14:26:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:51.834 14:26:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:51.834 14:26:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:51.834 14:26:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:51.834 14:26:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:51.834 14:26:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:21:51.834 14:26:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:21:51.834 14:26:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:51.834 14:26:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:51.834 14:26:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:51.834 14:26:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:51.834 14:26:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:51.834 14:26:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:51.834 14:26:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:51.834 14:26:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:51.834 14:26:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:51.834 14:26:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:51.834 14:26:06 -- paths/export.sh@5 -- # export PATH 00:21:51.834 14:26:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:51.834 14:26:06 -- nvmf/common.sh@46 -- # : 0 00:21:51.834 14:26:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:51.834 14:26:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:51.834 14:26:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:51.834 14:26:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:51.834 14:26:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:51.834 14:26:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:51.834 14:26:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:51.834 14:26:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:51.834 14:26:06 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:21:51.834 14:26:06 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:21:51.834 14:26:06 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:21:51.834 14:26:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:51.834 14:26:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:51.834 14:26:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:51.834 14:26:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:51.834 14:26:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:51.834 14:26:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:51.834 14:26:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:51.834 14:26:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:51.834 14:26:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:51.834 14:26:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:51.834 14:26:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:51.834 14:26:06 -- common/autotest_common.sh@10 -- # set +x 00:21:57.108 14:26:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:57.108 14:26:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:57.108 14:26:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:57.108 14:26:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:57.108 14:26:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:57.108 14:26:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:57.108 14:26:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:57.108 14:26:11 -- nvmf/common.sh@294 -- # net_devs=() 00:21:57.108 14:26:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:57.108 14:26:11 -- nvmf/common.sh@295 -- # e810=() 00:21:57.108 14:26:11 -- nvmf/common.sh@295 -- # local -ga e810 00:21:57.108 14:26:11 -- nvmf/common.sh@296 -- # x722=() 00:21:57.108 14:26:11 -- nvmf/common.sh@296 -- # local -ga x722 00:21:57.108 14:26:11 -- nvmf/common.sh@297 -- # mlx=() 00:21:57.108 14:26:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:57.108 14:26:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:57.108 14:26:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:57.108 14:26:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:57.108 14:26:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:57.108 14:26:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:57.108 14:26:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:21:57.108 Found 0000:af:00.0 (0x8086 - 0x159b) 00:21:57.108 14:26:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:57.108 14:26:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:21:57.108 Found 0000:af:00.1 (0x8086 - 0x159b) 00:21:57.108 14:26:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:57.108 14:26:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:57.108 14:26:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:57.108 14:26:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:57.108 14:26:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:57.108 14:26:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:21:57.108 Found net devices under 0000:af:00.0: cvl_0_0 00:21:57.108 14:26:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:57.108 14:26:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:57.108 14:26:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:57.108 14:26:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:57.108 14:26:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:57.108 14:26:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:21:57.108 Found net devices under 0000:af:00.1: cvl_0_1 00:21:57.108 14:26:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:57.108 14:26:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:57.108 14:26:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:57.108 14:26:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:57.108 14:26:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:57.108 14:26:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:57.108 14:26:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:57.108 14:26:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:57.108 14:26:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:57.108 14:26:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:57.108 14:26:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:57.108 14:26:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:57.108 14:26:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:57.108 14:26:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:57.108 14:26:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:57.108 14:26:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:57.108 14:26:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:57.108 14:26:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:57.108 14:26:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:57.108 14:26:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:57.108 14:26:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:57.108 14:26:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:57.367 14:26:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:57.367 14:26:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:57.367 14:26:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:57.367 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:57.367 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.380 ms 00:21:57.367 00:21:57.367 --- 10.0.0.2 ping statistics --- 00:21:57.367 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:57.367 rtt min/avg/max/mdev = 0.380/0.380/0.380/0.000 ms 00:21:57.367 14:26:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:57.367 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:57.367 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.197 ms 00:21:57.367 00:21:57.367 --- 10.0.0.1 ping statistics --- 00:21:57.367 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:57.367 rtt min/avg/max/mdev = 0.197/0.197/0.197/0.000 ms 00:21:57.367 14:26:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:57.367 14:26:11 -- nvmf/common.sh@410 -- # return 0 00:21:57.367 14:26:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:57.367 14:26:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:57.367 14:26:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:57.367 14:26:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:57.367 14:26:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:57.367 14:26:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:57.367 14:26:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:57.367 14:26:11 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:21:57.367 14:26:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:57.367 14:26:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:57.367 14:26:11 -- common/autotest_common.sh@10 -- # set +x 00:21:57.368 14:26:11 -- nvmf/common.sh@469 -- # nvmfpid=439892 00:21:57.368 14:26:11 -- nvmf/common.sh@470 -- # waitforlisten 439892 00:21:57.368 14:26:11 -- common/autotest_common.sh@829 -- # '[' -z 439892 ']' 00:21:57.368 14:26:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:57.368 14:26:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:57.368 14:26:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:57.368 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:57.368 14:26:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:57.368 14:26:11 -- common/autotest_common.sh@10 -- # set +x 00:21:57.368 14:26:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:21:57.368 [2024-12-16 14:26:11.817713] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:57.368 [2024-12-16 14:26:11.817757] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:57.368 EAL: No free 2048 kB hugepages reported on node 1 00:21:57.368 [2024-12-16 14:26:11.876153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:21:57.626 [2024-12-16 14:26:11.952868] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:57.626 [2024-12-16 14:26:11.952989] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:57.626 [2024-12-16 14:26:11.952997] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:57.626 [2024-12-16 14:26:11.953004] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:57.626 [2024-12-16 14:26:11.953038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:57.626 [2024-12-16 14:26:11.953055] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:57.626 [2024-12-16 14:26:11.953155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:21:57.626 [2024-12-16 14:26:11.953156] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:21:58.195 14:26:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:58.195 14:26:12 -- common/autotest_common.sh@862 -- # return 0 00:21:58.195 14:26:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:58.195 14:26:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:58.195 14:26:12 -- common/autotest_common.sh@10 -- # set +x 00:21:58.195 14:26:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:58.195 14:26:12 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:58.195 14:26:12 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:21:58.195 14:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:58.195 14:26:12 -- common/autotest_common.sh@10 -- # set +x 00:21:58.195 Malloc0 00:21:58.195 14:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:58.195 14:26:12 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:21:58.195 14:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:58.195 14:26:12 -- common/autotest_common.sh@10 -- # set +x 00:21:58.195 Delay0 00:21:58.195 14:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:58.195 14:26:12 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:58.195 14:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:58.195 14:26:12 -- common/autotest_common.sh@10 -- # set +x 00:21:58.195 [2024-12-16 14:26:12.706331] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:58.195 14:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:58.195 14:26:12 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:21:58.195 14:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:58.195 14:26:12 -- common/autotest_common.sh@10 -- # set +x 00:21:58.195 14:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:58.195 14:26:12 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:21:58.195 14:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:58.195 14:26:12 -- common/autotest_common.sh@10 -- # set +x 00:21:58.195 14:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:58.195 14:26:12 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:58.195 14:26:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:58.195 14:26:12 -- common/autotest_common.sh@10 -- # set +x 00:21:58.195 [2024-12-16 14:26:12.731094] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:58.195 14:26:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:58.195 14:26:12 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:21:59.571 14:26:13 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:21:59.571 14:26:13 -- common/autotest_common.sh@1187 -- # local i=0 00:21:59.571 14:26:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:21:59.571 14:26:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:21:59.571 14:26:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:01.526 14:26:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:01.526 14:26:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:01.526 14:26:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:22:01.526 14:26:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:01.526 14:26:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:01.526 14:26:15 -- common/autotest_common.sh@1197 -- # return 0 00:22:01.526 14:26:15 -- target/initiator_timeout.sh@35 -- # fio_pid=440605 00:22:01.526 14:26:15 -- target/initiator_timeout.sh@37 -- # sleep 3 00:22:01.526 14:26:15 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:22:01.526 [global] 00:22:01.526 thread=1 00:22:01.526 invalidate=1 00:22:01.526 rw=write 00:22:01.526 time_based=1 00:22:01.526 runtime=60 00:22:01.526 ioengine=libaio 00:22:01.526 direct=1 00:22:01.526 bs=4096 00:22:01.526 iodepth=1 00:22:01.526 norandommap=0 00:22:01.526 numjobs=1 00:22:01.526 00:22:01.526 verify_dump=1 00:22:01.526 verify_backlog=512 00:22:01.526 verify_state_save=0 00:22:01.526 do_verify=1 00:22:01.526 verify=crc32c-intel 00:22:01.526 [job0] 00:22:01.526 filename=/dev/nvme0n1 00:22:01.526 Could not set queue depth (nvme0n1) 00:22:01.815 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:22:01.815 fio-3.35 00:22:01.815 Starting 1 thread 00:22:05.103 14:26:18 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:22:05.103 14:26:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:05.103 14:26:18 -- common/autotest_common.sh@10 -- # set +x 00:22:05.103 true 00:22:05.103 14:26:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:05.103 14:26:18 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:22:05.103 14:26:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:05.103 14:26:18 -- common/autotest_common.sh@10 -- # set +x 00:22:05.103 true 00:22:05.103 14:26:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:05.103 14:26:18 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:22:05.103 14:26:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:05.103 14:26:18 -- common/autotest_common.sh@10 -- # set +x 00:22:05.103 true 00:22:05.103 14:26:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:05.103 14:26:18 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:22:05.103 14:26:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:05.103 14:26:18 -- common/autotest_common.sh@10 -- # set +x 00:22:05.103 true 00:22:05.103 14:26:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:05.103 14:26:18 -- target/initiator_timeout.sh@45 -- # sleep 3 00:22:07.637 14:26:21 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:22:07.637 14:26:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.637 14:26:21 -- common/autotest_common.sh@10 -- # set +x 00:22:07.637 true 00:22:07.637 14:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:07.637 14:26:22 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:22:07.637 14:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.637 14:26:22 -- common/autotest_common.sh@10 -- # set +x 00:22:07.637 true 00:22:07.637 14:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:07.637 14:26:22 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:22:07.637 14:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.637 14:26:22 -- common/autotest_common.sh@10 -- # set +x 00:22:07.637 true 00:22:07.637 14:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:07.637 14:26:22 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:22:07.637 14:26:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:07.637 14:26:22 -- common/autotest_common.sh@10 -- # set +x 00:22:07.637 true 00:22:07.637 14:26:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:07.637 14:26:22 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:22:07.637 14:26:22 -- target/initiator_timeout.sh@54 -- # wait 440605 00:23:03.868 00:23:03.868 job0: (groupid=0, jobs=1): err= 0: pid=440728: Mon Dec 16 14:27:16 2024 00:23:03.868 read: IOPS=101, BW=406KiB/s (416kB/s)(23.8MiB/60001msec) 00:23:03.868 slat (usec): min=6, max=10732, avg=10.45, stdev=137.39 00:23:03.868 clat (usec): min=217, max=41481k, avg=9611.58, stdev=531295.96 00:23:03.868 lat (usec): min=226, max=41481k, avg=9622.03, stdev=531296.16 00:23:03.868 clat percentiles (usec): 00:23:03.868 | 1.00th=[ 233], 5.00th=[ 243], 10.00th=[ 245], 00:23:03.868 | 20.00th=[ 251], 30.00th=[ 255], 40.00th=[ 260], 00:23:03.868 | 50.00th=[ 265], 60.00th=[ 269], 70.00th=[ 273], 00:23:03.868 | 80.00th=[ 277], 90.00th=[ 285], 95.00th=[ 41157], 00:23:03.868 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:23:03.868 | 99.95th=[ 42206], 99.99th=[17112761] 00:23:03.868 write: IOPS=102, BW=410KiB/s (419kB/s)(24.0MiB/60001msec); 0 zone resets 00:23:03.868 slat (usec): min=9, max=40626, avg=22.37, stdev=648.85 00:23:03.868 clat (usec): min=155, max=341, avg=189.97, stdev=18.86 00:23:03.868 lat (usec): min=166, max=40903, avg=212.34, stdev=651.12 00:23:03.868 clat percentiles (usec): 00:23:03.868 | 1.00th=[ 163], 5.00th=[ 169], 10.00th=[ 174], 20.00th=[ 178], 00:23:03.868 | 30.00th=[ 180], 40.00th=[ 184], 50.00th=[ 186], 60.00th=[ 190], 00:23:03.868 | 70.00th=[ 194], 80.00th=[ 198], 90.00th=[ 217], 95.00th=[ 239], 00:23:03.868 | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 253], 99.95th=[ 277], 00:23:03.868 | 99.99th=[ 343] 00:23:03.868 bw ( KiB/s): min= 776, max= 8192, per=100.00%, avg=6144.00, stdev=2975.04, samples=8 00:23:03.868 iops : min= 194, max= 2048, avg=1536.00, stdev=743.76, samples=8 00:23:03.868 lat (usec) : 250=59.46%, 500=37.44% 00:23:03.868 lat (msec) : 50=3.10%, >=2000=0.01% 00:23:03.868 cpu : usr=0.11%, sys=0.21%, ctx=12245, majf=0, minf=1 00:23:03.868 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:23:03.868 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.868 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:03.868 issued rwts: total=6097,6144,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:03.868 latency : target=0, window=0, percentile=100.00%, depth=1 00:23:03.868 00:23:03.868 Run status group 0 (all jobs): 00:23:03.868 READ: bw=406KiB/s (416kB/s), 406KiB/s-406KiB/s (416kB/s-416kB/s), io=23.8MiB (25.0MB), run=60001-60001msec 00:23:03.868 WRITE: bw=410KiB/s (419kB/s), 410KiB/s-410KiB/s (419kB/s-419kB/s), io=24.0MiB (25.2MB), run=60001-60001msec 00:23:03.868 00:23:03.868 Disk stats (read/write): 00:23:03.868 nvme0n1: ios=6146/6144, merge=0/0, ticks=18161/1147, in_queue=19308, util=99.76% 00:23:03.868 14:27:16 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:03.868 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:03.868 14:27:16 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:23:03.868 14:27:16 -- common/autotest_common.sh@1208 -- # local i=0 00:23:03.868 14:27:16 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:03.868 14:27:16 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:03.868 14:27:16 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:03.868 14:27:16 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:23:03.868 14:27:16 -- common/autotest_common.sh@1220 -- # return 0 00:23:03.868 14:27:16 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:23:03.868 14:27:16 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:23:03.868 nvmf hotplug test: fio successful as expected 00:23:03.868 14:27:16 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:03.868 14:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:03.868 14:27:16 -- common/autotest_common.sh@10 -- # set +x 00:23:03.868 14:27:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:03.868 14:27:16 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:23:03.868 14:27:16 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:23:03.868 14:27:16 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:23:03.869 14:27:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:03.869 14:27:16 -- nvmf/common.sh@116 -- # sync 00:23:03.869 14:27:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:03.869 14:27:16 -- nvmf/common.sh@119 -- # set +e 00:23:03.869 14:27:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:03.869 14:27:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:03.869 rmmod nvme_tcp 00:23:03.869 rmmod nvme_fabrics 00:23:03.869 rmmod nvme_keyring 00:23:03.869 14:27:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:03.869 14:27:16 -- nvmf/common.sh@123 -- # set -e 00:23:03.869 14:27:16 -- nvmf/common.sh@124 -- # return 0 00:23:03.869 14:27:16 -- nvmf/common.sh@477 -- # '[' -n 439892 ']' 00:23:03.869 14:27:16 -- nvmf/common.sh@478 -- # killprocess 439892 00:23:03.869 14:27:16 -- common/autotest_common.sh@936 -- # '[' -z 439892 ']' 00:23:03.869 14:27:16 -- common/autotest_common.sh@940 -- # kill -0 439892 00:23:03.869 14:27:16 -- common/autotest_common.sh@941 -- # uname 00:23:03.869 14:27:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:03.869 14:27:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 439892 00:23:03.869 14:27:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:03.869 14:27:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:03.869 14:27:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 439892' 00:23:03.869 killing process with pid 439892 00:23:03.869 14:27:16 -- common/autotest_common.sh@955 -- # kill 439892 00:23:03.869 14:27:16 -- common/autotest_common.sh@960 -- # wait 439892 00:23:03.869 14:27:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:03.869 14:27:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:03.869 14:27:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:03.869 14:27:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:03.869 14:27:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:03.869 14:27:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:03.869 14:27:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:03.869 14:27:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:04.437 14:27:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:04.437 00:23:04.437 real 1m12.778s 00:23:04.437 user 4m25.006s 00:23:04.437 sys 0m6.288s 00:23:04.437 14:27:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:04.437 14:27:18 -- common/autotest_common.sh@10 -- # set +x 00:23:04.437 ************************************ 00:23:04.437 END TEST nvmf_initiator_timeout 00:23:04.437 ************************************ 00:23:04.437 14:27:19 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:23:04.437 14:27:19 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:23:04.437 14:27:19 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:23:04.437 14:27:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:04.437 14:27:19 -- common/autotest_common.sh@10 -- # set +x 00:23:09.711 14:27:23 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:09.711 14:27:23 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:09.711 14:27:23 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:09.711 14:27:23 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:09.711 14:27:23 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:09.711 14:27:23 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:09.711 14:27:23 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:09.711 14:27:23 -- nvmf/common.sh@294 -- # net_devs=() 00:23:09.711 14:27:23 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:09.711 14:27:23 -- nvmf/common.sh@295 -- # e810=() 00:23:09.711 14:27:23 -- nvmf/common.sh@295 -- # local -ga e810 00:23:09.711 14:27:23 -- nvmf/common.sh@296 -- # x722=() 00:23:09.711 14:27:23 -- nvmf/common.sh@296 -- # local -ga x722 00:23:09.711 14:27:23 -- nvmf/common.sh@297 -- # mlx=() 00:23:09.711 14:27:23 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:09.711 14:27:23 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:09.711 14:27:23 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:09.711 14:27:23 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:09.711 14:27:23 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:09.711 14:27:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.711 14:27:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:23:09.711 Found 0000:af:00.0 (0x8086 - 0x159b) 00:23:09.711 14:27:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:09.711 14:27:23 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:23:09.711 Found 0000:af:00.1 (0x8086 - 0x159b) 00:23:09.711 14:27:23 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:09.711 14:27:23 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:09.711 14:27:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.711 14:27:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.711 14:27:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.711 14:27:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.711 14:27:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:23:09.711 Found net devices under 0000:af:00.0: cvl_0_0 00:23:09.711 14:27:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.711 14:27:23 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:09.711 14:27:23 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:09.711 14:27:23 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:09.711 14:27:23 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:09.711 14:27:23 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:23:09.711 Found net devices under 0000:af:00.1: cvl_0_1 00:23:09.711 14:27:23 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:09.711 14:27:23 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:09.711 14:27:23 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:09.711 14:27:23 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:23:09.711 14:27:23 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:09.711 14:27:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:09.711 14:27:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:09.711 14:27:23 -- common/autotest_common.sh@10 -- # set +x 00:23:09.711 ************************************ 00:23:09.711 START TEST nvmf_perf_adq 00:23:09.711 ************************************ 00:23:09.711 14:27:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:23:09.711 * Looking for test storage... 00:23:09.711 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:09.712 14:27:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:09.712 14:27:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:09.712 14:27:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:09.712 14:27:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:09.712 14:27:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:09.712 14:27:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:09.712 14:27:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:09.712 14:27:23 -- scripts/common.sh@335 -- # IFS=.-: 00:23:09.712 14:27:23 -- scripts/common.sh@335 -- # read -ra ver1 00:23:09.712 14:27:23 -- scripts/common.sh@336 -- # IFS=.-: 00:23:09.712 14:27:23 -- scripts/common.sh@336 -- # read -ra ver2 00:23:09.712 14:27:23 -- scripts/common.sh@337 -- # local 'op=<' 00:23:09.712 14:27:23 -- scripts/common.sh@339 -- # ver1_l=2 00:23:09.712 14:27:23 -- scripts/common.sh@340 -- # ver2_l=1 00:23:09.712 14:27:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:09.712 14:27:23 -- scripts/common.sh@343 -- # case "$op" in 00:23:09.712 14:27:23 -- scripts/common.sh@344 -- # : 1 00:23:09.712 14:27:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:09.712 14:27:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:09.712 14:27:23 -- scripts/common.sh@364 -- # decimal 1 00:23:09.712 14:27:23 -- scripts/common.sh@352 -- # local d=1 00:23:09.712 14:27:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:09.712 14:27:23 -- scripts/common.sh@354 -- # echo 1 00:23:09.712 14:27:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:09.712 14:27:23 -- scripts/common.sh@365 -- # decimal 2 00:23:09.712 14:27:23 -- scripts/common.sh@352 -- # local d=2 00:23:09.712 14:27:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:09.712 14:27:23 -- scripts/common.sh@354 -- # echo 2 00:23:09.712 14:27:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:09.712 14:27:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:09.712 14:27:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:09.712 14:27:23 -- scripts/common.sh@367 -- # return 0 00:23:09.712 14:27:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:09.712 14:27:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:09.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.712 --rc genhtml_branch_coverage=1 00:23:09.712 --rc genhtml_function_coverage=1 00:23:09.712 --rc genhtml_legend=1 00:23:09.712 --rc geninfo_all_blocks=1 00:23:09.712 --rc geninfo_unexecuted_blocks=1 00:23:09.712 00:23:09.712 ' 00:23:09.712 14:27:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:09.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.712 --rc genhtml_branch_coverage=1 00:23:09.712 --rc genhtml_function_coverage=1 00:23:09.712 --rc genhtml_legend=1 00:23:09.712 --rc geninfo_all_blocks=1 00:23:09.712 --rc geninfo_unexecuted_blocks=1 00:23:09.712 00:23:09.712 ' 00:23:09.712 14:27:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:09.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.712 --rc genhtml_branch_coverage=1 00:23:09.712 --rc genhtml_function_coverage=1 00:23:09.712 --rc genhtml_legend=1 00:23:09.712 --rc geninfo_all_blocks=1 00:23:09.712 --rc geninfo_unexecuted_blocks=1 00:23:09.712 00:23:09.712 ' 00:23:09.712 14:27:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:09.712 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:09.712 --rc genhtml_branch_coverage=1 00:23:09.712 --rc genhtml_function_coverage=1 00:23:09.712 --rc genhtml_legend=1 00:23:09.712 --rc geninfo_all_blocks=1 00:23:09.712 --rc geninfo_unexecuted_blocks=1 00:23:09.712 00:23:09.712 ' 00:23:09.712 14:27:23 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:09.712 14:27:23 -- nvmf/common.sh@7 -- # uname -s 00:23:09.712 14:27:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:09.712 14:27:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:09.712 14:27:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:09.712 14:27:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:09.712 14:27:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:09.712 14:27:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:09.712 14:27:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:09.712 14:27:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:09.712 14:27:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:09.712 14:27:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:09.712 14:27:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:23:09.712 14:27:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:23:09.712 14:27:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:09.712 14:27:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:09.712 14:27:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:09.712 14:27:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:09.712 14:27:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:09.712 14:27:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:09.712 14:27:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:09.712 14:27:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.712 14:27:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.712 14:27:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.712 14:27:23 -- paths/export.sh@5 -- # export PATH 00:23:09.712 14:27:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:09.712 14:27:23 -- nvmf/common.sh@46 -- # : 0 00:23:09.712 14:27:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:09.712 14:27:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:09.712 14:27:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:09.712 14:27:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:09.712 14:27:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:09.712 14:27:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:09.712 14:27:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:09.712 14:27:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:09.712 14:27:23 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:23:09.712 14:27:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:09.712 14:27:23 -- common/autotest_common.sh@10 -- # set +x 00:23:14.986 14:27:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:14.986 14:27:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:14.986 14:27:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:14.986 14:27:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:14.986 14:27:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:14.986 14:27:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:14.986 14:27:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:14.986 14:27:28 -- nvmf/common.sh@294 -- # net_devs=() 00:23:14.986 14:27:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:14.986 14:27:28 -- nvmf/common.sh@295 -- # e810=() 00:23:14.986 14:27:28 -- nvmf/common.sh@295 -- # local -ga e810 00:23:14.986 14:27:28 -- nvmf/common.sh@296 -- # x722=() 00:23:14.986 14:27:28 -- nvmf/common.sh@296 -- # local -ga x722 00:23:14.986 14:27:28 -- nvmf/common.sh@297 -- # mlx=() 00:23:14.986 14:27:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:14.986 14:27:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:14.986 14:27:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:14.986 14:27:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:14.986 14:27:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:14.986 14:27:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:14.986 14:27:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:23:14.986 Found 0000:af:00.0 (0x8086 - 0x159b) 00:23:14.986 14:27:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:14.986 14:27:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:23:14.986 Found 0000:af:00.1 (0x8086 - 0x159b) 00:23:14.986 14:27:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:14.986 14:27:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:14.986 14:27:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:14.986 14:27:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:14.986 14:27:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:14.986 14:27:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:14.986 14:27:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:23:14.986 Found net devices under 0000:af:00.0: cvl_0_0 00:23:14.986 14:27:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:14.986 14:27:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:14.986 14:27:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:14.986 14:27:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:14.986 14:27:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:14.986 14:27:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:23:14.986 Found net devices under 0000:af:00.1: cvl_0_1 00:23:14.986 14:27:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:14.986 14:27:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:14.986 14:27:28 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:14.986 14:27:28 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:23:14.986 14:27:28 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:23:14.986 14:27:28 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:23:14.986 14:27:28 -- target/perf_adq.sh@52 -- # rmmod ice 00:23:15.245 14:27:29 -- target/perf_adq.sh@53 -- # modprobe ice 00:23:17.785 14:27:32 -- target/perf_adq.sh@54 -- # sleep 5 00:23:23.053 14:27:37 -- target/perf_adq.sh@67 -- # nvmftestinit 00:23:23.053 14:27:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:23.053 14:27:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:23.053 14:27:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:23.053 14:27:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:23.053 14:27:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:23.053 14:27:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:23.053 14:27:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:23.053 14:27:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:23.053 14:27:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:23.053 14:27:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:23.053 14:27:37 -- common/autotest_common.sh@10 -- # set +x 00:23:23.053 14:27:37 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:23.053 14:27:37 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:23.053 14:27:37 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:23.053 14:27:37 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:23.053 14:27:37 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:23.053 14:27:37 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:23.053 14:27:37 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:23.053 14:27:37 -- nvmf/common.sh@294 -- # net_devs=() 00:23:23.053 14:27:37 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:23.053 14:27:37 -- nvmf/common.sh@295 -- # e810=() 00:23:23.053 14:27:37 -- nvmf/common.sh@295 -- # local -ga e810 00:23:23.053 14:27:37 -- nvmf/common.sh@296 -- # x722=() 00:23:23.053 14:27:37 -- nvmf/common.sh@296 -- # local -ga x722 00:23:23.053 14:27:37 -- nvmf/common.sh@297 -- # mlx=() 00:23:23.053 14:27:37 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:23.053 14:27:37 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:23.053 14:27:37 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:23.053 14:27:37 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:23.053 14:27:37 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:23.053 14:27:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:23.053 14:27:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:23:23.053 Found 0000:af:00.0 (0x8086 - 0x159b) 00:23:23.053 14:27:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:23.053 14:27:37 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:23:23.053 Found 0000:af:00.1 (0x8086 - 0x159b) 00:23:23.053 14:27:37 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:23.053 14:27:37 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:23.053 14:27:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:23.053 14:27:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:23.053 14:27:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:23.053 14:27:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:23:23.053 Found net devices under 0000:af:00.0: cvl_0_0 00:23:23.053 14:27:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:23.053 14:27:37 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:23.053 14:27:37 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:23.053 14:27:37 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:23.053 14:27:37 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:23.053 14:27:37 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:23:23.053 Found net devices under 0000:af:00.1: cvl_0_1 00:23:23.053 14:27:37 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:23.053 14:27:37 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:23.053 14:27:37 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:23.053 14:27:37 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:23.053 14:27:37 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:23.053 14:27:37 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:23.053 14:27:37 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:23.053 14:27:37 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:23.053 14:27:37 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:23.053 14:27:37 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:23.053 14:27:37 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:23.053 14:27:37 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:23.053 14:27:37 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:23.053 14:27:37 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:23.053 14:27:37 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:23.053 14:27:37 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:23.053 14:27:37 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:23.053 14:27:37 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:23.053 14:27:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:23.053 14:27:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:23.053 14:27:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:23.053 14:27:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:23.053 14:27:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:23.054 14:27:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:23.054 14:27:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:23.054 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:23.054 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.512 ms 00:23:23.054 00:23:23.054 --- 10.0.0.2 ping statistics --- 00:23:23.054 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:23.054 rtt min/avg/max/mdev = 0.512/0.512/0.512/0.000 ms 00:23:23.054 14:27:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:23.054 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:23.054 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.173 ms 00:23:23.054 00:23:23.054 --- 10.0.0.1 ping statistics --- 00:23:23.054 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:23.054 rtt min/avg/max/mdev = 0.173/0.173/0.173/0.000 ms 00:23:23.054 14:27:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:23.054 14:27:37 -- nvmf/common.sh@410 -- # return 0 00:23:23.054 14:27:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:23.054 14:27:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:23.054 14:27:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:23.054 14:27:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:23.054 14:27:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:23.054 14:27:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:23.054 14:27:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:23.054 14:27:37 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:23:23.054 14:27:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:23.054 14:27:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:23.054 14:27:37 -- common/autotest_common.sh@10 -- # set +x 00:23:23.054 14:27:37 -- nvmf/common.sh@469 -- # nvmfpid=458971 00:23:23.054 14:27:37 -- nvmf/common.sh@470 -- # waitforlisten 458971 00:23:23.054 14:27:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:23:23.054 14:27:37 -- common/autotest_common.sh@829 -- # '[' -z 458971 ']' 00:23:23.054 14:27:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:23.054 14:27:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:23.054 14:27:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:23.054 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:23.054 14:27:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:23.054 14:27:37 -- common/autotest_common.sh@10 -- # set +x 00:23:23.054 [2024-12-16 14:27:37.546217] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:23.054 [2024-12-16 14:27:37.546264] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:23.054 EAL: No free 2048 kB hugepages reported on node 1 00:23:23.054 [2024-12-16 14:27:37.605600] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:23.312 [2024-12-16 14:27:37.681227] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:23.312 [2024-12-16 14:27:37.681336] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:23.312 [2024-12-16 14:27:37.681344] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:23.312 [2024-12-16 14:27:37.681350] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:23.312 [2024-12-16 14:27:37.681397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:23.312 [2024-12-16 14:27:37.681503] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:23.312 [2024-12-16 14:27:37.681588] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:23.312 [2024-12-16 14:27:37.681590] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:23.877 14:27:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:23.877 14:27:38 -- common/autotest_common.sh@862 -- # return 0 00:23:23.877 14:27:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:23.877 14:27:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:23.877 14:27:38 -- common/autotest_common.sh@10 -- # set +x 00:23:23.877 14:27:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:23.877 14:27:38 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:23:23.877 14:27:38 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:23:23.877 14:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.877 14:27:38 -- common/autotest_common.sh@10 -- # set +x 00:23:23.877 14:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:23.877 14:27:38 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:23:23.877 14:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:23.877 14:27:38 -- common/autotest_common.sh@10 -- # set +x 00:23:24.133 14:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.133 14:27:38 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:23:24.133 14:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.133 14:27:38 -- common/autotest_common.sh@10 -- # set +x 00:23:24.133 [2024-12-16 14:27:38.505140] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:24.133 14:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.133 14:27:38 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:24.133 14:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.133 14:27:38 -- common/autotest_common.sh@10 -- # set +x 00:23:24.133 Malloc1 00:23:24.133 14:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.133 14:27:38 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:24.133 14:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.133 14:27:38 -- common/autotest_common.sh@10 -- # set +x 00:23:24.133 14:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.133 14:27:38 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:23:24.133 14:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.133 14:27:38 -- common/autotest_common.sh@10 -- # set +x 00:23:24.133 14:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.133 14:27:38 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:24.133 14:27:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.133 14:27:38 -- common/autotest_common.sh@10 -- # set +x 00:23:24.133 [2024-12-16 14:27:38.552804] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:24.133 14:27:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.133 14:27:38 -- target/perf_adq.sh@73 -- # perfpid=459190 00:23:24.133 14:27:38 -- target/perf_adq.sh@74 -- # sleep 2 00:23:24.133 14:27:38 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:23:24.133 EAL: No free 2048 kB hugepages reported on node 1 00:23:26.032 14:27:40 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:23:26.032 14:27:40 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:23:26.032 14:27:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:26.032 14:27:40 -- target/perf_adq.sh@76 -- # wc -l 00:23:26.032 14:27:40 -- common/autotest_common.sh@10 -- # set +x 00:23:26.032 14:27:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:26.289 14:27:40 -- target/perf_adq.sh@76 -- # count=4 00:23:26.289 14:27:40 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:23:26.289 14:27:40 -- target/perf_adq.sh@81 -- # wait 459190 00:23:34.399 Initializing NVMe Controllers 00:23:34.399 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:34.399 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:23:34.399 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:23:34.399 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:23:34.399 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:23:34.399 Initialization complete. Launching workers. 00:23:34.399 ======================================================== 00:23:34.399 Latency(us) 00:23:34.399 Device Information : IOPS MiB/s Average min max 00:23:34.399 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11087.10 43.31 5783.93 1094.88 47719.18 00:23:34.399 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11304.40 44.16 5662.56 1035.70 10110.42 00:23:34.399 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11264.70 44.00 5681.87 986.59 10603.77 00:23:34.399 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 11338.40 44.29 5644.84 1043.64 10662.37 00:23:34.399 ======================================================== 00:23:34.399 Total : 44994.60 175.76 5692.84 986.59 47719.18 00:23:34.399 00:23:34.399 14:27:48 -- target/perf_adq.sh@82 -- # nvmftestfini 00:23:34.399 14:27:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:34.399 14:27:48 -- nvmf/common.sh@116 -- # sync 00:23:34.399 14:27:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:34.399 14:27:48 -- nvmf/common.sh@119 -- # set +e 00:23:34.399 14:27:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:34.399 14:27:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:34.399 rmmod nvme_tcp 00:23:34.399 rmmod nvme_fabrics 00:23:34.399 rmmod nvme_keyring 00:23:34.399 14:27:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:34.399 14:27:48 -- nvmf/common.sh@123 -- # set -e 00:23:34.399 14:27:48 -- nvmf/common.sh@124 -- # return 0 00:23:34.399 14:27:48 -- nvmf/common.sh@477 -- # '[' -n 458971 ']' 00:23:34.399 14:27:48 -- nvmf/common.sh@478 -- # killprocess 458971 00:23:34.399 14:27:48 -- common/autotest_common.sh@936 -- # '[' -z 458971 ']' 00:23:34.399 14:27:48 -- common/autotest_common.sh@940 -- # kill -0 458971 00:23:34.399 14:27:48 -- common/autotest_common.sh@941 -- # uname 00:23:34.399 14:27:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:34.399 14:27:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 458971 00:23:34.399 14:27:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:34.399 14:27:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:34.399 14:27:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 458971' 00:23:34.399 killing process with pid 458971 00:23:34.399 14:27:48 -- common/autotest_common.sh@955 -- # kill 458971 00:23:34.399 14:27:48 -- common/autotest_common.sh@960 -- # wait 458971 00:23:34.658 14:27:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:34.658 14:27:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:34.658 14:27:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:34.658 14:27:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:34.658 14:27:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:34.658 14:27:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:34.658 14:27:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:34.658 14:27:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:37.190 14:27:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:37.190 14:27:51 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:23:37.190 14:27:51 -- target/perf_adq.sh@52 -- # rmmod ice 00:23:37.756 14:27:52 -- target/perf_adq.sh@53 -- # modprobe ice 00:23:40.288 14:27:54 -- target/perf_adq.sh@54 -- # sleep 5 00:23:45.557 14:27:59 -- target/perf_adq.sh@87 -- # nvmftestinit 00:23:45.557 14:27:59 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:45.557 14:27:59 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:45.557 14:27:59 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:45.557 14:27:59 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:45.557 14:27:59 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:45.557 14:27:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:45.557 14:27:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:45.557 14:27:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:45.557 14:27:59 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:45.557 14:27:59 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:45.557 14:27:59 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:45.557 14:27:59 -- common/autotest_common.sh@10 -- # set +x 00:23:45.557 14:27:59 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:45.557 14:27:59 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:45.557 14:27:59 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:45.557 14:27:59 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:45.557 14:27:59 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:45.557 14:27:59 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:45.557 14:27:59 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:45.557 14:27:59 -- nvmf/common.sh@294 -- # net_devs=() 00:23:45.557 14:27:59 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:45.557 14:27:59 -- nvmf/common.sh@295 -- # e810=() 00:23:45.557 14:27:59 -- nvmf/common.sh@295 -- # local -ga e810 00:23:45.557 14:27:59 -- nvmf/common.sh@296 -- # x722=() 00:23:45.557 14:27:59 -- nvmf/common.sh@296 -- # local -ga x722 00:23:45.557 14:27:59 -- nvmf/common.sh@297 -- # mlx=() 00:23:45.557 14:27:59 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:45.558 14:27:59 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:45.558 14:27:59 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:45.558 14:27:59 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:45.558 14:27:59 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:45.558 14:27:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:45.558 14:27:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:23:45.558 Found 0000:af:00.0 (0x8086 - 0x159b) 00:23:45.558 14:27:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:45.558 14:27:59 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:23:45.558 Found 0000:af:00.1 (0x8086 - 0x159b) 00:23:45.558 14:27:59 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:45.558 14:27:59 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:45.558 14:27:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:45.558 14:27:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:45.558 14:27:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:45.558 14:27:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:23:45.558 Found net devices under 0000:af:00.0: cvl_0_0 00:23:45.558 14:27:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:45.558 14:27:59 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:45.558 14:27:59 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:45.558 14:27:59 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:45.558 14:27:59 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:45.558 14:27:59 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:23:45.558 Found net devices under 0000:af:00.1: cvl_0_1 00:23:45.558 14:27:59 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:45.558 14:27:59 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:45.558 14:27:59 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:45.558 14:27:59 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:45.558 14:27:59 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:45.558 14:27:59 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:45.558 14:27:59 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:45.558 14:27:59 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:45.558 14:27:59 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:45.558 14:27:59 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:45.558 14:27:59 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:45.558 14:27:59 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:45.558 14:27:59 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:45.558 14:27:59 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:45.558 14:27:59 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:45.558 14:27:59 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:45.558 14:27:59 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:45.558 14:27:59 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:45.558 14:27:59 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:45.558 14:27:59 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:45.558 14:27:59 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:45.558 14:27:59 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:45.558 14:27:59 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:45.558 14:27:59 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:45.558 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:45.558 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.909 ms 00:23:45.558 00:23:45.558 --- 10.0.0.2 ping statistics --- 00:23:45.558 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:45.558 rtt min/avg/max/mdev = 0.909/0.909/0.909/0.000 ms 00:23:45.558 14:27:59 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:45.558 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:45.558 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.187 ms 00:23:45.558 00:23:45.558 --- 10.0.0.1 ping statistics --- 00:23:45.558 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:45.558 rtt min/avg/max/mdev = 0.187/0.187/0.187/0.000 ms 00:23:45.558 14:27:59 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:45.558 14:27:59 -- nvmf/common.sh@410 -- # return 0 00:23:45.558 14:27:59 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:45.558 14:27:59 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:45.558 14:27:59 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:45.558 14:27:59 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:45.558 14:27:59 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:45.558 14:27:59 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:45.558 14:27:59 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:23:45.558 14:27:59 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:23:45.558 14:27:59 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:23:45.558 14:27:59 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:23:45.558 net.core.busy_poll = 1 00:23:45.558 14:28:00 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:23:45.558 net.core.busy_read = 1 00:23:45.558 14:28:00 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:23:45.558 14:28:00 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:23:45.817 14:28:00 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:23:45.817 14:28:00 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:23:45.817 14:28:00 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:23:45.817 14:28:00 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:23:45.817 14:28:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:45.817 14:28:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:45.817 14:28:00 -- common/autotest_common.sh@10 -- # set +x 00:23:45.817 14:28:00 -- nvmf/common.sh@469 -- # nvmfpid=463089 00:23:45.817 14:28:00 -- nvmf/common.sh@470 -- # waitforlisten 463089 00:23:45.817 14:28:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:23:45.817 14:28:00 -- common/autotest_common.sh@829 -- # '[' -z 463089 ']' 00:23:45.817 14:28:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:45.817 14:28:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:45.817 14:28:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:45.817 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:45.817 14:28:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:45.817 14:28:00 -- common/autotest_common.sh@10 -- # set +x 00:23:45.817 [2024-12-16 14:28:00.282152] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:45.817 [2024-12-16 14:28:00.282194] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:45.817 EAL: No free 2048 kB hugepages reported on node 1 00:23:45.817 [2024-12-16 14:28:00.339764] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:46.075 [2024-12-16 14:28:00.412073] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:46.075 [2024-12-16 14:28:00.412180] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:46.075 [2024-12-16 14:28:00.412188] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:46.075 [2024-12-16 14:28:00.412195] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:46.075 [2024-12-16 14:28:00.412249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:46.075 [2024-12-16 14:28:00.412267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:46.075 [2024-12-16 14:28:00.412375] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:46.075 [2024-12-16 14:28:00.412376] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:46.642 14:28:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:46.642 14:28:01 -- common/autotest_common.sh@862 -- # return 0 00:23:46.642 14:28:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:46.642 14:28:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:46.642 14:28:01 -- common/autotest_common.sh@10 -- # set +x 00:23:46.642 14:28:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:46.642 14:28:01 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:23:46.642 14:28:01 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:23:46.642 14:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:46.642 14:28:01 -- common/autotest_common.sh@10 -- # set +x 00:23:46.642 14:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:46.642 14:28:01 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:23:46.642 14:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:46.642 14:28:01 -- common/autotest_common.sh@10 -- # set +x 00:23:46.900 14:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:46.900 14:28:01 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:23:46.900 14:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:46.900 14:28:01 -- common/autotest_common.sh@10 -- # set +x 00:23:46.900 [2024-12-16 14:28:01.237373] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:46.900 14:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:46.900 14:28:01 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:23:46.900 14:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:46.900 14:28:01 -- common/autotest_common.sh@10 -- # set +x 00:23:46.900 Malloc1 00:23:46.900 14:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:46.900 14:28:01 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:23:46.900 14:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:46.900 14:28:01 -- common/autotest_common.sh@10 -- # set +x 00:23:46.900 14:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:46.900 14:28:01 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:23:46.900 14:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:46.900 14:28:01 -- common/autotest_common.sh@10 -- # set +x 00:23:46.900 14:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:46.900 14:28:01 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:46.900 14:28:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:46.900 14:28:01 -- common/autotest_common.sh@10 -- # set +x 00:23:46.900 [2024-12-16 14:28:01.284564] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:46.900 14:28:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:46.900 14:28:01 -- target/perf_adq.sh@94 -- # perfpid=463338 00:23:46.900 14:28:01 -- target/perf_adq.sh@95 -- # sleep 2 00:23:46.900 14:28:01 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:23:46.900 EAL: No free 2048 kB hugepages reported on node 1 00:23:48.801 14:28:03 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:23:48.801 14:28:03 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:23:48.801 14:28:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:48.801 14:28:03 -- target/perf_adq.sh@97 -- # wc -l 00:23:48.801 14:28:03 -- common/autotest_common.sh@10 -- # set +x 00:23:48.801 14:28:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:48.801 14:28:03 -- target/perf_adq.sh@97 -- # count=2 00:23:48.801 14:28:03 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:23:48.801 14:28:03 -- target/perf_adq.sh@103 -- # wait 463338 00:23:56.920 Initializing NVMe Controllers 00:23:56.920 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:23:56.920 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:23:56.920 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:23:56.920 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:23:56.920 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:23:56.920 Initialization complete. Launching workers. 00:23:56.920 ======================================================== 00:23:56.920 Latency(us) 00:23:56.920 Device Information : IOPS MiB/s Average min max 00:23:56.920 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 6106.80 23.85 10481.90 1462.35 56656.83 00:23:56.920 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 5817.00 22.72 11003.70 830.04 58809.77 00:23:56.920 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 16188.70 63.24 3953.01 947.67 45193.91 00:23:56.920 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5693.60 22.24 11242.29 1088.61 59884.47 00:23:56.920 ======================================================== 00:23:56.920 Total : 33806.09 132.06 7573.27 830.04 59884.47 00:23:56.920 00:23:56.920 14:28:11 -- target/perf_adq.sh@104 -- # nvmftestfini 00:23:56.920 14:28:11 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:56.920 14:28:11 -- nvmf/common.sh@116 -- # sync 00:23:56.920 14:28:11 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:56.920 14:28:11 -- nvmf/common.sh@119 -- # set +e 00:23:56.920 14:28:11 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:56.920 14:28:11 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:56.920 rmmod nvme_tcp 00:23:56.920 rmmod nvme_fabrics 00:23:56.920 rmmod nvme_keyring 00:23:56.920 14:28:11 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:57.179 14:28:11 -- nvmf/common.sh@123 -- # set -e 00:23:57.179 14:28:11 -- nvmf/common.sh@124 -- # return 0 00:23:57.179 14:28:11 -- nvmf/common.sh@477 -- # '[' -n 463089 ']' 00:23:57.179 14:28:11 -- nvmf/common.sh@478 -- # killprocess 463089 00:23:57.179 14:28:11 -- common/autotest_common.sh@936 -- # '[' -z 463089 ']' 00:23:57.179 14:28:11 -- common/autotest_common.sh@940 -- # kill -0 463089 00:23:57.179 14:28:11 -- common/autotest_common.sh@941 -- # uname 00:23:57.179 14:28:11 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:57.179 14:28:11 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 463089 00:23:57.179 14:28:11 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:57.179 14:28:11 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:57.179 14:28:11 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 463089' 00:23:57.179 killing process with pid 463089 00:23:57.179 14:28:11 -- common/autotest_common.sh@955 -- # kill 463089 00:23:57.179 14:28:11 -- common/autotest_common.sh@960 -- # wait 463089 00:23:57.438 14:28:11 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:57.438 14:28:11 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:57.438 14:28:11 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:57.438 14:28:11 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:57.438 14:28:11 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:57.438 14:28:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:57.438 14:28:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:57.438 14:28:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:59.525 14:28:13 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:59.526 14:28:13 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:23:59.526 00:23:59.526 real 0m50.072s 00:23:59.526 user 2m48.296s 00:23:59.526 sys 0m9.710s 00:23:59.526 14:28:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:59.526 14:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:59.526 ************************************ 00:23:59.526 END TEST nvmf_perf_adq 00:23:59.526 ************************************ 00:23:59.526 14:28:13 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:23:59.526 14:28:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:59.526 14:28:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:59.526 14:28:13 -- common/autotest_common.sh@10 -- # set +x 00:23:59.526 ************************************ 00:23:59.526 START TEST nvmf_shutdown 00:23:59.526 ************************************ 00:23:59.526 14:28:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:23:59.526 * Looking for test storage... 00:23:59.526 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:59.526 14:28:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:59.526 14:28:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:59.526 14:28:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:59.526 14:28:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:59.526 14:28:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:59.526 14:28:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:59.526 14:28:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:59.526 14:28:14 -- scripts/common.sh@335 -- # IFS=.-: 00:23:59.526 14:28:14 -- scripts/common.sh@335 -- # read -ra ver1 00:23:59.526 14:28:14 -- scripts/common.sh@336 -- # IFS=.-: 00:23:59.526 14:28:14 -- scripts/common.sh@336 -- # read -ra ver2 00:23:59.526 14:28:14 -- scripts/common.sh@337 -- # local 'op=<' 00:23:59.526 14:28:14 -- scripts/common.sh@339 -- # ver1_l=2 00:23:59.526 14:28:14 -- scripts/common.sh@340 -- # ver2_l=1 00:23:59.526 14:28:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:59.526 14:28:14 -- scripts/common.sh@343 -- # case "$op" in 00:23:59.526 14:28:14 -- scripts/common.sh@344 -- # : 1 00:23:59.526 14:28:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:59.526 14:28:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:59.526 14:28:14 -- scripts/common.sh@364 -- # decimal 1 00:23:59.526 14:28:14 -- scripts/common.sh@352 -- # local d=1 00:23:59.526 14:28:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:59.526 14:28:14 -- scripts/common.sh@354 -- # echo 1 00:23:59.526 14:28:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:59.526 14:28:14 -- scripts/common.sh@365 -- # decimal 2 00:23:59.526 14:28:14 -- scripts/common.sh@352 -- # local d=2 00:23:59.526 14:28:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:59.526 14:28:14 -- scripts/common.sh@354 -- # echo 2 00:23:59.526 14:28:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:59.526 14:28:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:59.526 14:28:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:59.526 14:28:14 -- scripts/common.sh@367 -- # return 0 00:23:59.526 14:28:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:59.526 14:28:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:59.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:59.526 --rc genhtml_branch_coverage=1 00:23:59.526 --rc genhtml_function_coverage=1 00:23:59.526 --rc genhtml_legend=1 00:23:59.526 --rc geninfo_all_blocks=1 00:23:59.526 --rc geninfo_unexecuted_blocks=1 00:23:59.526 00:23:59.526 ' 00:23:59.526 14:28:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:59.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:59.526 --rc genhtml_branch_coverage=1 00:23:59.526 --rc genhtml_function_coverage=1 00:23:59.526 --rc genhtml_legend=1 00:23:59.526 --rc geninfo_all_blocks=1 00:23:59.526 --rc geninfo_unexecuted_blocks=1 00:23:59.526 00:23:59.526 ' 00:23:59.526 14:28:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:59.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:59.526 --rc genhtml_branch_coverage=1 00:23:59.526 --rc genhtml_function_coverage=1 00:23:59.526 --rc genhtml_legend=1 00:23:59.526 --rc geninfo_all_blocks=1 00:23:59.526 --rc geninfo_unexecuted_blocks=1 00:23:59.526 00:23:59.526 ' 00:23:59.526 14:28:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:59.526 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:59.526 --rc genhtml_branch_coverage=1 00:23:59.526 --rc genhtml_function_coverage=1 00:23:59.526 --rc genhtml_legend=1 00:23:59.526 --rc geninfo_all_blocks=1 00:23:59.526 --rc geninfo_unexecuted_blocks=1 00:23:59.526 00:23:59.526 ' 00:23:59.526 14:28:14 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:59.526 14:28:14 -- nvmf/common.sh@7 -- # uname -s 00:23:59.526 14:28:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:59.526 14:28:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:59.526 14:28:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:59.526 14:28:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:59.526 14:28:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:59.526 14:28:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:59.526 14:28:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:59.526 14:28:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:59.526 14:28:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:59.526 14:28:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:59.526 14:28:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:23:59.526 14:28:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:23:59.526 14:28:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:59.526 14:28:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:59.526 14:28:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:59.526 14:28:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:59.526 14:28:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:59.526 14:28:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:59.526 14:28:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:59.526 14:28:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.526 14:28:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.526 14:28:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.526 14:28:14 -- paths/export.sh@5 -- # export PATH 00:23:59.526 14:28:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:59.526 14:28:14 -- nvmf/common.sh@46 -- # : 0 00:23:59.526 14:28:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:59.526 14:28:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:59.526 14:28:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:59.526 14:28:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:59.526 14:28:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:59.526 14:28:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:59.526 14:28:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:59.526 14:28:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:59.526 14:28:14 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:59.526 14:28:14 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:59.527 14:28:14 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:23:59.527 14:28:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:23:59.527 14:28:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:59.527 14:28:14 -- common/autotest_common.sh@10 -- # set +x 00:23:59.527 ************************************ 00:23:59.527 START TEST nvmf_shutdown_tc1 00:23:59.527 ************************************ 00:23:59.527 14:28:14 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:23:59.527 14:28:14 -- target/shutdown.sh@74 -- # starttarget 00:23:59.527 14:28:14 -- target/shutdown.sh@15 -- # nvmftestinit 00:23:59.527 14:28:14 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:59.527 14:28:14 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:59.527 14:28:14 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:59.527 14:28:14 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:59.527 14:28:14 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:59.527 14:28:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:59.527 14:28:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:59.527 14:28:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:59.527 14:28:14 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:59.527 14:28:14 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:59.527 14:28:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:59.527 14:28:14 -- common/autotest_common.sh@10 -- # set +x 00:24:04.794 14:28:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:04.794 14:28:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:04.794 14:28:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:04.794 14:28:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:04.794 14:28:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:04.794 14:28:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:04.794 14:28:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:04.794 14:28:19 -- nvmf/common.sh@294 -- # net_devs=() 00:24:04.794 14:28:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:04.794 14:28:19 -- nvmf/common.sh@295 -- # e810=() 00:24:04.794 14:28:19 -- nvmf/common.sh@295 -- # local -ga e810 00:24:04.794 14:28:19 -- nvmf/common.sh@296 -- # x722=() 00:24:04.794 14:28:19 -- nvmf/common.sh@296 -- # local -ga x722 00:24:04.794 14:28:19 -- nvmf/common.sh@297 -- # mlx=() 00:24:04.794 14:28:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:04.794 14:28:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:04.794 14:28:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:04.794 14:28:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:04.794 14:28:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:04.794 14:28:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:04.794 14:28:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:04.794 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:04.794 14:28:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:04.794 14:28:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:04.794 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:04.794 14:28:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:04.794 14:28:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:04.794 14:28:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:04.794 14:28:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:04.794 14:28:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:04.794 14:28:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:04.794 Found net devices under 0000:af:00.0: cvl_0_0 00:24:04.794 14:28:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:04.794 14:28:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:04.794 14:28:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:04.794 14:28:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:04.794 14:28:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:04.794 14:28:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:04.794 Found net devices under 0000:af:00.1: cvl_0_1 00:24:04.794 14:28:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:04.794 14:28:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:04.794 14:28:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:04.794 14:28:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:04.794 14:28:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:04.794 14:28:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:04.794 14:28:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:04.794 14:28:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:04.794 14:28:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:04.794 14:28:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:04.794 14:28:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:04.794 14:28:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:04.794 14:28:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:04.794 14:28:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:04.794 14:28:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:04.794 14:28:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:04.794 14:28:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:04.794 14:28:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:04.794 14:28:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:04.794 14:28:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:04.794 14:28:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:04.794 14:28:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:05.053 14:28:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:05.053 14:28:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:05.053 14:28:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:05.053 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:05.053 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.331 ms 00:24:05.053 00:24:05.053 --- 10.0.0.2 ping statistics --- 00:24:05.053 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:05.053 rtt min/avg/max/mdev = 0.331/0.331/0.331/0.000 ms 00:24:05.053 14:28:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:05.053 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:05.053 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.228 ms 00:24:05.053 00:24:05.053 --- 10.0.0.1 ping statistics --- 00:24:05.053 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:05.053 rtt min/avg/max/mdev = 0.228/0.228/0.228/0.000 ms 00:24:05.053 14:28:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:05.053 14:28:19 -- nvmf/common.sh@410 -- # return 0 00:24:05.053 14:28:19 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:05.053 14:28:19 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:05.053 14:28:19 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:05.053 14:28:19 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:05.053 14:28:19 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:05.053 14:28:19 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:05.053 14:28:19 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:05.053 14:28:19 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:05.053 14:28:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:05.053 14:28:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:05.053 14:28:19 -- common/autotest_common.sh@10 -- # set +x 00:24:05.053 14:28:19 -- nvmf/common.sh@469 -- # nvmfpid=468497 00:24:05.053 14:28:19 -- nvmf/common.sh@470 -- # waitforlisten 468497 00:24:05.053 14:28:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:05.053 14:28:19 -- common/autotest_common.sh@829 -- # '[' -z 468497 ']' 00:24:05.053 14:28:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:05.053 14:28:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:05.053 14:28:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:05.053 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:05.053 14:28:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:05.053 14:28:19 -- common/autotest_common.sh@10 -- # set +x 00:24:05.053 [2024-12-16 14:28:19.556163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:05.053 [2024-12-16 14:28:19.556209] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:05.053 EAL: No free 2048 kB hugepages reported on node 1 00:24:05.053 [2024-12-16 14:28:19.616429] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:05.311 [2024-12-16 14:28:19.684677] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:05.311 [2024-12-16 14:28:19.684805] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:05.311 [2024-12-16 14:28:19.684812] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:05.311 [2024-12-16 14:28:19.684819] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:05.311 [2024-12-16 14:28:19.684946] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:05.311 [2024-12-16 14:28:19.685038] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:05.311 [2024-12-16 14:28:19.685125] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:05.311 [2024-12-16 14:28:19.685126] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:05.876 14:28:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:05.876 14:28:20 -- common/autotest_common.sh@862 -- # return 0 00:24:05.876 14:28:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:05.876 14:28:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:05.876 14:28:20 -- common/autotest_common.sh@10 -- # set +x 00:24:05.876 14:28:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:05.876 14:28:20 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:05.876 14:28:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:05.876 14:28:20 -- common/autotest_common.sh@10 -- # set +x 00:24:05.877 [2024-12-16 14:28:20.418268] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:05.877 14:28:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:05.877 14:28:20 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:05.877 14:28:20 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:05.877 14:28:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:05.877 14:28:20 -- common/autotest_common.sh@10 -- # set +x 00:24:05.877 14:28:20 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:05.877 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:05.877 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:05.877 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:05.877 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:05.877 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:05.877 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:05.877 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:05.877 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:06.134 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:06.134 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:06.134 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:06.134 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:06.134 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:06.134 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:06.134 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:06.135 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:06.135 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:06.135 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:06.135 14:28:20 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:06.135 14:28:20 -- target/shutdown.sh@28 -- # cat 00:24:06.135 14:28:20 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:06.135 14:28:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:06.135 14:28:20 -- common/autotest_common.sh@10 -- # set +x 00:24:06.135 Malloc1 00:24:06.135 [2024-12-16 14:28:20.513827] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:06.135 Malloc2 00:24:06.135 Malloc3 00:24:06.135 Malloc4 00:24:06.135 Malloc5 00:24:06.135 Malloc6 00:24:06.393 Malloc7 00:24:06.393 Malloc8 00:24:06.393 Malloc9 00:24:06.393 Malloc10 00:24:06.393 14:28:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:06.393 14:28:20 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:06.393 14:28:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:06.393 14:28:20 -- common/autotest_common.sh@10 -- # set +x 00:24:06.393 14:28:20 -- target/shutdown.sh@78 -- # perfpid=468778 00:24:06.393 14:28:20 -- target/shutdown.sh@79 -- # waitforlisten 468778 /var/tmp/bdevperf.sock 00:24:06.393 14:28:20 -- common/autotest_common.sh@829 -- # '[' -z 468778 ']' 00:24:06.393 14:28:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:06.393 14:28:20 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:24:06.393 14:28:20 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:06.393 14:28:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:06.393 14:28:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:06.393 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:06.393 14:28:20 -- nvmf/common.sh@520 -- # config=() 00:24:06.393 14:28:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:06.393 14:28:20 -- nvmf/common.sh@520 -- # local subsystem config 00:24:06.393 14:28:20 -- common/autotest_common.sh@10 -- # set +x 00:24:06.393 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.393 { 00:24:06.393 "params": { 00:24:06.393 "name": "Nvme$subsystem", 00:24:06.393 "trtype": "$TEST_TRANSPORT", 00:24:06.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.393 "adrfam": "ipv4", 00:24:06.393 "trsvcid": "$NVMF_PORT", 00:24:06.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.393 "hdgst": ${hdgst:-false}, 00:24:06.393 "ddgst": ${ddgst:-false} 00:24:06.393 }, 00:24:06.393 "method": "bdev_nvme_attach_controller" 00:24:06.393 } 00:24:06.393 EOF 00:24:06.393 )") 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.393 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.393 { 00:24:06.393 "params": { 00:24:06.393 "name": "Nvme$subsystem", 00:24:06.393 "trtype": "$TEST_TRANSPORT", 00:24:06.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.393 "adrfam": "ipv4", 00:24:06.393 "trsvcid": "$NVMF_PORT", 00:24:06.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.393 "hdgst": ${hdgst:-false}, 00:24:06.393 "ddgst": ${ddgst:-false} 00:24:06.393 }, 00:24:06.393 "method": "bdev_nvme_attach_controller" 00:24:06.393 } 00:24:06.393 EOF 00:24:06.393 )") 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.393 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.393 { 00:24:06.393 "params": { 00:24:06.393 "name": "Nvme$subsystem", 00:24:06.393 "trtype": "$TEST_TRANSPORT", 00:24:06.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.393 "adrfam": "ipv4", 00:24:06.393 "trsvcid": "$NVMF_PORT", 00:24:06.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.393 "hdgst": ${hdgst:-false}, 00:24:06.393 "ddgst": ${ddgst:-false} 00:24:06.393 }, 00:24:06.393 "method": "bdev_nvme_attach_controller" 00:24:06.393 } 00:24:06.393 EOF 00:24:06.393 )") 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.393 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.393 { 00:24:06.393 "params": { 00:24:06.393 "name": "Nvme$subsystem", 00:24:06.393 "trtype": "$TEST_TRANSPORT", 00:24:06.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.393 "adrfam": "ipv4", 00:24:06.393 "trsvcid": "$NVMF_PORT", 00:24:06.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.393 "hdgst": ${hdgst:-false}, 00:24:06.393 "ddgst": ${ddgst:-false} 00:24:06.393 }, 00:24:06.393 "method": "bdev_nvme_attach_controller" 00:24:06.393 } 00:24:06.393 EOF 00:24:06.393 )") 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.393 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.393 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.393 { 00:24:06.393 "params": { 00:24:06.393 "name": "Nvme$subsystem", 00:24:06.393 "trtype": "$TEST_TRANSPORT", 00:24:06.393 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.393 "adrfam": "ipv4", 00:24:06.393 "trsvcid": "$NVMF_PORT", 00:24:06.393 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.393 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.393 "hdgst": ${hdgst:-false}, 00:24:06.393 "ddgst": ${ddgst:-false} 00:24:06.393 }, 00:24:06.393 "method": "bdev_nvme_attach_controller" 00:24:06.393 } 00:24:06.393 EOF 00:24:06.393 )") 00:24:06.651 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.651 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.652 { 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme$subsystem", 00:24:06.652 "trtype": "$TEST_TRANSPORT", 00:24:06.652 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "$NVMF_PORT", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.652 "hdgst": ${hdgst:-false}, 00:24:06.652 "ddgst": ${ddgst:-false} 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 } 00:24:06.652 EOF 00:24:06.652 )") 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.652 [2024-12-16 14:28:20.976084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:06.652 [2024-12-16 14:28:20.976133] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:24:06.652 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.652 { 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme$subsystem", 00:24:06.652 "trtype": "$TEST_TRANSPORT", 00:24:06.652 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "$NVMF_PORT", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.652 "hdgst": ${hdgst:-false}, 00:24:06.652 "ddgst": ${ddgst:-false} 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 } 00:24:06.652 EOF 00:24:06.652 )") 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.652 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.652 { 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme$subsystem", 00:24:06.652 "trtype": "$TEST_TRANSPORT", 00:24:06.652 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "$NVMF_PORT", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.652 "hdgst": ${hdgst:-false}, 00:24:06.652 "ddgst": ${ddgst:-false} 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 } 00:24:06.652 EOF 00:24:06.652 )") 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.652 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.652 { 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme$subsystem", 00:24:06.652 "trtype": "$TEST_TRANSPORT", 00:24:06.652 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "$NVMF_PORT", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.652 "hdgst": ${hdgst:-false}, 00:24:06.652 "ddgst": ${ddgst:-false} 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 } 00:24:06.652 EOF 00:24:06.652 )") 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.652 14:28:20 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:06.652 { 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme$subsystem", 00:24:06.652 "trtype": "$TEST_TRANSPORT", 00:24:06.652 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "$NVMF_PORT", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:06.652 "hdgst": ${hdgst:-false}, 00:24:06.652 "ddgst": ${ddgst:-false} 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 } 00:24:06.652 EOF 00:24:06.652 )") 00:24:06.652 14:28:20 -- nvmf/common.sh@542 -- # cat 00:24:06.652 EAL: No free 2048 kB hugepages reported on node 1 00:24:06.652 14:28:21 -- nvmf/common.sh@544 -- # jq . 00:24:06.652 14:28:21 -- nvmf/common.sh@545 -- # IFS=, 00:24:06.652 14:28:21 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme1", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme2", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme3", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme4", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme5", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme6", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme7", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme8", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme9", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 },{ 00:24:06.652 "params": { 00:24:06.652 "name": "Nvme10", 00:24:06.652 "trtype": "tcp", 00:24:06.652 "traddr": "10.0.0.2", 00:24:06.652 "adrfam": "ipv4", 00:24:06.652 "trsvcid": "4420", 00:24:06.652 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:06.652 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:06.652 "hdgst": false, 00:24:06.652 "ddgst": false 00:24:06.652 }, 00:24:06.652 "method": "bdev_nvme_attach_controller" 00:24:06.652 }' 00:24:06.652 [2024-12-16 14:28:21.033809] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:06.652 [2024-12-16 14:28:21.102320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:08.024 14:28:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:08.024 14:28:22 -- common/autotest_common.sh@862 -- # return 0 00:24:08.024 14:28:22 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:08.024 14:28:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:08.024 14:28:22 -- common/autotest_common.sh@10 -- # set +x 00:24:08.024 14:28:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:08.024 14:28:22 -- target/shutdown.sh@83 -- # kill -9 468778 00:24:08.024 14:28:22 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:24:08.024 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 468778 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:24:08.024 14:28:22 -- target/shutdown.sh@87 -- # sleep 1 00:24:08.956 14:28:23 -- target/shutdown.sh@88 -- # kill -0 468497 00:24:08.956 14:28:23 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:24:08.956 14:28:23 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:08.956 14:28:23 -- nvmf/common.sh@520 -- # config=() 00:24:08.956 14:28:23 -- nvmf/common.sh@520 -- # local subsystem config 00:24:08.956 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:08.956 { 00:24:08.956 "params": { 00:24:08.956 "name": "Nvme$subsystem", 00:24:08.956 "trtype": "$TEST_TRANSPORT", 00:24:08.956 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:08.956 "adrfam": "ipv4", 00:24:08.956 "trsvcid": "$NVMF_PORT", 00:24:08.956 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:08.956 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:08.956 "hdgst": ${hdgst:-false}, 00:24:08.956 "ddgst": ${ddgst:-false} 00:24:08.956 }, 00:24:08.956 "method": "bdev_nvme_attach_controller" 00:24:08.956 } 00:24:08.956 EOF 00:24:08.956 )") 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:08.956 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:08.956 { 00:24:08.956 "params": { 00:24:08.956 "name": "Nvme$subsystem", 00:24:08.956 "trtype": "$TEST_TRANSPORT", 00:24:08.956 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:08.956 "adrfam": "ipv4", 00:24:08.956 "trsvcid": "$NVMF_PORT", 00:24:08.956 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:08.956 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:08.956 "hdgst": ${hdgst:-false}, 00:24:08.956 "ddgst": ${ddgst:-false} 00:24:08.956 }, 00:24:08.956 "method": "bdev_nvme_attach_controller" 00:24:08.956 } 00:24:08.956 EOF 00:24:08.956 )") 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:08.956 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:08.956 { 00:24:08.956 "params": { 00:24:08.956 "name": "Nvme$subsystem", 00:24:08.956 "trtype": "$TEST_TRANSPORT", 00:24:08.956 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:08.956 "adrfam": "ipv4", 00:24:08.956 "trsvcid": "$NVMF_PORT", 00:24:08.956 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:08.956 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:08.956 "hdgst": ${hdgst:-false}, 00:24:08.956 "ddgst": ${ddgst:-false} 00:24:08.956 }, 00:24:08.956 "method": "bdev_nvme_attach_controller" 00:24:08.956 } 00:24:08.956 EOF 00:24:08.956 )") 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:08.956 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:08.956 { 00:24:08.956 "params": { 00:24:08.956 "name": "Nvme$subsystem", 00:24:08.956 "trtype": "$TEST_TRANSPORT", 00:24:08.956 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:08.956 "adrfam": "ipv4", 00:24:08.956 "trsvcid": "$NVMF_PORT", 00:24:08.956 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:08.956 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:08.956 "hdgst": ${hdgst:-false}, 00:24:08.956 "ddgst": ${ddgst:-false} 00:24:08.956 }, 00:24:08.956 "method": "bdev_nvme_attach_controller" 00:24:08.956 } 00:24:08.956 EOF 00:24:08.956 )") 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:08.956 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:08.956 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:08.956 { 00:24:08.956 "params": { 00:24:08.956 "name": "Nvme$subsystem", 00:24:08.956 "trtype": "$TEST_TRANSPORT", 00:24:08.956 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:08.956 "adrfam": "ipv4", 00:24:08.956 "trsvcid": "$NVMF_PORT", 00:24:08.956 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:08.956 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:08.956 "hdgst": ${hdgst:-false}, 00:24:08.956 "ddgst": ${ddgst:-false} 00:24:08.956 }, 00:24:08.956 "method": "bdev_nvme_attach_controller" 00:24:08.956 } 00:24:08.956 EOF 00:24:08.956 )") 00:24:09.214 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:09.214 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:09.214 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:09.214 { 00:24:09.214 "params": { 00:24:09.214 "name": "Nvme$subsystem", 00:24:09.214 "trtype": "$TEST_TRANSPORT", 00:24:09.214 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:09.214 "adrfam": "ipv4", 00:24:09.214 "trsvcid": "$NVMF_PORT", 00:24:09.214 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:09.214 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:09.214 "hdgst": ${hdgst:-false}, 00:24:09.214 "ddgst": ${ddgst:-false} 00:24:09.214 }, 00:24:09.214 "method": "bdev_nvme_attach_controller" 00:24:09.214 } 00:24:09.214 EOF 00:24:09.214 )") 00:24:09.214 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:09.214 [2024-12-16 14:28:23.539611] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:09.214 [2024-12-16 14:28:23.539660] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid469256 ] 00:24:09.214 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:09.214 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:09.214 { 00:24:09.214 "params": { 00:24:09.214 "name": "Nvme$subsystem", 00:24:09.214 "trtype": "$TEST_TRANSPORT", 00:24:09.214 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:09.214 "adrfam": "ipv4", 00:24:09.214 "trsvcid": "$NVMF_PORT", 00:24:09.214 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:09.214 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:09.214 "hdgst": ${hdgst:-false}, 00:24:09.214 "ddgst": ${ddgst:-false} 00:24:09.214 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 } 00:24:09.215 EOF 00:24:09.215 )") 00:24:09.215 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:09.215 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:09.215 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:09.215 { 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme$subsystem", 00:24:09.215 "trtype": "$TEST_TRANSPORT", 00:24:09.215 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "$NVMF_PORT", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:09.215 "hdgst": ${hdgst:-false}, 00:24:09.215 "ddgst": ${ddgst:-false} 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 } 00:24:09.215 EOF 00:24:09.215 )") 00:24:09.215 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:09.215 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:09.215 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:09.215 { 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme$subsystem", 00:24:09.215 "trtype": "$TEST_TRANSPORT", 00:24:09.215 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "$NVMF_PORT", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:09.215 "hdgst": ${hdgst:-false}, 00:24:09.215 "ddgst": ${ddgst:-false} 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 } 00:24:09.215 EOF 00:24:09.215 )") 00:24:09.215 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:09.215 14:28:23 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:09.215 14:28:23 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:09.215 { 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme$subsystem", 00:24:09.215 "trtype": "$TEST_TRANSPORT", 00:24:09.215 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "$NVMF_PORT", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:09.215 "hdgst": ${hdgst:-false}, 00:24:09.215 "ddgst": ${ddgst:-false} 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 } 00:24:09.215 EOF 00:24:09.215 )") 00:24:09.215 14:28:23 -- nvmf/common.sh@542 -- # cat 00:24:09.215 EAL: No free 2048 kB hugepages reported on node 1 00:24:09.215 14:28:23 -- nvmf/common.sh@544 -- # jq . 00:24:09.215 14:28:23 -- nvmf/common.sh@545 -- # IFS=, 00:24:09.215 14:28:23 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme1", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme2", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme3", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme4", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme5", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme6", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme7", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme8", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme9", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 },{ 00:24:09.215 "params": { 00:24:09.215 "name": "Nvme10", 00:24:09.215 "trtype": "tcp", 00:24:09.215 "traddr": "10.0.0.2", 00:24:09.215 "adrfam": "ipv4", 00:24:09.215 "trsvcid": "4420", 00:24:09.215 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:09.215 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:09.215 "hdgst": false, 00:24:09.215 "ddgst": false 00:24:09.215 }, 00:24:09.215 "method": "bdev_nvme_attach_controller" 00:24:09.215 }' 00:24:09.215 [2024-12-16 14:28:23.597676] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:09.215 [2024-12-16 14:28:23.667377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:10.588 Running I/O for 1 seconds... 00:24:11.520 00:24:11.520 Latency(us) 00:24:11.520 [2024-12-16T13:28:26.094Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:11.520 [2024-12-16T13:28:26.094Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.520 Verification LBA range: start 0x0 length 0x400 00:24:11.520 Nvme1n1 : 1.07 486.20 30.39 0.00 0.00 129453.87 19473.55 110350.14 00:24:11.520 [2024-12-16T13:28:26.094Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme2n1 : 1.08 484.73 30.30 0.00 0.00 129426.07 15291.73 109351.50 00:24:11.521 [2024-12-16T13:28:26.095Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme3n1 : 1.06 493.69 30.86 0.00 0.00 126209.29 14480.34 99864.38 00:24:11.521 [2024-12-16T13:28:26.095Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme4n1 : 1.06 491.33 30.71 0.00 0.00 125916.29 17351.44 97867.09 00:24:11.521 [2024-12-16T13:28:26.095Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme5n1 : 1.07 488.69 30.54 0.00 0.00 125635.06 18974.23 94371.84 00:24:11.521 [2024-12-16T13:28:26.095Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme6n1 : 1.07 487.57 30.47 0.00 0.00 125196.00 18724.57 93872.52 00:24:11.521 [2024-12-16T13:28:26.095Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme7n1 : 1.08 484.22 30.26 0.00 0.00 125790.08 14043.43 106355.57 00:24:11.521 [2024-12-16T13:28:26.095Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme8n1 : 1.12 467.93 29.25 0.00 0.00 124705.05 17226.61 99365.06 00:24:11.521 [2024-12-16T13:28:26.095Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme9n1 : 1.08 482.79 30.17 0.00 0.00 124711.21 13981.01 104358.28 00:24:11.521 [2024-12-16T13:28:26.095Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:11.521 Verification LBA range: start 0x0 length 0x400 00:24:11.521 Nvme10n1 : 1.08 487.14 30.45 0.00 0.00 122891.21 8238.81 106355.57 00:24:11.521 [2024-12-16T13:28:26.095Z] =================================================================================================================== 00:24:11.521 [2024-12-16T13:28:26.095Z] Total : 4854.27 303.39 0.00 0.00 125991.04 8238.81 110350.14 00:24:11.779 14:28:26 -- target/shutdown.sh@93 -- # stoptarget 00:24:11.779 14:28:26 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:11.779 14:28:26 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:11.779 14:28:26 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:11.779 14:28:26 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:11.779 14:28:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:11.779 14:28:26 -- nvmf/common.sh@116 -- # sync 00:24:11.779 14:28:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:11.779 14:28:26 -- nvmf/common.sh@119 -- # set +e 00:24:11.779 14:28:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:11.779 14:28:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:11.779 rmmod nvme_tcp 00:24:11.779 rmmod nvme_fabrics 00:24:11.779 rmmod nvme_keyring 00:24:11.779 14:28:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:11.779 14:28:26 -- nvmf/common.sh@123 -- # set -e 00:24:12.036 14:28:26 -- nvmf/common.sh@124 -- # return 0 00:24:12.036 14:28:26 -- nvmf/common.sh@477 -- # '[' -n 468497 ']' 00:24:12.036 14:28:26 -- nvmf/common.sh@478 -- # killprocess 468497 00:24:12.037 14:28:26 -- common/autotest_common.sh@936 -- # '[' -z 468497 ']' 00:24:12.037 14:28:26 -- common/autotest_common.sh@940 -- # kill -0 468497 00:24:12.037 14:28:26 -- common/autotest_common.sh@941 -- # uname 00:24:12.037 14:28:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:12.037 14:28:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 468497 00:24:12.037 14:28:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:12.037 14:28:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:12.037 14:28:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 468497' 00:24:12.037 killing process with pid 468497 00:24:12.037 14:28:26 -- common/autotest_common.sh@955 -- # kill 468497 00:24:12.037 14:28:26 -- common/autotest_common.sh@960 -- # wait 468497 00:24:12.295 14:28:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:12.295 14:28:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:12.295 14:28:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:12.295 14:28:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:12.295 14:28:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:12.295 14:28:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:12.295 14:28:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:12.295 14:28:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:14.827 14:28:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:14.827 00:24:14.827 real 0m14.801s 00:24:14.827 user 0m33.864s 00:24:14.827 sys 0m5.302s 00:24:14.827 14:28:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:14.827 14:28:28 -- common/autotest_common.sh@10 -- # set +x 00:24:14.827 ************************************ 00:24:14.827 END TEST nvmf_shutdown_tc1 00:24:14.827 ************************************ 00:24:14.827 14:28:28 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:24:14.827 14:28:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:14.827 14:28:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:14.827 14:28:28 -- common/autotest_common.sh@10 -- # set +x 00:24:14.827 ************************************ 00:24:14.827 START TEST nvmf_shutdown_tc2 00:24:14.827 ************************************ 00:24:14.827 14:28:28 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:24:14.827 14:28:28 -- target/shutdown.sh@98 -- # starttarget 00:24:14.827 14:28:28 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:14.827 14:28:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:14.827 14:28:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:14.827 14:28:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:14.827 14:28:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:14.827 14:28:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:14.827 14:28:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:14.827 14:28:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:14.827 14:28:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:14.827 14:28:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:14.827 14:28:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:14.827 14:28:28 -- common/autotest_common.sh@10 -- # set +x 00:24:14.827 14:28:28 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:14.827 14:28:28 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:14.827 14:28:28 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:14.827 14:28:28 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:14.827 14:28:28 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:14.827 14:28:28 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:14.827 14:28:28 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:14.827 14:28:28 -- nvmf/common.sh@294 -- # net_devs=() 00:24:14.827 14:28:28 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:14.827 14:28:28 -- nvmf/common.sh@295 -- # e810=() 00:24:14.827 14:28:28 -- nvmf/common.sh@295 -- # local -ga e810 00:24:14.827 14:28:28 -- nvmf/common.sh@296 -- # x722=() 00:24:14.827 14:28:28 -- nvmf/common.sh@296 -- # local -ga x722 00:24:14.827 14:28:28 -- nvmf/common.sh@297 -- # mlx=() 00:24:14.827 14:28:28 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:14.827 14:28:28 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:14.827 14:28:28 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:14.827 14:28:28 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:14.827 14:28:28 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:14.827 14:28:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:14.827 14:28:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:14.827 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:14.827 14:28:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:14.827 14:28:28 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:14.827 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:14.827 14:28:28 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:14.827 14:28:28 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:14.827 14:28:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:14.827 14:28:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:14.827 14:28:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:14.827 14:28:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:14.827 Found net devices under 0000:af:00.0: cvl_0_0 00:24:14.827 14:28:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:14.827 14:28:28 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:14.827 14:28:28 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:14.827 14:28:28 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:14.827 14:28:28 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:14.827 14:28:28 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:14.827 Found net devices under 0000:af:00.1: cvl_0_1 00:24:14.827 14:28:28 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:14.827 14:28:28 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:14.827 14:28:28 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:14.827 14:28:28 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:14.827 14:28:28 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:14.827 14:28:28 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:14.827 14:28:28 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:14.827 14:28:28 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:14.827 14:28:28 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:14.827 14:28:28 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:14.827 14:28:28 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:14.827 14:28:28 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:14.827 14:28:28 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:14.827 14:28:28 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:14.827 14:28:28 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:14.827 14:28:28 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:14.827 14:28:28 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:14.827 14:28:28 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:14.827 14:28:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:14.827 14:28:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:14.827 14:28:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:14.827 14:28:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:14.827 14:28:29 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:14.827 14:28:29 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:14.827 14:28:29 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:14.827 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:14.827 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.344 ms 00:24:14.827 00:24:14.827 --- 10.0.0.2 ping statistics --- 00:24:14.827 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:14.827 rtt min/avg/max/mdev = 0.344/0.344/0.344/0.000 ms 00:24:14.827 14:28:29 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:14.827 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:14.827 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.200 ms 00:24:14.827 00:24:14.827 --- 10.0.0.1 ping statistics --- 00:24:14.827 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:14.827 rtt min/avg/max/mdev = 0.200/0.200/0.200/0.000 ms 00:24:14.827 14:28:29 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:14.827 14:28:29 -- nvmf/common.sh@410 -- # return 0 00:24:14.827 14:28:29 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:14.827 14:28:29 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:14.827 14:28:29 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:14.827 14:28:29 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:14.827 14:28:29 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:14.827 14:28:29 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:14.827 14:28:29 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:14.827 14:28:29 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:14.827 14:28:29 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:14.827 14:28:29 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:14.827 14:28:29 -- common/autotest_common.sh@10 -- # set +x 00:24:14.827 14:28:29 -- nvmf/common.sh@469 -- # nvmfpid=470277 00:24:14.827 14:28:29 -- nvmf/common.sh@470 -- # waitforlisten 470277 00:24:14.827 14:28:29 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:14.827 14:28:29 -- common/autotest_common.sh@829 -- # '[' -z 470277 ']' 00:24:14.827 14:28:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:14.827 14:28:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:14.827 14:28:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:14.827 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:14.827 14:28:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:14.827 14:28:29 -- common/autotest_common.sh@10 -- # set +x 00:24:14.828 [2024-12-16 14:28:29.228406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:14.828 [2024-12-16 14:28:29.228448] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:14.828 EAL: No free 2048 kB hugepages reported on node 1 00:24:14.828 [2024-12-16 14:28:29.285395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:14.828 [2024-12-16 14:28:29.359999] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:14.828 [2024-12-16 14:28:29.360123] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:14.828 [2024-12-16 14:28:29.360131] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:14.828 [2024-12-16 14:28:29.360137] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:14.828 [2024-12-16 14:28:29.360257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:14.828 [2024-12-16 14:28:29.360344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:14.828 [2024-12-16 14:28:29.360451] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:14.828 [2024-12-16 14:28:29.360453] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:15.760 14:28:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:15.760 14:28:30 -- common/autotest_common.sh@862 -- # return 0 00:24:15.760 14:28:30 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:15.760 14:28:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:15.760 14:28:30 -- common/autotest_common.sh@10 -- # set +x 00:24:15.760 14:28:30 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:15.760 14:28:30 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:15.760 14:28:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:15.760 14:28:30 -- common/autotest_common.sh@10 -- # set +x 00:24:15.760 [2024-12-16 14:28:30.088206] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:15.760 14:28:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:15.760 14:28:30 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:15.760 14:28:30 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:15.760 14:28:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:15.760 14:28:30 -- common/autotest_common.sh@10 -- # set +x 00:24:15.760 14:28:30 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:15.760 14:28:30 -- target/shutdown.sh@28 -- # cat 00:24:15.760 14:28:30 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:15.760 14:28:30 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:15.760 14:28:30 -- common/autotest_common.sh@10 -- # set +x 00:24:15.760 Malloc1 00:24:15.760 [2024-12-16 14:28:30.184035] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:15.760 Malloc2 00:24:15.760 Malloc3 00:24:15.760 Malloc4 00:24:15.760 Malloc5 00:24:16.018 Malloc6 00:24:16.018 Malloc7 00:24:16.018 Malloc8 00:24:16.018 Malloc9 00:24:16.018 Malloc10 00:24:16.018 14:28:30 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:16.018 14:28:30 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:16.018 14:28:30 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:16.018 14:28:30 -- common/autotest_common.sh@10 -- # set +x 00:24:16.277 14:28:30 -- target/shutdown.sh@102 -- # perfpid=470556 00:24:16.277 14:28:30 -- target/shutdown.sh@103 -- # waitforlisten 470556 /var/tmp/bdevperf.sock 00:24:16.277 14:28:30 -- common/autotest_common.sh@829 -- # '[' -z 470556 ']' 00:24:16.277 14:28:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:16.277 14:28:30 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:16.277 14:28:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:16.277 14:28:30 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:16.277 14:28:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:16.277 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:16.277 14:28:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:16.277 14:28:30 -- nvmf/common.sh@520 -- # config=() 00:24:16.277 14:28:30 -- common/autotest_common.sh@10 -- # set +x 00:24:16.277 14:28:30 -- nvmf/common.sh@520 -- # local subsystem config 00:24:16.277 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.277 { 00:24:16.277 "params": { 00:24:16.277 "name": "Nvme$subsystem", 00:24:16.277 "trtype": "$TEST_TRANSPORT", 00:24:16.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.277 "adrfam": "ipv4", 00:24:16.277 "trsvcid": "$NVMF_PORT", 00:24:16.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.277 "hdgst": ${hdgst:-false}, 00:24:16.277 "ddgst": ${ddgst:-false} 00:24:16.277 }, 00:24:16.277 "method": "bdev_nvme_attach_controller" 00:24:16.277 } 00:24:16.277 EOF 00:24:16.277 )") 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.277 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.277 { 00:24:16.277 "params": { 00:24:16.277 "name": "Nvme$subsystem", 00:24:16.277 "trtype": "$TEST_TRANSPORT", 00:24:16.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.277 "adrfam": "ipv4", 00:24:16.277 "trsvcid": "$NVMF_PORT", 00:24:16.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.277 "hdgst": ${hdgst:-false}, 00:24:16.277 "ddgst": ${ddgst:-false} 00:24:16.277 }, 00:24:16.277 "method": "bdev_nvme_attach_controller" 00:24:16.277 } 00:24:16.277 EOF 00:24:16.277 )") 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.277 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.277 { 00:24:16.277 "params": { 00:24:16.277 "name": "Nvme$subsystem", 00:24:16.277 "trtype": "$TEST_TRANSPORT", 00:24:16.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.277 "adrfam": "ipv4", 00:24:16.277 "trsvcid": "$NVMF_PORT", 00:24:16.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.277 "hdgst": ${hdgst:-false}, 00:24:16.277 "ddgst": ${ddgst:-false} 00:24:16.277 }, 00:24:16.277 "method": "bdev_nvme_attach_controller" 00:24:16.277 } 00:24:16.277 EOF 00:24:16.277 )") 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.277 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.277 { 00:24:16.277 "params": { 00:24:16.277 "name": "Nvme$subsystem", 00:24:16.277 "trtype": "$TEST_TRANSPORT", 00:24:16.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.277 "adrfam": "ipv4", 00:24:16.277 "trsvcid": "$NVMF_PORT", 00:24:16.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.277 "hdgst": ${hdgst:-false}, 00:24:16.277 "ddgst": ${ddgst:-false} 00:24:16.277 }, 00:24:16.277 "method": "bdev_nvme_attach_controller" 00:24:16.277 } 00:24:16.277 EOF 00:24:16.277 )") 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.277 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.277 { 00:24:16.277 "params": { 00:24:16.277 "name": "Nvme$subsystem", 00:24:16.277 "trtype": "$TEST_TRANSPORT", 00:24:16.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.277 "adrfam": "ipv4", 00:24:16.277 "trsvcid": "$NVMF_PORT", 00:24:16.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.277 "hdgst": ${hdgst:-false}, 00:24:16.277 "ddgst": ${ddgst:-false} 00:24:16.277 }, 00:24:16.277 "method": "bdev_nvme_attach_controller" 00:24:16.277 } 00:24:16.277 EOF 00:24:16.277 )") 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.277 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.277 { 00:24:16.277 "params": { 00:24:16.277 "name": "Nvme$subsystem", 00:24:16.277 "trtype": "$TEST_TRANSPORT", 00:24:16.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.277 "adrfam": "ipv4", 00:24:16.277 "trsvcid": "$NVMF_PORT", 00:24:16.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.277 "hdgst": ${hdgst:-false}, 00:24:16.277 "ddgst": ${ddgst:-false} 00:24:16.277 }, 00:24:16.277 "method": "bdev_nvme_attach_controller" 00:24:16.277 } 00:24:16.277 EOF 00:24:16.277 )") 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.277 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.277 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.277 { 00:24:16.277 "params": { 00:24:16.277 "name": "Nvme$subsystem", 00:24:16.277 "trtype": "$TEST_TRANSPORT", 00:24:16.277 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.277 "adrfam": "ipv4", 00:24:16.277 "trsvcid": "$NVMF_PORT", 00:24:16.277 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.277 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.278 "hdgst": ${hdgst:-false}, 00:24:16.278 "ddgst": ${ddgst:-false} 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 } 00:24:16.278 EOF 00:24:16.278 )") 00:24:16.278 [2024-12-16 14:28:30.650393] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:16.278 [2024-12-16 14:28:30.650442] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid470556 ] 00:24:16.278 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.278 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.278 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.278 { 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme$subsystem", 00:24:16.278 "trtype": "$TEST_TRANSPORT", 00:24:16.278 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "$NVMF_PORT", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.278 "hdgst": ${hdgst:-false}, 00:24:16.278 "ddgst": ${ddgst:-false} 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 } 00:24:16.278 EOF 00:24:16.278 )") 00:24:16.278 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.278 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.278 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.278 { 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme$subsystem", 00:24:16.278 "trtype": "$TEST_TRANSPORT", 00:24:16.278 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "$NVMF_PORT", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.278 "hdgst": ${hdgst:-false}, 00:24:16.278 "ddgst": ${ddgst:-false} 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 } 00:24:16.278 EOF 00:24:16.278 )") 00:24:16.278 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.278 14:28:30 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:16.278 14:28:30 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:16.278 { 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme$subsystem", 00:24:16.278 "trtype": "$TEST_TRANSPORT", 00:24:16.278 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "$NVMF_PORT", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:16.278 "hdgst": ${hdgst:-false}, 00:24:16.278 "ddgst": ${ddgst:-false} 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 } 00:24:16.278 EOF 00:24:16.278 )") 00:24:16.278 14:28:30 -- nvmf/common.sh@542 -- # cat 00:24:16.278 EAL: No free 2048 kB hugepages reported on node 1 00:24:16.278 14:28:30 -- nvmf/common.sh@544 -- # jq . 00:24:16.278 14:28:30 -- nvmf/common.sh@545 -- # IFS=, 00:24:16.278 14:28:30 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme1", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme2", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme3", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme4", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme5", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme6", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme7", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme8", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme9", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 },{ 00:24:16.278 "params": { 00:24:16.278 "name": "Nvme10", 00:24:16.278 "trtype": "tcp", 00:24:16.278 "traddr": "10.0.0.2", 00:24:16.278 "adrfam": "ipv4", 00:24:16.278 "trsvcid": "4420", 00:24:16.278 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:16.278 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:16.278 "hdgst": false, 00:24:16.278 "ddgst": false 00:24:16.278 }, 00:24:16.278 "method": "bdev_nvme_attach_controller" 00:24:16.278 }' 00:24:16.278 [2024-12-16 14:28:30.708168] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:16.278 [2024-12-16 14:28:30.777008] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:18.178 Running I/O for 10 seconds... 00:24:18.436 14:28:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:18.436 14:28:32 -- common/autotest_common.sh@862 -- # return 0 00:24:18.436 14:28:32 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:18.436 14:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:18.436 14:28:32 -- common/autotest_common.sh@10 -- # set +x 00:24:18.436 14:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:18.436 14:28:32 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:18.436 14:28:32 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:18.436 14:28:32 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:18.436 14:28:32 -- target/shutdown.sh@57 -- # local ret=1 00:24:18.436 14:28:32 -- target/shutdown.sh@58 -- # local i 00:24:18.436 14:28:32 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:18.436 14:28:32 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:18.436 14:28:32 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:18.436 14:28:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:18.436 14:28:32 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:18.436 14:28:32 -- common/autotest_common.sh@10 -- # set +x 00:24:18.436 14:28:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:18.436 14:28:32 -- target/shutdown.sh@60 -- # read_io_count=211 00:24:18.436 14:28:32 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:24:18.436 14:28:32 -- target/shutdown.sh@64 -- # ret=0 00:24:18.436 14:28:32 -- target/shutdown.sh@65 -- # break 00:24:18.436 14:28:32 -- target/shutdown.sh@69 -- # return 0 00:24:18.436 14:28:32 -- target/shutdown.sh@109 -- # killprocess 470556 00:24:18.436 14:28:32 -- common/autotest_common.sh@936 -- # '[' -z 470556 ']' 00:24:18.436 14:28:32 -- common/autotest_common.sh@940 -- # kill -0 470556 00:24:18.436 14:28:32 -- common/autotest_common.sh@941 -- # uname 00:24:18.436 14:28:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:18.436 14:28:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 470556 00:24:18.436 14:28:32 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:18.436 14:28:32 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:18.436 14:28:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 470556' 00:24:18.436 killing process with pid 470556 00:24:18.436 14:28:32 -- common/autotest_common.sh@955 -- # kill 470556 00:24:18.436 14:28:32 -- common/autotest_common.sh@960 -- # wait 470556 00:24:18.695 Received shutdown signal, test time was about 0.721233 seconds 00:24:18.695 00:24:18.695 Latency(us) 00:24:18.695 [2024-12-16T13:28:33.269Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme1n1 : 0.66 475.56 29.72 0.00 0.00 131288.37 19099.06 126827.76 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme2n1 : 0.68 524.01 32.75 0.00 0.00 118604.16 13107.20 96369.13 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme3n1 : 0.68 525.03 32.81 0.00 0.00 117036.75 14730.00 94871.16 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme4n1 : 0.68 522.62 32.66 0.00 0.00 116631.31 13356.86 93872.52 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme5n1 : 0.72 492.65 30.79 0.00 0.00 116121.44 11858.90 93373.20 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme6n1 : 0.66 480.45 30.03 0.00 0.00 123581.78 17226.61 95869.81 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme7n1 : 0.66 478.59 29.91 0.00 0.00 122889.07 17725.93 94871.16 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme8n1 : 0.67 472.38 29.52 0.00 0.00 122982.19 20846.69 96369.13 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme9n1 : 0.67 470.03 29.38 0.00 0.00 122366.36 21221.18 98865.74 00:24:18.695 [2024-12-16T13:28:33.269Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:18.695 Verification LBA range: start 0x0 length 0x400 00:24:18.695 Nvme10n1 : 0.67 468.35 29.27 0.00 0.00 121689.11 20347.37 98865.74 00:24:18.695 [2024-12-16T13:28:33.269Z] =================================================================================================================== 00:24:18.695 [2024-12-16T13:28:33.269Z] Total : 4909.67 306.85 0.00 0.00 121115.03 11858.90 126827.76 00:24:18.953 14:28:33 -- target/shutdown.sh@112 -- # sleep 1 00:24:19.888 14:28:34 -- target/shutdown.sh@113 -- # kill -0 470277 00:24:19.888 14:28:34 -- target/shutdown.sh@115 -- # stoptarget 00:24:19.888 14:28:34 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:19.888 14:28:34 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:19.888 14:28:34 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:19.888 14:28:34 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:19.888 14:28:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:19.888 14:28:34 -- nvmf/common.sh@116 -- # sync 00:24:19.888 14:28:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:19.888 14:28:34 -- nvmf/common.sh@119 -- # set +e 00:24:19.888 14:28:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:19.888 14:28:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:19.888 rmmod nvme_tcp 00:24:19.888 rmmod nvme_fabrics 00:24:19.888 rmmod nvme_keyring 00:24:19.888 14:28:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:19.888 14:28:34 -- nvmf/common.sh@123 -- # set -e 00:24:19.888 14:28:34 -- nvmf/common.sh@124 -- # return 0 00:24:19.888 14:28:34 -- nvmf/common.sh@477 -- # '[' -n 470277 ']' 00:24:19.888 14:28:34 -- nvmf/common.sh@478 -- # killprocess 470277 00:24:19.888 14:28:34 -- common/autotest_common.sh@936 -- # '[' -z 470277 ']' 00:24:19.888 14:28:34 -- common/autotest_common.sh@940 -- # kill -0 470277 00:24:19.888 14:28:34 -- common/autotest_common.sh@941 -- # uname 00:24:19.888 14:28:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:19.888 14:28:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 470277 00:24:19.888 14:28:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:19.888 14:28:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:19.888 14:28:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 470277' 00:24:19.888 killing process with pid 470277 00:24:19.888 14:28:34 -- common/autotest_common.sh@955 -- # kill 470277 00:24:19.888 14:28:34 -- common/autotest_common.sh@960 -- # wait 470277 00:24:20.455 14:28:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:20.455 14:28:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:20.455 14:28:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:20.455 14:28:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:20.455 14:28:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:20.455 14:28:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:20.455 14:28:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:20.455 14:28:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:22.362 14:28:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:22.362 00:24:22.362 real 0m7.963s 00:24:22.362 user 0m24.557s 00:24:22.362 sys 0m1.304s 00:24:22.362 14:28:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:22.362 14:28:36 -- common/autotest_common.sh@10 -- # set +x 00:24:22.362 ************************************ 00:24:22.362 END TEST nvmf_shutdown_tc2 00:24:22.362 ************************************ 00:24:22.362 14:28:36 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:24:22.362 14:28:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:24:22.362 14:28:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:22.362 14:28:36 -- common/autotest_common.sh@10 -- # set +x 00:24:22.362 ************************************ 00:24:22.362 START TEST nvmf_shutdown_tc3 00:24:22.362 ************************************ 00:24:22.362 14:28:36 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:24:22.362 14:28:36 -- target/shutdown.sh@120 -- # starttarget 00:24:22.362 14:28:36 -- target/shutdown.sh@15 -- # nvmftestinit 00:24:22.362 14:28:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:22.362 14:28:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:22.362 14:28:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:22.362 14:28:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:22.362 14:28:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:22.362 14:28:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:22.362 14:28:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:22.362 14:28:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:22.362 14:28:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:22.362 14:28:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:22.362 14:28:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:22.362 14:28:36 -- common/autotest_common.sh@10 -- # set +x 00:24:22.362 14:28:36 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:22.362 14:28:36 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:22.362 14:28:36 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:22.362 14:28:36 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:22.362 14:28:36 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:22.362 14:28:36 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:22.362 14:28:36 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:22.362 14:28:36 -- nvmf/common.sh@294 -- # net_devs=() 00:24:22.362 14:28:36 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:22.362 14:28:36 -- nvmf/common.sh@295 -- # e810=() 00:24:22.362 14:28:36 -- nvmf/common.sh@295 -- # local -ga e810 00:24:22.362 14:28:36 -- nvmf/common.sh@296 -- # x722=() 00:24:22.362 14:28:36 -- nvmf/common.sh@296 -- # local -ga x722 00:24:22.362 14:28:36 -- nvmf/common.sh@297 -- # mlx=() 00:24:22.362 14:28:36 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:22.362 14:28:36 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:22.362 14:28:36 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:22.362 14:28:36 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:22.362 14:28:36 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:22.362 14:28:36 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:22.362 14:28:36 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:22.362 14:28:36 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:22.362 14:28:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:22.362 14:28:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:22.362 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:22.621 14:28:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:22.621 14:28:36 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:22.621 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:22.621 14:28:36 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:22.621 14:28:36 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:22.621 14:28:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:22.621 14:28:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:22.621 14:28:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:22.621 14:28:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:22.621 Found net devices under 0000:af:00.0: cvl_0_0 00:24:22.621 14:28:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:22.621 14:28:36 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:22.621 14:28:36 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:22.621 14:28:36 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:22.621 14:28:36 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:22.621 14:28:36 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:22.621 Found net devices under 0000:af:00.1: cvl_0_1 00:24:22.621 14:28:36 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:22.621 14:28:36 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:22.621 14:28:36 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:22.621 14:28:36 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:22.621 14:28:36 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:22.621 14:28:36 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:22.621 14:28:36 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:22.621 14:28:36 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:22.621 14:28:36 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:22.621 14:28:36 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:22.621 14:28:36 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:22.621 14:28:36 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:22.621 14:28:36 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:22.621 14:28:36 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:22.621 14:28:36 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:22.621 14:28:36 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:22.621 14:28:36 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:22.621 14:28:36 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:22.621 14:28:37 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:22.621 14:28:37 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:22.621 14:28:37 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:22.621 14:28:37 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:22.621 14:28:37 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:22.621 14:28:37 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:22.621 14:28:37 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:22.621 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:22.621 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.274 ms 00:24:22.621 00:24:22.621 --- 10.0.0.2 ping statistics --- 00:24:22.621 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:22.621 rtt min/avg/max/mdev = 0.274/0.274/0.274/0.000 ms 00:24:22.621 14:28:37 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:22.621 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:22.621 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:24:22.621 00:24:22.621 --- 10.0.0.1 ping statistics --- 00:24:22.621 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:22.621 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:24:22.621 14:28:37 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:22.621 14:28:37 -- nvmf/common.sh@410 -- # return 0 00:24:22.621 14:28:37 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:22.621 14:28:37 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:22.621 14:28:37 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:22.621 14:28:37 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:22.621 14:28:37 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:22.621 14:28:37 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:22.621 14:28:37 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:22.880 14:28:37 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:24:22.880 14:28:37 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:22.880 14:28:37 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:22.880 14:28:37 -- common/autotest_common.sh@10 -- # set +x 00:24:22.880 14:28:37 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:24:22.880 14:28:37 -- nvmf/common.sh@469 -- # nvmfpid=471635 00:24:22.880 14:28:37 -- nvmf/common.sh@470 -- # waitforlisten 471635 00:24:22.880 14:28:37 -- common/autotest_common.sh@829 -- # '[' -z 471635 ']' 00:24:22.880 14:28:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:22.880 14:28:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:22.880 14:28:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:22.880 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:22.880 14:28:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:22.880 14:28:37 -- common/autotest_common.sh@10 -- # set +x 00:24:22.880 [2024-12-16 14:28:37.234343] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:22.880 [2024-12-16 14:28:37.234384] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:22.880 EAL: No free 2048 kB hugepages reported on node 1 00:24:22.880 [2024-12-16 14:28:37.295836] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:22.880 [2024-12-16 14:28:37.369391] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:22.880 [2024-12-16 14:28:37.369497] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:22.880 [2024-12-16 14:28:37.369505] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:22.880 [2024-12-16 14:28:37.369511] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:22.880 [2024-12-16 14:28:37.369606] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:22.880 [2024-12-16 14:28:37.369713] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:22.880 [2024-12-16 14:28:37.369733] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:24:22.880 [2024-12-16 14:28:37.369739] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:23.814 14:28:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:23.814 14:28:38 -- common/autotest_common.sh@862 -- # return 0 00:24:23.814 14:28:38 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:23.814 14:28:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:23.814 14:28:38 -- common/autotest_common.sh@10 -- # set +x 00:24:23.814 14:28:38 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:23.814 14:28:38 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:23.814 14:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:23.814 14:28:38 -- common/autotest_common.sh@10 -- # set +x 00:24:23.814 [2024-12-16 14:28:38.113224] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:23.814 14:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:23.814 14:28:38 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:24:23.814 14:28:38 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:24:23.814 14:28:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:23.814 14:28:38 -- common/autotest_common.sh@10 -- # set +x 00:24:23.814 14:28:38 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:24:23.814 14:28:38 -- target/shutdown.sh@28 -- # cat 00:24:23.814 14:28:38 -- target/shutdown.sh@35 -- # rpc_cmd 00:24:23.814 14:28:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:23.814 14:28:38 -- common/autotest_common.sh@10 -- # set +x 00:24:23.814 Malloc1 00:24:23.814 [2024-12-16 14:28:38.208840] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:23.814 Malloc2 00:24:23.814 Malloc3 00:24:23.814 Malloc4 00:24:23.814 Malloc5 00:24:24.072 Malloc6 00:24:24.072 Malloc7 00:24:24.072 Malloc8 00:24:24.072 Malloc9 00:24:24.072 Malloc10 00:24:24.072 14:28:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:24.072 14:28:38 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:24:24.072 14:28:38 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:24.072 14:28:38 -- common/autotest_common.sh@10 -- # set +x 00:24:24.072 14:28:38 -- target/shutdown.sh@124 -- # perfpid=471918 00:24:24.072 14:28:38 -- target/shutdown.sh@125 -- # waitforlisten 471918 /var/tmp/bdevperf.sock 00:24:24.072 14:28:38 -- common/autotest_common.sh@829 -- # '[' -z 471918 ']' 00:24:24.072 14:28:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:24.072 14:28:38 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:24:24.072 14:28:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:24.072 14:28:38 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:24:24.072 14:28:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:24.072 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:24.072 14:28:38 -- nvmf/common.sh@520 -- # config=() 00:24:24.072 14:28:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:24.072 14:28:38 -- nvmf/common.sh@520 -- # local subsystem config 00:24:24.072 14:28:38 -- common/autotest_common.sh@10 -- # set +x 00:24:24.072 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.072 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.072 { 00:24:24.072 "params": { 00:24:24.072 "name": "Nvme$subsystem", 00:24:24.072 "trtype": "$TEST_TRANSPORT", 00:24:24.072 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.072 "adrfam": "ipv4", 00:24:24.072 "trsvcid": "$NVMF_PORT", 00:24:24.072 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.072 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.072 "hdgst": ${hdgst:-false}, 00:24:24.072 "ddgst": ${ddgst:-false} 00:24:24.072 }, 00:24:24.072 "method": "bdev_nvme_attach_controller" 00:24:24.072 } 00:24:24.072 EOF 00:24:24.072 )") 00:24:24.072 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.073 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.073 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.073 { 00:24:24.073 "params": { 00:24:24.073 "name": "Nvme$subsystem", 00:24:24.073 "trtype": "$TEST_TRANSPORT", 00:24:24.073 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.073 "adrfam": "ipv4", 00:24:24.073 "trsvcid": "$NVMF_PORT", 00:24:24.073 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.073 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.073 "hdgst": ${hdgst:-false}, 00:24:24.073 "ddgst": ${ddgst:-false} 00:24:24.073 }, 00:24:24.073 "method": "bdev_nvme_attach_controller" 00:24:24.073 } 00:24:24.073 EOF 00:24:24.073 )") 00:24:24.073 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.073 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.073 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.073 { 00:24:24.073 "params": { 00:24:24.073 "name": "Nvme$subsystem", 00:24:24.073 "trtype": "$TEST_TRANSPORT", 00:24:24.073 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.073 "adrfam": "ipv4", 00:24:24.073 "trsvcid": "$NVMF_PORT", 00:24:24.073 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.073 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.073 "hdgst": ${hdgst:-false}, 00:24:24.073 "ddgst": ${ddgst:-false} 00:24:24.073 }, 00:24:24.073 "method": "bdev_nvme_attach_controller" 00:24:24.073 } 00:24:24.073 EOF 00:24:24.073 )") 00:24:24.331 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.331 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.331 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.331 { 00:24:24.331 "params": { 00:24:24.331 "name": "Nvme$subsystem", 00:24:24.331 "trtype": "$TEST_TRANSPORT", 00:24:24.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.331 "adrfam": "ipv4", 00:24:24.331 "trsvcid": "$NVMF_PORT", 00:24:24.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.331 "hdgst": ${hdgst:-false}, 00:24:24.331 "ddgst": ${ddgst:-false} 00:24:24.331 }, 00:24:24.331 "method": "bdev_nvme_attach_controller" 00:24:24.331 } 00:24:24.331 EOF 00:24:24.331 )") 00:24:24.331 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.331 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.331 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.331 { 00:24:24.331 "params": { 00:24:24.331 "name": "Nvme$subsystem", 00:24:24.331 "trtype": "$TEST_TRANSPORT", 00:24:24.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.331 "adrfam": "ipv4", 00:24:24.331 "trsvcid": "$NVMF_PORT", 00:24:24.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.331 "hdgst": ${hdgst:-false}, 00:24:24.331 "ddgst": ${ddgst:-false} 00:24:24.331 }, 00:24:24.331 "method": "bdev_nvme_attach_controller" 00:24:24.331 } 00:24:24.331 EOF 00:24:24.331 )") 00:24:24.331 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.331 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.331 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.331 { 00:24:24.331 "params": { 00:24:24.331 "name": "Nvme$subsystem", 00:24:24.331 "trtype": "$TEST_TRANSPORT", 00:24:24.331 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.331 "adrfam": "ipv4", 00:24:24.331 "trsvcid": "$NVMF_PORT", 00:24:24.331 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.331 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.331 "hdgst": ${hdgst:-false}, 00:24:24.332 "ddgst": ${ddgst:-false} 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 } 00:24:24.332 EOF 00:24:24.332 )") 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.332 [2024-12-16 14:28:38.669766] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:24.332 [2024-12-16 14:28:38.669817] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid471918 ] 00:24:24.332 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.332 { 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme$subsystem", 00:24:24.332 "trtype": "$TEST_TRANSPORT", 00:24:24.332 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "$NVMF_PORT", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.332 "hdgst": ${hdgst:-false}, 00:24:24.332 "ddgst": ${ddgst:-false} 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 } 00:24:24.332 EOF 00:24:24.332 )") 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.332 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.332 { 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme$subsystem", 00:24:24.332 "trtype": "$TEST_TRANSPORT", 00:24:24.332 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "$NVMF_PORT", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.332 "hdgst": ${hdgst:-false}, 00:24:24.332 "ddgst": ${ddgst:-false} 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 } 00:24:24.332 EOF 00:24:24.332 )") 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.332 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.332 { 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme$subsystem", 00:24:24.332 "trtype": "$TEST_TRANSPORT", 00:24:24.332 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "$NVMF_PORT", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.332 "hdgst": ${hdgst:-false}, 00:24:24.332 "ddgst": ${ddgst:-false} 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 } 00:24:24.332 EOF 00:24:24.332 )") 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.332 14:28:38 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:24:24.332 { 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme$subsystem", 00:24:24.332 "trtype": "$TEST_TRANSPORT", 00:24:24.332 "traddr": "$NVMF_FIRST_TARGET_IP", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "$NVMF_PORT", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:24:24.332 "hdgst": ${hdgst:-false}, 00:24:24.332 "ddgst": ${ddgst:-false} 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 } 00:24:24.332 EOF 00:24:24.332 )") 00:24:24.332 14:28:38 -- nvmf/common.sh@542 -- # cat 00:24:24.332 EAL: No free 2048 kB hugepages reported on node 1 00:24:24.332 14:28:38 -- nvmf/common.sh@544 -- # jq . 00:24:24.332 14:28:38 -- nvmf/common.sh@545 -- # IFS=, 00:24:24.332 14:28:38 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme1", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme2", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme3", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme4", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme5", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme6", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme7", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme8", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme9", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 },{ 00:24:24.332 "params": { 00:24:24.332 "name": "Nvme10", 00:24:24.332 "trtype": "tcp", 00:24:24.332 "traddr": "10.0.0.2", 00:24:24.332 "adrfam": "ipv4", 00:24:24.332 "trsvcid": "4420", 00:24:24.332 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:24:24.332 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:24:24.332 "hdgst": false, 00:24:24.332 "ddgst": false 00:24:24.332 }, 00:24:24.332 "method": "bdev_nvme_attach_controller" 00:24:24.332 }' 00:24:24.332 [2024-12-16 14:28:38.727661] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:24.332 [2024-12-16 14:28:38.797249] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:25.764 Running I/O for 10 seconds... 00:24:26.331 14:28:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:26.331 14:28:40 -- common/autotest_common.sh@862 -- # return 0 00:24:26.331 14:28:40 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:24:26.331 14:28:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:26.331 14:28:40 -- common/autotest_common.sh@10 -- # set +x 00:24:26.603 14:28:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:26.603 14:28:40 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:26.603 14:28:40 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:24:26.603 14:28:40 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:24:26.603 14:28:40 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:24:26.603 14:28:40 -- target/shutdown.sh@57 -- # local ret=1 00:24:26.603 14:28:40 -- target/shutdown.sh@58 -- # local i 00:24:26.603 14:28:40 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:24:26.603 14:28:40 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:24:26.603 14:28:40 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:24:26.603 14:28:40 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:24:26.603 14:28:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:26.603 14:28:40 -- common/autotest_common.sh@10 -- # set +x 00:24:26.603 14:28:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:26.603 14:28:40 -- target/shutdown.sh@60 -- # read_io_count=254 00:24:26.603 14:28:40 -- target/shutdown.sh@63 -- # '[' 254 -ge 100 ']' 00:24:26.603 14:28:40 -- target/shutdown.sh@64 -- # ret=0 00:24:26.603 14:28:40 -- target/shutdown.sh@65 -- # break 00:24:26.603 14:28:40 -- target/shutdown.sh@69 -- # return 0 00:24:26.603 14:28:40 -- target/shutdown.sh@134 -- # killprocess 471635 00:24:26.603 14:28:40 -- common/autotest_common.sh@936 -- # '[' -z 471635 ']' 00:24:26.603 14:28:40 -- common/autotest_common.sh@940 -- # kill -0 471635 00:24:26.603 14:28:40 -- common/autotest_common.sh@941 -- # uname 00:24:26.603 14:28:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:26.603 14:28:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 471635 00:24:26.603 14:28:41 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:26.603 14:28:41 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:26.603 14:28:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 471635' 00:24:26.603 killing process with pid 471635 00:24:26.603 14:28:41 -- common/autotest_common.sh@955 -- # kill 471635 00:24:26.603 14:28:41 -- common/autotest_common.sh@960 -- # wait 471635 00:24:26.603 [2024-12-16 14:28:41.019013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.603 [2024-12-16 14:28:41.019063] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.603 [2024-12-16 14:28:41.019070] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.603 [2024-12-16 14:28:41.019077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.603 [2024-12-16 14:28:41.019083] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.603 [2024-12-16 14:28:41.019090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019114] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019127] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019134] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019146] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019152] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019158] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019164] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019170] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019182] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019188] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019194] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019200] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019219] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019224] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019230] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019243] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019255] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019266] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019285] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019291] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019303] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019314] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019326] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019358] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019409] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019420] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.019445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378aa0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021507] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021553] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021560] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021614] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021669] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021704] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.604 [2024-12-16 14:28:41.021710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021759] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021785] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021791] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021797] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021803] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021809] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021815] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021902] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021908] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021914] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.021920] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dc3b0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.023532] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378f30 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.023543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378f30 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.023549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378f30 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.023555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1378f30 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024395] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024418] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024426] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024440] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024452] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024476] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024493] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024523] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024543] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024557] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024596] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024608] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024638] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.605 [2024-12-16 14:28:41.024709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024726] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024775] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.024792] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13793e0 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.025925] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dad90 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026497] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026503] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026579] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026585] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026603] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026615] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026621] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026627] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026651] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026663] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026674] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026680] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026693] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026705] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026729] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026736] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026748] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026754] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026784] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.026860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db240 is same with the state(5) to be set 00:24:26.606 [2024-12-16 14:28:41.027378] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.606 [2024-12-16 14:28:41.027407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.606 [2024-12-16 14:28:41.027417] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.606 [2024-12-16 14:28:41.027424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.606 [2024-12-16 14:28:41.027432] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.606 [2024-12-16 14:28:41.027438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.606 [2024-12-16 14:28:41.027449] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027462] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e88190 is same with the state(5) to be set 00:24:26.607 [2024-12-16 14:28:41.027513] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027528] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027542] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027556] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e650e0 is same with the state(5) to be set 00:24:26.607 [2024-12-16 14:28:41.027589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027604] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027617] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027640] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e67e40 is same with the state(5) to be set 00:24:26.607 [2024-12-16 14:28:41.027691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027707] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027723] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027736] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dc9990 is same with the state(5) to be set 00:24:26.607 [2024-12-16 14:28:41.027771] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027787] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027801] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027814] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027827] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202bb40 is same with the state(5) to be set 00:24:26.607 [2024-12-16 14:28:41.027860] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027876] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027890] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027903] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.607 [2024-12-16 14:28:41.027910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.027916] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb2ae0 is same with the state(5) to be set 00:24:26.607 [2024-12-16 14:28:41.028192] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db5a0 is same with the state(5) to be set 00:24:26.607 [2024-12-16 14:28:41.028206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11db5a0 is same with the state(5) to be set 00:24:26.607 [2024-12-16 14:28:41.028255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:45824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028333] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028422] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:45952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:46080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:46208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.607 [2024-12-16 14:28:41.028501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.607 [2024-12-16 14:28:41.028508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:46336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028655] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028678] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with [2024-12-16 14:28:41.028678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:24:26.608 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with [2024-12-16 14:28:41.028690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:45056 len:12the state(5) to be set 00:24:26.608 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with [2024-12-16 14:28:41.028698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:24:26.608 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:46464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:46592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:46720 len:1[2024-12-16 14:28:41.028742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-12-16 14:28:41.028751] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028760] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:46848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028772] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:46976 len:12[2024-12-16 14:28:41.028779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-12-16 14:28:41.028789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:47104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:47232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:47360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028848] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with [2024-12-16 14:28:41.028848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:47488 len:1the state(5) to be set 00:24:26.608 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.608 [2024-12-16 14:28:41.028861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.608 [2024-12-16 14:28:41.028864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.608 [2024-12-16 14:28:41.028867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:47616 len:12[2024-12-16 14:28:41.028874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028883] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with [2024-12-16 14:28:41.028883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:24:26.609 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.028891] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:47744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.028898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.028905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:47872 len:12[2024-12-16 14:28:41.028912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-12-16 14:28:41.028921] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:48000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.028937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.028943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:48128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.028950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.028957] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028964] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:48256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.028970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.028976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:48384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.028987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.028995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.028998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:48512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029009] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:48640 len:1[2024-12-16 14:28:41.029015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-12-16 14:28:41.029023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:48768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029038] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029045] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:48896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with [2024-12-16 14:28:41.029059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:24:26.609 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:49024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:49152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029090] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-12-16 14:28:41.029097] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029105] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:49280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:49408 len:1[2024-12-16 14:28:41.029123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with 28 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with [2024-12-16 14:28:41.029131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:24:26.609 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029140] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dba50 is same with the state(5) to be set 00:24:26.609 [2024-12-16 14:28:41.029143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:49536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:49664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:49792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:49920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:50048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:50176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:50304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:50432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.609 [2024-12-16 14:28:41.029263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:50560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.609 [2024-12-16 14:28:41.029269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.029277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:50688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.610 [2024-12-16 14:28:41.029283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.029291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:50816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.610 [2024-12-16 14:28:41.029298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.029305] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa3360 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029357] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1fa3360 was disconnected and freed. reset controller. 00:24:26.610 [2024-12-16 14:28:41.029696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029733] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029739] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029745] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029756] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029761] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029778] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029827] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029833] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029839] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029845] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029850] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029879] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029885] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029890] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029905] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029911] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029917] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029929] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029934] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029940] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029946] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029960] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029966] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029972] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029978] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.029995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030001] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030013] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030018] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030024] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030048] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030054] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030060] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030066] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030072] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.030077] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x11dbf00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.037536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e88190 (9): Bad file descriptor 00:24:26.610 [2024-12-16 14:28:41.037584] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.610 [2024-12-16 14:28:41.037595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.037604] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.610 [2024-12-16 14:28:41.037611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.037618] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.610 [2024-12-16 14:28:41.037628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.037636] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.610 [2024-12-16 14:28:41.037642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.037650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1df00 is same with the state(5) to be set 00:24:26.610 [2024-12-16 14:28:41.037673] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.610 [2024-12-16 14:28:41.037681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.037688] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.610 [2024-12-16 14:28:41.037694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.037702] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.610 [2024-12-16 14:28:41.037708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.610 [2024-12-16 14:28:41.037715] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202b000 is same with the state(5) to be set 00:24:26.611 [2024-12-16 14:28:41.037751] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037766] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037780] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037793] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fc0470 is same with the state(5) to be set 00:24:26.611 [2024-12-16 14:28:41.037821] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e650e0 (9): Bad file descriptor 00:24:26.611 [2024-12-16 14:28:41.037833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e67e40 (9): Bad file descriptor 00:24:26.611 [2024-12-16 14:28:41.037847] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1dc9990 (9): Bad file descriptor 00:24:26.611 [2024-12-16 14:28:41.037868] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x202bb40 (9): Bad file descriptor 00:24:26.611 [2024-12-16 14:28:41.037897] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037911] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037924] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:24:26.611 [2024-12-16 14:28:41.037944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.037950] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e9d640 is same with the state(5) to be set 00:24:26.611 [2024-12-16 14:28:41.037963] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb2ae0 (9): Bad file descriptor 00:24:26.611 [2024-12-16 14:28:41.039204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:45824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:45952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:46080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:46208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:46336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039587] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.611 [2024-12-16 14:28:41.039629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.611 [2024-12-16 14:28:41.039638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:46464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:46592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:46720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:46848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:46976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:47104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:47232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:47360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:47488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:47616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039798] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:47744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:47872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:48000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:48128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:48256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:48384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:48512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:48640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:48768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:48896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:49024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:49152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:49280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.039986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.039994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:49408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:49536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:49664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040033] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:49792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:49920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:50048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:50176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:50304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:50432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:50560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:50688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:50816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.612 [2024-12-16 14:28:41.040166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.612 [2024-12-16 14:28:41.040173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20bb150 is same with the state(5) to be set 00:24:26.613 [2024-12-16 14:28:41.040227] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20bb150 was disconnected and freed. reset controller. 00:24:26.613 [2024-12-16 14:28:41.040503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:24:26.613 [2024-12-16 14:28:41.041236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:45824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:45952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:46080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:46208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:46336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:46464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:46592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:46720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:46848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:46976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:47104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:47232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:47360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:47488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:47616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:47744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:47872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:48000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041667] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:48128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:48256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:48384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:48512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:48640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:48768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:48896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:49024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:49152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:49280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:49408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.613 [2024-12-16 14:28:41.041831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:49536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.613 [2024-12-16 14:28:41.041837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:49664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:49792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:49920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:50048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:50176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.041986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.041993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.042000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.042007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.042015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:50304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.042021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.042030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:50432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.042036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:50560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:50688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:50816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.048888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.048973] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1fa1dc0 was disconnected and freed. reset controller. 00:24:26.614 [2024-12-16 14:28:41.050693] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:24:26.614 [2024-12-16 14:28:41.050916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.614 [2024-12-16 14:28:41.051022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.614 [2024-12-16 14:28:41.051033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1dc9990 with addr=10.0.0.2, port=4420 00:24:26.614 [2024-12-16 14:28:41.051043] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dc9990 is same with the state(5) to be set 00:24:26.614 [2024-12-16 14:28:41.051072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1df00 (9): Bad file descriptor 00:24:26.614 [2024-12-16 14:28:41.051094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x202b000 (9): Bad file descriptor 00:24:26.614 [2024-12-16 14:28:41.051114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fc0470 (9): Bad file descriptor 00:24:26.614 [2024-12-16 14:28:41.051135] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.614 [2024-12-16 14:28:41.051151] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e9d640 (9): Bad file descriptor 00:24:26.614 [2024-12-16 14:28:41.051170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1dc9990 (9): Bad file descriptor 00:24:26.614 [2024-12-16 14:28:41.051292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.614 [2024-12-16 14:28:41.051494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.614 [2024-12-16 14:28:41.051508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.051663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.051670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.052391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fa0870 is same with the state(5) to be set 00:24:26.615 [2024-12-16 14:28:41.052452] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1fa0870 was disconnected and freed. reset controller. 00:24:26.615 [2024-12-16 14:28:41.052460] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.615 [2024-12-16 14:28:41.053625] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:26.615 [2024-12-16 14:28:41.053720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.053992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.053998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.054013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.054027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.054042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20bdd10 is same with the state(5) to be set 00:24:26.615 [2024-12-16 14:28:41.054103] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20bdd10 was disconnected and freed. reset controller. 00:24:26.615 [2024-12-16 14:28:41.054267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:24:26.615 [2024-12-16 14:28:41.054411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.615 [2024-12-16 14:28:41.054498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.615 [2024-12-16 14:28:41.054507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e88190 with addr=10.0.0.2, port=4420 00:24:26.615 [2024-12-16 14:28:41.054515] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e88190 is same with the state(5) to be set 00:24:26.615 [2024-12-16 14:28:41.054563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.054572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.054590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.054608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.054623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.615 [2024-12-16 14:28:41.054638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.615 [2024-12-16 14:28:41.054646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054652] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054676] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.054993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.054999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055028] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.616 [2024-12-16 14:28:41.055182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.616 [2024-12-16 14:28:41.055188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055254] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.055541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.055549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.057755] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:26.617 [2024-12-16 14:28:41.057815] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:24:26.617 [2024-12-16 14:28:41.057875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.057886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.057899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.057906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.057916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.057924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.057933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.057940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.057949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.057957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.057966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.057973] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.057982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.057989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.057999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.617 [2024-12-16 14:28:41.058164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.617 [2024-12-16 14:28:41.058171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058392] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058425] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.618 [2024-12-16 14:28:41.058825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.618 [2024-12-16 14:28:41.058834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.058841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.058850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.058862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.058871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.058878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.058887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.058895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.058905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.058914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.058923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.058930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.060335] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:26.619 [2024-12-16 14:28:41.060357] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:24:26.619 [2024-12-16 14:28:41.060644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.619 [2024-12-16 14:28:41.060810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.619 [2024-12-16 14:28:41.060822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e67e40 with addr=10.0.0.2, port=4420 00:24:26.619 [2024-12-16 14:28:41.060830] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e67e40 is same with the state(5) to be set 00:24:26.619 [2024-12-16 14:28:41.060843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e88190 (9): Bad file descriptor 00:24:26.619 [2024-12-16 14:28:41.060858] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:24:26.619 [2024-12-16 14:28:41.060866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:24:26.619 [2024-12-16 14:28:41.060875] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:24:26.619 [2024-12-16 14:28:41.061457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.619 [2024-12-16 14:28:41.061969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.619 [2024-12-16 14:28:41.061976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.061987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.061994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062136] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:45440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:45568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:45696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:45824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:45952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.620 [2024-12-16 14:28:41.062515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.620 [2024-12-16 14:28:41.062523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f165f0 is same with the state(5) to be set 00:24:26.620 [2024-12-16 14:28:41.062591] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1f165f0 was disconnected and freed. reset controller. 00:24:26.620 [2024-12-16 14:28:41.062614] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:24:26.620 [2024-12-16 14:28:41.062624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.620 [2024-12-16 14:28:41.062631] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:24:26.620 [2024-12-16 14:28:41.062883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.620 [2024-12-16 14:28:41.063055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.620 [2024-12-16 14:28:41.063066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e650e0 with addr=10.0.0.2, port=4420 00:24:26.620 [2024-12-16 14:28:41.063074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e650e0 is same with the state(5) to be set 00:24:26.620 [2024-12-16 14:28:41.063157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.620 [2024-12-16 14:28:41.063314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.620 [2024-12-16 14:28:41.063324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x202bb40 with addr=10.0.0.2, port=4420 00:24:26.620 [2024-12-16 14:28:41.063332] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202bb40 is same with the state(5) to be set 00:24:26.620 [2024-12-16 14:28:41.063341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e67e40 (9): Bad file descriptor 00:24:26.620 [2024-12-16 14:28:41.063353] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:24:26.620 [2024-12-16 14:28:41.063360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:24:26.620 [2024-12-16 14:28:41.063367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:24:26.620 [2024-12-16 14:28:41.063397] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.621 [2024-12-16 14:28:41.063422] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.621 [2024-12-16 14:28:41.065169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.621 [2024-12-16 14:28:41.065198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:24:26.621 [2024-12-16 14:28:41.065371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.621 [2024-12-16 14:28:41.065537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.621 [2024-12-16 14:28:41.065547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fb2ae0 with addr=10.0.0.2, port=4420 00:24:26.621 [2024-12-16 14:28:41.065555] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fb2ae0 is same with the state(5) to be set 00:24:26.621 [2024-12-16 14:28:41.065631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.621 [2024-12-16 14:28:41.065723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.621 [2024-12-16 14:28:41.065733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e9d640 with addr=10.0.0.2, port=4420 00:24:26.621 [2024-12-16 14:28:41.065739] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e9d640 is same with the state(5) to be set 00:24:26.621 [2024-12-16 14:28:41.065748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e650e0 (9): Bad file descriptor 00:24:26.621 [2024-12-16 14:28:41.065757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x202bb40 (9): Bad file descriptor 00:24:26.621 [2024-12-16 14:28:41.065765] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:24:26.621 [2024-12-16 14:28:41.065771] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:24:26.621 [2024-12-16 14:28:41.065777] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:24:26.621 [2024-12-16 14:28:41.065790] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.621 [2024-12-16 14:28:41.065865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.065885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065892] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.065901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.065916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.065934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.065949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.065963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.065978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.065992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.065998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.621 [2024-12-16 14:28:41.066280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.621 [2024-12-16 14:28:41.066287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066488] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066604] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:34 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066784] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.066799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.066806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20bc730 is same with the state(5) to be set 00:24:26.622 [2024-12-16 14:28:41.067789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:40320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.067804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.067814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:40448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.067821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.067832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:40576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.067839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.067848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:40704 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.067860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.067868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.622 [2024-12-16 14:28:41.067875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.622 [2024-12-16 14:28:41.067883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.067889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.067897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.067904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.067912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.067918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.067926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.067933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.067941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.067947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.067956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.067962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.067970] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.067977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.067985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.067992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:40832 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:40960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:41088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:41216 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:41344 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:41472 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:41600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:41728 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068336] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:41856 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:41984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:42112 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:42240 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:42368 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:42496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:42624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:42752 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:42880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.623 [2024-12-16 14:28:41.068470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:43008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.623 [2024-12-16 14:28:41.068476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:43136 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:43264 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:43392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:43520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:43648 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:43776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:43904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:44032 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:44160 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:44288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:44416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:44544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:44672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:44800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:44928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:45056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:45184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:45312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:24:26.624 [2024-12-16 14:28:41.068738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:24:26.624 [2024-12-16 14:28:41.068746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f15010 is same with the state(5) to be set 00:24:26.624 [2024-12-16 14:28:41.070879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:24:26.624 [2024-12-16 14:28:41.070899] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.624 [2024-12-16 14:28:41.070907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:24:26.624 task offset: 45440 on job bdev=Nvme4n1 fails 00:24:26.624 00:24:26.624 Latency(us) 00:24:26.624 [2024-12-16T13:28:41.198Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme1n1 ended in about 0.74 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme1n1 : 0.74 392.93 24.56 86.42 0.00 132678.97 72901.00 132819.63 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme2n1 ended in about 0.74 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme2n1 : 0.74 453.51 28.34 28.51 0.00 129502.21 10610.59 102360.99 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme3n1 ended in about 0.74 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme3n1 : 0.74 452.90 28.31 86.78 0.00 115781.21 33204.91 95869.81 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme4n1 ended in about 0.72 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme4n1 : 0.72 461.74 28.86 88.48 0.00 112480.65 11484.40 94371.84 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme5n1 ended in about 0.73 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme5n1 : 0.73 455.02 28.44 87.19 0.00 113165.57 12046.14 93872.52 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme6n1 ended in about 0.75 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme6n1 : 0.75 387.07 24.19 85.13 0.00 128961.49 76895.57 106854.89 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme7n1 ended in about 0.74 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme7n1 : 0.74 450.27 28.14 28.31 0.00 125247.38 6647.22 98366.42 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme8n1 ended in about 0.75 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme8n1 : 0.75 386.08 24.13 84.91 0.00 127033.12 76895.57 99864.38 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme9n1 ended in about 0.75 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme9n1 : 0.75 395.22 24.70 85.45 0.00 123287.78 36700.16 99864.38 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:24:26.624 [2024-12-16T13:28:41.198Z] Job: Nvme10n1 ended in about 0.74 seconds with error 00:24:26.624 Verification LBA range: start 0x0 length 0x400 00:24:26.624 Nvme10n1 : 0.74 391.15 24.45 86.03 0.00 123012.52 55924.05 100863.02 00:24:26.624 [2024-12-16T13:28:41.198Z] =================================================================================================================== 00:24:26.624 [2024-12-16T13:28:41.198Z] Total : 4225.89 264.12 747.21 0.00 122789.46 6647.22 132819.63 00:24:26.624 [2024-12-16 14:28:41.096399] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:24:26.624 [2024-12-16 14:28:41.096441] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:24:26.624 [2024-12-16 14:28:41.096784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.624 [2024-12-16 14:28:41.096937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.624 [2024-12-16 14:28:41.096950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1fc0470 with addr=10.0.0.2, port=4420 00:24:26.624 [2024-12-16 14:28:41.096961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1fc0470 is same with the state(5) to be set 00:24:26.624 [2024-12-16 14:28:41.096977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fb2ae0 (9): Bad file descriptor 00:24:26.624 [2024-12-16 14:28:41.096989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e9d640 (9): Bad file descriptor 00:24:26.624 [2024-12-16 14:28:41.096998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:26.624 [2024-12-16 14:28:41.097004] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:26.624 [2024-12-16 14:28:41.097013] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:26.624 [2024-12-16 14:28:41.097029] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:24:26.624 [2024-12-16 14:28:41.097035] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:24:26.624 [2024-12-16 14:28:41.097042] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:24:26.624 [2024-12-16 14:28:41.097074] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.625 [2024-12-16 14:28:41.097085] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.625 [2024-12-16 14:28:41.097414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.097423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.097675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.097759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.097769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1dc9990 with addr=10.0.0.2, port=4420 00:24:26.625 [2024-12-16 14:28:41.097778] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1dc9990 is same with the state(5) to be set 00:24:26.625 [2024-12-16 14:28:41.097994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.098169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.098178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x202b000 with addr=10.0.0.2, port=4420 00:24:26.625 [2024-12-16 14:28:41.098186] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202b000 is same with the state(5) to be set 00:24:26.625 [2024-12-16 14:28:41.098341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.098489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.098499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1f1df00 with addr=10.0.0.2, port=4420 00:24:26.625 [2024-12-16 14:28:41.098506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1f1df00 is same with the state(5) to be set 00:24:26.625 [2024-12-16 14:28:41.098517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1fc0470 (9): Bad file descriptor 00:24:26.625 [2024-12-16 14:28:41.098527] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.098533] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.098540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:24:26.625 [2024-12-16 14:28:41.098555] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.098561] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.098568] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:24:26.625 [2024-12-16 14:28:41.098590] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.625 [2024-12-16 14:28:41.098601] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.625 [2024-12-16 14:28:41.098623] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:24:26.625 [2024-12-16 14:28:41.099388] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.099403] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.099428] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1dc9990 (9): Bad file descriptor 00:24:26.625 [2024-12-16 14:28:41.099439] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x202b000 (9): Bad file descriptor 00:24:26.625 [2024-12-16 14:28:41.099448] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f1df00 (9): Bad file descriptor 00:24:26.625 [2024-12-16 14:28:41.099456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.099462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.099469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:24:26.625 [2024-12-16 14:28:41.099522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:24:26.625 [2024-12-16 14:28:41.099534] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:24:26.625 [2024-12-16 14:28:41.099542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:24:26.625 [2024-12-16 14:28:41.099550] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:24:26.625 [2024-12-16 14:28:41.099557] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.099584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.099591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.099597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:24:26.625 [2024-12-16 14:28:41.099605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.099611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.099617] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:24:26.625 [2024-12-16 14:28:41.099626] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.099632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.099638] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:24:26.625 [2024-12-16 14:28:41.099670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.099677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.099686] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.099944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.100154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.100164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e88190 with addr=10.0.0.2, port=4420 00:24:26.625 [2024-12-16 14:28:41.100173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e88190 is same with the state(5) to be set 00:24:26.625 [2024-12-16 14:28:41.100316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.100494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.100506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e67e40 with addr=10.0.0.2, port=4420 00:24:26.625 [2024-12-16 14:28:41.100513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e67e40 is same with the state(5) to be set 00:24:26.625 [2024-12-16 14:28:41.100711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.100875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.100887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x202bb40 with addr=10.0.0.2, port=4420 00:24:26.625 [2024-12-16 14:28:41.100894] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x202bb40 is same with the state(5) to be set 00:24:26.625 [2024-12-16 14:28:41.101040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.101138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:24:26.625 [2024-12-16 14:28:41.101148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e650e0 with addr=10.0.0.2, port=4420 00:24:26.625 [2024-12-16 14:28:41.101155] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1e650e0 is same with the state(5) to be set 00:24:26.625 [2024-12-16 14:28:41.101185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e88190 (9): Bad file descriptor 00:24:26.625 [2024-12-16 14:28:41.101195] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e67e40 (9): Bad file descriptor 00:24:26.625 [2024-12-16 14:28:41.101204] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x202bb40 (9): Bad file descriptor 00:24:26.625 [2024-12-16 14:28:41.101212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1e650e0 (9): Bad file descriptor 00:24:26.625 [2024-12-16 14:28:41.101238] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.101246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.101253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:24:26.625 [2024-12-16 14:28:41.101262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.101268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.101274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:24:26.625 [2024-12-16 14:28:41.101282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.101288] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.101294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:24:26.625 [2024-12-16 14:28:41.101302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:24:26.625 [2024-12-16 14:28:41.101311] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:24:26.625 [2024-12-16 14:28:41.101318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:24:26.625 [2024-12-16 14:28:41.101341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.101348] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.101354] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:26.625 [2024-12-16 14:28:41.101359] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:24:27.193 14:28:41 -- target/shutdown.sh@135 -- # nvmfpid= 00:24:27.193 14:28:41 -- target/shutdown.sh@138 -- # sleep 1 00:24:28.128 14:28:42 -- target/shutdown.sh@141 -- # kill -9 471918 00:24:28.128 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (471918) - No such process 00:24:28.128 14:28:42 -- target/shutdown.sh@141 -- # true 00:24:28.128 14:28:42 -- target/shutdown.sh@143 -- # stoptarget 00:24:28.128 14:28:42 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:24:28.128 14:28:42 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:24:28.128 14:28:42 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:24:28.128 14:28:42 -- target/shutdown.sh@45 -- # nvmftestfini 00:24:28.128 14:28:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:28.128 14:28:42 -- nvmf/common.sh@116 -- # sync 00:24:28.128 14:28:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:28.128 14:28:42 -- nvmf/common.sh@119 -- # set +e 00:24:28.128 14:28:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:28.128 14:28:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:28.128 rmmod nvme_tcp 00:24:28.128 rmmod nvme_fabrics 00:24:28.128 rmmod nvme_keyring 00:24:28.128 14:28:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:28.128 14:28:42 -- nvmf/common.sh@123 -- # set -e 00:24:28.128 14:28:42 -- nvmf/common.sh@124 -- # return 0 00:24:28.128 14:28:42 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:24:28.128 14:28:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:28.128 14:28:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:28.128 14:28:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:28.128 14:28:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:28.128 14:28:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:28.128 14:28:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:28.128 14:28:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:28.128 14:28:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:30.029 14:28:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:30.029 00:24:30.029 real 0m7.687s 00:24:30.029 user 0m19.031s 00:24:30.029 sys 0m1.342s 00:24:30.287 14:28:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:30.287 14:28:44 -- common/autotest_common.sh@10 -- # set +x 00:24:30.287 ************************************ 00:24:30.287 END TEST nvmf_shutdown_tc3 00:24:30.287 ************************************ 00:24:30.287 14:28:44 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:24:30.287 00:24:30.287 real 0m30.756s 00:24:30.287 user 1m17.599s 00:24:30.287 sys 0m8.141s 00:24:30.287 14:28:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:30.287 14:28:44 -- common/autotest_common.sh@10 -- # set +x 00:24:30.287 ************************************ 00:24:30.287 END TEST nvmf_shutdown 00:24:30.287 ************************************ 00:24:30.287 14:28:44 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:24:30.287 14:28:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:30.287 14:28:44 -- common/autotest_common.sh@10 -- # set +x 00:24:30.287 14:28:44 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:24:30.287 14:28:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:30.287 14:28:44 -- common/autotest_common.sh@10 -- # set +x 00:24:30.287 14:28:44 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:24:30.287 14:28:44 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:24:30.287 14:28:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:30.287 14:28:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:30.287 14:28:44 -- common/autotest_common.sh@10 -- # set +x 00:24:30.287 ************************************ 00:24:30.287 START TEST nvmf_multicontroller 00:24:30.287 ************************************ 00:24:30.287 14:28:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:24:30.287 * Looking for test storage... 00:24:30.287 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:30.287 14:28:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:30.287 14:28:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:30.287 14:28:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:30.545 14:28:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:30.545 14:28:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:30.545 14:28:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:30.545 14:28:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:30.545 14:28:44 -- scripts/common.sh@335 -- # IFS=.-: 00:24:30.545 14:28:44 -- scripts/common.sh@335 -- # read -ra ver1 00:24:30.545 14:28:44 -- scripts/common.sh@336 -- # IFS=.-: 00:24:30.545 14:28:44 -- scripts/common.sh@336 -- # read -ra ver2 00:24:30.545 14:28:44 -- scripts/common.sh@337 -- # local 'op=<' 00:24:30.545 14:28:44 -- scripts/common.sh@339 -- # ver1_l=2 00:24:30.545 14:28:44 -- scripts/common.sh@340 -- # ver2_l=1 00:24:30.545 14:28:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:30.545 14:28:44 -- scripts/common.sh@343 -- # case "$op" in 00:24:30.545 14:28:44 -- scripts/common.sh@344 -- # : 1 00:24:30.545 14:28:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:30.545 14:28:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:30.545 14:28:44 -- scripts/common.sh@364 -- # decimal 1 00:24:30.545 14:28:44 -- scripts/common.sh@352 -- # local d=1 00:24:30.545 14:28:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:30.545 14:28:44 -- scripts/common.sh@354 -- # echo 1 00:24:30.545 14:28:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:30.545 14:28:44 -- scripts/common.sh@365 -- # decimal 2 00:24:30.545 14:28:44 -- scripts/common.sh@352 -- # local d=2 00:24:30.545 14:28:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:30.545 14:28:44 -- scripts/common.sh@354 -- # echo 2 00:24:30.545 14:28:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:30.545 14:28:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:30.545 14:28:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:30.545 14:28:44 -- scripts/common.sh@367 -- # return 0 00:24:30.545 14:28:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:30.546 14:28:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:30.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:30.546 --rc genhtml_branch_coverage=1 00:24:30.546 --rc genhtml_function_coverage=1 00:24:30.546 --rc genhtml_legend=1 00:24:30.546 --rc geninfo_all_blocks=1 00:24:30.546 --rc geninfo_unexecuted_blocks=1 00:24:30.546 00:24:30.546 ' 00:24:30.546 14:28:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:30.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:30.546 --rc genhtml_branch_coverage=1 00:24:30.546 --rc genhtml_function_coverage=1 00:24:30.546 --rc genhtml_legend=1 00:24:30.546 --rc geninfo_all_blocks=1 00:24:30.546 --rc geninfo_unexecuted_blocks=1 00:24:30.546 00:24:30.546 ' 00:24:30.546 14:28:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:30.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:30.546 --rc genhtml_branch_coverage=1 00:24:30.546 --rc genhtml_function_coverage=1 00:24:30.546 --rc genhtml_legend=1 00:24:30.546 --rc geninfo_all_blocks=1 00:24:30.546 --rc geninfo_unexecuted_blocks=1 00:24:30.546 00:24:30.546 ' 00:24:30.546 14:28:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:30.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:30.546 --rc genhtml_branch_coverage=1 00:24:30.546 --rc genhtml_function_coverage=1 00:24:30.546 --rc genhtml_legend=1 00:24:30.546 --rc geninfo_all_blocks=1 00:24:30.546 --rc geninfo_unexecuted_blocks=1 00:24:30.546 00:24:30.546 ' 00:24:30.546 14:28:44 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:30.546 14:28:44 -- nvmf/common.sh@7 -- # uname -s 00:24:30.546 14:28:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:30.546 14:28:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:30.546 14:28:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:30.546 14:28:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:30.546 14:28:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:30.546 14:28:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:30.546 14:28:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:30.546 14:28:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:30.546 14:28:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:30.546 14:28:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:30.546 14:28:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:24:30.546 14:28:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:24:30.546 14:28:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:30.546 14:28:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:30.546 14:28:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:30.546 14:28:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:30.546 14:28:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:30.546 14:28:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:30.546 14:28:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:30.546 14:28:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:30.546 14:28:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:30.546 14:28:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:30.546 14:28:44 -- paths/export.sh@5 -- # export PATH 00:24:30.546 14:28:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:30.546 14:28:44 -- nvmf/common.sh@46 -- # : 0 00:24:30.546 14:28:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:30.546 14:28:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:30.546 14:28:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:30.546 14:28:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:30.546 14:28:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:30.546 14:28:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:30.546 14:28:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:30.546 14:28:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:30.546 14:28:44 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:24:30.546 14:28:44 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:24:30.546 14:28:44 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:24:30.546 14:28:44 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:24:30.546 14:28:44 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:24:30.546 14:28:44 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:24:30.546 14:28:44 -- host/multicontroller.sh@23 -- # nvmftestinit 00:24:30.546 14:28:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:30.546 14:28:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:30.546 14:28:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:30.546 14:28:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:30.546 14:28:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:30.546 14:28:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:30.546 14:28:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:30.546 14:28:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:30.546 14:28:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:30.546 14:28:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:30.546 14:28:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:30.546 14:28:44 -- common/autotest_common.sh@10 -- # set +x 00:24:35.814 14:28:50 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:35.814 14:28:50 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:35.814 14:28:50 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:35.814 14:28:50 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:35.814 14:28:50 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:35.814 14:28:50 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:35.814 14:28:50 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:35.814 14:28:50 -- nvmf/common.sh@294 -- # net_devs=() 00:24:35.814 14:28:50 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:35.814 14:28:50 -- nvmf/common.sh@295 -- # e810=() 00:24:35.814 14:28:50 -- nvmf/common.sh@295 -- # local -ga e810 00:24:35.814 14:28:50 -- nvmf/common.sh@296 -- # x722=() 00:24:35.814 14:28:50 -- nvmf/common.sh@296 -- # local -ga x722 00:24:35.814 14:28:50 -- nvmf/common.sh@297 -- # mlx=() 00:24:35.814 14:28:50 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:35.814 14:28:50 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:35.814 14:28:50 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:35.814 14:28:50 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:35.814 14:28:50 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:35.814 14:28:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:35.814 14:28:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:35.814 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:35.814 14:28:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:35.814 14:28:50 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:35.814 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:35.814 14:28:50 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:35.814 14:28:50 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:35.814 14:28:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:35.814 14:28:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:35.814 14:28:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:35.814 14:28:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:35.814 Found net devices under 0000:af:00.0: cvl_0_0 00:24:35.814 14:28:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:35.814 14:28:50 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:35.814 14:28:50 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:35.814 14:28:50 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:35.814 14:28:50 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:35.814 14:28:50 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:35.814 Found net devices under 0000:af:00.1: cvl_0_1 00:24:35.814 14:28:50 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:35.814 14:28:50 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:35.814 14:28:50 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:35.814 14:28:50 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:35.814 14:28:50 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:35.814 14:28:50 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:35.814 14:28:50 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:35.814 14:28:50 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:35.814 14:28:50 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:35.814 14:28:50 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:35.814 14:28:50 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:35.814 14:28:50 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:35.814 14:28:50 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:35.814 14:28:50 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:35.814 14:28:50 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:35.814 14:28:50 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:35.814 14:28:50 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:36.072 14:28:50 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:36.072 14:28:50 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:36.072 14:28:50 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:36.072 14:28:50 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:36.072 14:28:50 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:36.331 14:28:50 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:36.331 14:28:50 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:36.331 14:28:50 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:36.331 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:36.331 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.277 ms 00:24:36.331 00:24:36.331 --- 10.0.0.2 ping statistics --- 00:24:36.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:36.331 rtt min/avg/max/mdev = 0.277/0.277/0.277/0.000 ms 00:24:36.331 14:28:50 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:36.331 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:36.331 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.129 ms 00:24:36.331 00:24:36.331 --- 10.0.0.1 ping statistics --- 00:24:36.331 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:36.331 rtt min/avg/max/mdev = 0.129/0.129/0.129/0.000 ms 00:24:36.331 14:28:50 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:36.331 14:28:50 -- nvmf/common.sh@410 -- # return 0 00:24:36.331 14:28:50 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:36.331 14:28:50 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:36.331 14:28:50 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:36.331 14:28:50 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:36.331 14:28:50 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:36.331 14:28:50 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:36.331 14:28:50 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:36.331 14:28:50 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:24:36.331 14:28:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:36.331 14:28:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:36.331 14:28:50 -- common/autotest_common.sh@10 -- # set +x 00:24:36.331 14:28:50 -- nvmf/common.sh@469 -- # nvmfpid=476104 00:24:36.331 14:28:50 -- nvmf/common.sh@470 -- # waitforlisten 476104 00:24:36.331 14:28:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:24:36.331 14:28:50 -- common/autotest_common.sh@829 -- # '[' -z 476104 ']' 00:24:36.331 14:28:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:36.331 14:28:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:36.331 14:28:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:36.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:36.331 14:28:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:36.331 14:28:50 -- common/autotest_common.sh@10 -- # set +x 00:24:36.331 [2024-12-16 14:28:50.789934] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:36.331 [2024-12-16 14:28:50.789976] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:36.331 EAL: No free 2048 kB hugepages reported on node 1 00:24:36.331 [2024-12-16 14:28:50.847978] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:24:36.589 [2024-12-16 14:28:50.921342] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:36.589 [2024-12-16 14:28:50.921449] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:36.589 [2024-12-16 14:28:50.921456] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:36.589 [2024-12-16 14:28:50.921462] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:36.589 [2024-12-16 14:28:50.921559] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:36.589 [2024-12-16 14:28:50.921649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:36.589 [2024-12-16 14:28:50.921650] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:37.155 14:28:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:37.155 14:28:51 -- common/autotest_common.sh@862 -- # return 0 00:24:37.155 14:28:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:37.155 14:28:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:37.155 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.155 14:28:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:37.155 14:28:51 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:37.155 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.155 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.155 [2024-12-16 14:28:51.657340] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:37.155 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.155 14:28:51 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:24:37.155 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.155 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.155 Malloc0 00:24:37.155 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.155 14:28:51 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:37.155 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.155 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.155 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.155 14:28:51 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:37.155 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.155 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.155 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.155 14:28:51 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:37.155 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.155 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.155 [2024-12-16 14:28:51.720649] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:37.155 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.155 14:28:51 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:24:37.155 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.155 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.414 [2024-12-16 14:28:51.728563] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:37.414 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.414 14:28:51 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:37.414 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.414 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.414 Malloc1 00:24:37.414 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.414 14:28:51 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:24:37.414 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.414 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.414 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.414 14:28:51 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:24:37.414 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.414 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.414 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.414 14:28:51 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:24:37.414 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.414 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.414 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.414 14:28:51 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:24:37.414 14:28:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.414 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:37.414 14:28:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.414 14:28:51 -- host/multicontroller.sh@44 -- # bdevperf_pid=476349 00:24:37.414 14:28:51 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:24:37.414 14:28:51 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:24:37.414 14:28:51 -- host/multicontroller.sh@47 -- # waitforlisten 476349 /var/tmp/bdevperf.sock 00:24:37.414 14:28:51 -- common/autotest_common.sh@829 -- # '[' -z 476349 ']' 00:24:37.414 14:28:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:24:37.414 14:28:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:37.414 14:28:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:24:37.414 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:24:37.414 14:28:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:37.414 14:28:51 -- common/autotest_common.sh@10 -- # set +x 00:24:38.349 14:28:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:38.349 14:28:52 -- common/autotest_common.sh@862 -- # return 0 00:24:38.349 14:28:52 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:24:38.349 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.349 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.349 NVMe0n1 00:24:38.349 14:28:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.349 14:28:52 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:38.349 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.349 14:28:52 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:24:38.349 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.349 14:28:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.349 1 00:24:38.349 14:28:52 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:24:38.349 14:28:52 -- common/autotest_common.sh@650 -- # local es=0 00:24:38.349 14:28:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:24:38.349 14:28:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:24:38.349 14:28:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:24:38.349 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.349 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.349 request: 00:24:38.349 { 00:24:38.349 "name": "NVMe0", 00:24:38.349 "trtype": "tcp", 00:24:38.349 "traddr": "10.0.0.2", 00:24:38.349 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:24:38.349 "hostaddr": "10.0.0.2", 00:24:38.349 "hostsvcid": "60000", 00:24:38.349 "adrfam": "ipv4", 00:24:38.349 "trsvcid": "4420", 00:24:38.349 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:38.349 "method": "bdev_nvme_attach_controller", 00:24:38.349 "req_id": 1 00:24:38.349 } 00:24:38.349 Got JSON-RPC error response 00:24:38.349 response: 00:24:38.349 { 00:24:38.349 "code": -114, 00:24:38.349 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:24:38.349 } 00:24:38.349 14:28:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:24:38.349 14:28:52 -- common/autotest_common.sh@653 -- # es=1 00:24:38.349 14:28:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:24:38.349 14:28:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:24:38.349 14:28:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:24:38.349 14:28:52 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:24:38.349 14:28:52 -- common/autotest_common.sh@650 -- # local es=0 00:24:38.349 14:28:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:24:38.349 14:28:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:24:38.349 14:28:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:24:38.349 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.349 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.349 request: 00:24:38.349 { 00:24:38.349 "name": "NVMe0", 00:24:38.349 "trtype": "tcp", 00:24:38.349 "traddr": "10.0.0.2", 00:24:38.349 "hostaddr": "10.0.0.2", 00:24:38.349 "hostsvcid": "60000", 00:24:38.349 "adrfam": "ipv4", 00:24:38.349 "trsvcid": "4420", 00:24:38.349 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:24:38.349 "method": "bdev_nvme_attach_controller", 00:24:38.349 "req_id": 1 00:24:38.349 } 00:24:38.349 Got JSON-RPC error response 00:24:38.349 response: 00:24:38.349 { 00:24:38.349 "code": -114, 00:24:38.349 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:24:38.349 } 00:24:38.349 14:28:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:24:38.349 14:28:52 -- common/autotest_common.sh@653 -- # es=1 00:24:38.349 14:28:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:24:38.349 14:28:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:24:38.349 14:28:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:24:38.349 14:28:52 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:24:38.349 14:28:52 -- common/autotest_common.sh@650 -- # local es=0 00:24:38.349 14:28:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:24:38.349 14:28:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:24:38.349 14:28:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:24:38.349 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.349 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.349 request: 00:24:38.349 { 00:24:38.349 "name": "NVMe0", 00:24:38.349 "trtype": "tcp", 00:24:38.349 "traddr": "10.0.0.2", 00:24:38.349 "hostaddr": "10.0.0.2", 00:24:38.349 "hostsvcid": "60000", 00:24:38.349 "adrfam": "ipv4", 00:24:38.349 "trsvcid": "4420", 00:24:38.349 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:38.349 "multipath": "disable", 00:24:38.349 "method": "bdev_nvme_attach_controller", 00:24:38.349 "req_id": 1 00:24:38.349 } 00:24:38.349 Got JSON-RPC error response 00:24:38.349 response: 00:24:38.349 { 00:24:38.349 "code": -114, 00:24:38.349 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:24:38.349 } 00:24:38.349 14:28:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:24:38.349 14:28:52 -- common/autotest_common.sh@653 -- # es=1 00:24:38.349 14:28:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:24:38.349 14:28:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:24:38.349 14:28:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:24:38.349 14:28:52 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:24:38.349 14:28:52 -- common/autotest_common.sh@650 -- # local es=0 00:24:38.349 14:28:52 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:24:38.349 14:28:52 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:24:38.349 14:28:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:24:38.350 14:28:52 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:24:38.350 14:28:52 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:24:38.350 14:28:52 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:24:38.350 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.350 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.350 request: 00:24:38.350 { 00:24:38.350 "name": "NVMe0", 00:24:38.350 "trtype": "tcp", 00:24:38.350 "traddr": "10.0.0.2", 00:24:38.350 "hostaddr": "10.0.0.2", 00:24:38.350 "hostsvcid": "60000", 00:24:38.350 "adrfam": "ipv4", 00:24:38.350 "trsvcid": "4420", 00:24:38.350 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:24:38.350 "multipath": "failover", 00:24:38.350 "method": "bdev_nvme_attach_controller", 00:24:38.350 "req_id": 1 00:24:38.350 } 00:24:38.350 Got JSON-RPC error response 00:24:38.350 response: 00:24:38.350 { 00:24:38.350 "code": -114, 00:24:38.350 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:24:38.350 } 00:24:38.350 14:28:52 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:24:38.350 14:28:52 -- common/autotest_common.sh@653 -- # es=1 00:24:38.350 14:28:52 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:24:38.350 14:28:52 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:24:38.350 14:28:52 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:24:38.350 14:28:52 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:38.350 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.350 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.608 00:24:38.608 14:28:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.608 14:28:52 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:24:38.608 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.608 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.608 14:28:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.608 14:28:52 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:24:38.608 14:28:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.608 14:28:52 -- common/autotest_common.sh@10 -- # set +x 00:24:38.608 00:24:38.608 14:28:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.608 14:28:53 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:24:38.608 14:28:53 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:24:38.608 14:28:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:38.608 14:28:53 -- common/autotest_common.sh@10 -- # set +x 00:24:38.608 14:28:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:38.608 14:28:53 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:24:38.608 14:28:53 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:24:39.982 0 00:24:39.982 14:28:54 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:24:39.982 14:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:39.982 14:28:54 -- common/autotest_common.sh@10 -- # set +x 00:24:39.982 14:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:39.982 14:28:54 -- host/multicontroller.sh@100 -- # killprocess 476349 00:24:39.982 14:28:54 -- common/autotest_common.sh@936 -- # '[' -z 476349 ']' 00:24:39.982 14:28:54 -- common/autotest_common.sh@940 -- # kill -0 476349 00:24:39.982 14:28:54 -- common/autotest_common.sh@941 -- # uname 00:24:39.982 14:28:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:39.982 14:28:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 476349 00:24:39.982 14:28:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:39.982 14:28:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:39.982 14:28:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 476349' 00:24:39.982 killing process with pid 476349 00:24:39.982 14:28:54 -- common/autotest_common.sh@955 -- # kill 476349 00:24:39.982 14:28:54 -- common/autotest_common.sh@960 -- # wait 476349 00:24:40.240 14:28:54 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:40.240 14:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:40.240 14:28:54 -- common/autotest_common.sh@10 -- # set +x 00:24:40.240 14:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:40.240 14:28:54 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:24:40.240 14:28:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:40.240 14:28:54 -- common/autotest_common.sh@10 -- # set +x 00:24:40.240 14:28:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:40.240 14:28:54 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:24:40.241 14:28:54 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:40.241 14:28:54 -- common/autotest_common.sh@1607 -- # read -r file 00:24:40.241 14:28:54 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:24:40.241 14:28:54 -- common/autotest_common.sh@1606 -- # sort -u 00:24:40.241 14:28:54 -- common/autotest_common.sh@1608 -- # cat 00:24:40.241 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:24:40.241 [2024-12-16 14:28:51.828984] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:40.241 [2024-12-16 14:28:51.829032] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid476349 ] 00:24:40.241 EAL: No free 2048 kB hugepages reported on node 1 00:24:40.241 [2024-12-16 14:28:51.883978] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:40.241 [2024-12-16 14:28:51.952648] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:40.241 [2024-12-16 14:28:53.156850] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name 4d8d0d8f-a9f8-4cba-bbed-b76a9e5ae015 already exists 00:24:40.241 [2024-12-16 14:28:53.156880] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:4d8d0d8f-a9f8-4cba-bbed-b76a9e5ae015 alias for bdev NVMe1n1 00:24:40.241 [2024-12-16 14:28:53.156890] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:24:40.241 Running I/O for 1 seconds... 00:24:40.241 00:24:40.241 Latency(us) 00:24:40.241 [2024-12-16T13:28:54.815Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:40.241 [2024-12-16T13:28:54.815Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:24:40.241 NVMe0n1 : 1.00 26556.01 103.73 0.00 0.00 4810.22 1443.35 8363.64 00:24:40.241 [2024-12-16T13:28:54.815Z] =================================================================================================================== 00:24:40.241 [2024-12-16T13:28:54.815Z] Total : 26556.01 103.73 0.00 0.00 4810.22 1443.35 8363.64 00:24:40.241 Received shutdown signal, test time was about 1.000000 seconds 00:24:40.241 00:24:40.241 Latency(us) 00:24:40.241 [2024-12-16T13:28:54.815Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:24:40.241 [2024-12-16T13:28:54.815Z] =================================================================================================================== 00:24:40.241 [2024-12-16T13:28:54.815Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:24:40.241 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:24:40.241 14:28:54 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:24:40.241 14:28:54 -- common/autotest_common.sh@1607 -- # read -r file 00:24:40.241 14:28:54 -- host/multicontroller.sh@108 -- # nvmftestfini 00:24:40.241 14:28:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:40.241 14:28:54 -- nvmf/common.sh@116 -- # sync 00:24:40.241 14:28:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:40.241 14:28:54 -- nvmf/common.sh@119 -- # set +e 00:24:40.241 14:28:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:40.241 14:28:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:40.241 rmmod nvme_tcp 00:24:40.241 rmmod nvme_fabrics 00:24:40.241 rmmod nvme_keyring 00:24:40.241 14:28:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:40.241 14:28:54 -- nvmf/common.sh@123 -- # set -e 00:24:40.241 14:28:54 -- nvmf/common.sh@124 -- # return 0 00:24:40.241 14:28:54 -- nvmf/common.sh@477 -- # '[' -n 476104 ']' 00:24:40.241 14:28:54 -- nvmf/common.sh@478 -- # killprocess 476104 00:24:40.241 14:28:54 -- common/autotest_common.sh@936 -- # '[' -z 476104 ']' 00:24:40.241 14:28:54 -- common/autotest_common.sh@940 -- # kill -0 476104 00:24:40.241 14:28:54 -- common/autotest_common.sh@941 -- # uname 00:24:40.241 14:28:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:40.241 14:28:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 476104 00:24:40.241 14:28:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:24:40.241 14:28:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:24:40.241 14:28:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 476104' 00:24:40.241 killing process with pid 476104 00:24:40.241 14:28:54 -- common/autotest_common.sh@955 -- # kill 476104 00:24:40.241 14:28:54 -- common/autotest_common.sh@960 -- # wait 476104 00:24:40.500 14:28:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:40.500 14:28:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:40.500 14:28:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:40.500 14:28:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:40.500 14:28:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:40.500 14:28:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:40.500 14:28:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:40.500 14:28:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:43.029 14:28:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:43.029 00:24:43.029 real 0m12.282s 00:24:43.029 user 0m16.794s 00:24:43.029 sys 0m5.054s 00:24:43.029 14:28:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:43.029 14:28:57 -- common/autotest_common.sh@10 -- # set +x 00:24:43.029 ************************************ 00:24:43.029 END TEST nvmf_multicontroller 00:24:43.029 ************************************ 00:24:43.029 14:28:57 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:24:43.029 14:28:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:43.029 14:28:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:43.029 14:28:57 -- common/autotest_common.sh@10 -- # set +x 00:24:43.029 ************************************ 00:24:43.029 START TEST nvmf_aer 00:24:43.029 ************************************ 00:24:43.029 14:28:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:24:43.029 * Looking for test storage... 00:24:43.029 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:43.029 14:28:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:43.029 14:28:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:43.029 14:28:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:43.029 14:28:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:43.029 14:28:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:43.029 14:28:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:43.029 14:28:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:43.029 14:28:57 -- scripts/common.sh@335 -- # IFS=.-: 00:24:43.029 14:28:57 -- scripts/common.sh@335 -- # read -ra ver1 00:24:43.029 14:28:57 -- scripts/common.sh@336 -- # IFS=.-: 00:24:43.029 14:28:57 -- scripts/common.sh@336 -- # read -ra ver2 00:24:43.029 14:28:57 -- scripts/common.sh@337 -- # local 'op=<' 00:24:43.029 14:28:57 -- scripts/common.sh@339 -- # ver1_l=2 00:24:43.029 14:28:57 -- scripts/common.sh@340 -- # ver2_l=1 00:24:43.029 14:28:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:43.029 14:28:57 -- scripts/common.sh@343 -- # case "$op" in 00:24:43.029 14:28:57 -- scripts/common.sh@344 -- # : 1 00:24:43.029 14:28:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:43.029 14:28:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:43.029 14:28:57 -- scripts/common.sh@364 -- # decimal 1 00:24:43.029 14:28:57 -- scripts/common.sh@352 -- # local d=1 00:24:43.029 14:28:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:43.029 14:28:57 -- scripts/common.sh@354 -- # echo 1 00:24:43.029 14:28:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:43.029 14:28:57 -- scripts/common.sh@365 -- # decimal 2 00:24:43.029 14:28:57 -- scripts/common.sh@352 -- # local d=2 00:24:43.029 14:28:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:43.029 14:28:57 -- scripts/common.sh@354 -- # echo 2 00:24:43.029 14:28:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:43.029 14:28:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:43.029 14:28:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:43.029 14:28:57 -- scripts/common.sh@367 -- # return 0 00:24:43.029 14:28:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:43.029 14:28:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:43.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:43.029 --rc genhtml_branch_coverage=1 00:24:43.029 --rc genhtml_function_coverage=1 00:24:43.029 --rc genhtml_legend=1 00:24:43.029 --rc geninfo_all_blocks=1 00:24:43.029 --rc geninfo_unexecuted_blocks=1 00:24:43.029 00:24:43.029 ' 00:24:43.029 14:28:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:43.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:43.029 --rc genhtml_branch_coverage=1 00:24:43.029 --rc genhtml_function_coverage=1 00:24:43.029 --rc genhtml_legend=1 00:24:43.029 --rc geninfo_all_blocks=1 00:24:43.029 --rc geninfo_unexecuted_blocks=1 00:24:43.029 00:24:43.029 ' 00:24:43.029 14:28:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:43.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:43.029 --rc genhtml_branch_coverage=1 00:24:43.029 --rc genhtml_function_coverage=1 00:24:43.029 --rc genhtml_legend=1 00:24:43.029 --rc geninfo_all_blocks=1 00:24:43.029 --rc geninfo_unexecuted_blocks=1 00:24:43.029 00:24:43.029 ' 00:24:43.029 14:28:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:43.029 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:43.029 --rc genhtml_branch_coverage=1 00:24:43.029 --rc genhtml_function_coverage=1 00:24:43.029 --rc genhtml_legend=1 00:24:43.029 --rc geninfo_all_blocks=1 00:24:43.029 --rc geninfo_unexecuted_blocks=1 00:24:43.029 00:24:43.029 ' 00:24:43.029 14:28:57 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:43.029 14:28:57 -- nvmf/common.sh@7 -- # uname -s 00:24:43.029 14:28:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:43.029 14:28:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:43.029 14:28:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:43.029 14:28:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:43.029 14:28:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:43.029 14:28:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:43.029 14:28:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:43.029 14:28:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:43.029 14:28:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:43.029 14:28:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:43.029 14:28:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:24:43.029 14:28:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:24:43.029 14:28:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:43.029 14:28:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:43.029 14:28:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:43.030 14:28:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:43.030 14:28:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:43.030 14:28:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:43.030 14:28:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:43.030 14:28:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:43.030 14:28:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:43.030 14:28:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:43.030 14:28:57 -- paths/export.sh@5 -- # export PATH 00:24:43.030 14:28:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:43.030 14:28:57 -- nvmf/common.sh@46 -- # : 0 00:24:43.030 14:28:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:43.030 14:28:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:43.030 14:28:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:43.030 14:28:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:43.030 14:28:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:43.030 14:28:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:43.030 14:28:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:43.030 14:28:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:43.030 14:28:57 -- host/aer.sh@11 -- # nvmftestinit 00:24:43.030 14:28:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:43.030 14:28:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:43.030 14:28:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:43.030 14:28:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:43.030 14:28:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:43.030 14:28:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:43.030 14:28:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:43.030 14:28:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:43.030 14:28:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:43.030 14:28:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:43.030 14:28:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:43.030 14:28:57 -- common/autotest_common.sh@10 -- # set +x 00:24:48.313 14:29:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:48.313 14:29:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:48.313 14:29:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:48.313 14:29:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:48.313 14:29:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:48.313 14:29:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:48.313 14:29:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:48.313 14:29:02 -- nvmf/common.sh@294 -- # net_devs=() 00:24:48.313 14:29:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:48.313 14:29:02 -- nvmf/common.sh@295 -- # e810=() 00:24:48.313 14:29:02 -- nvmf/common.sh@295 -- # local -ga e810 00:24:48.313 14:29:02 -- nvmf/common.sh@296 -- # x722=() 00:24:48.313 14:29:02 -- nvmf/common.sh@296 -- # local -ga x722 00:24:48.313 14:29:02 -- nvmf/common.sh@297 -- # mlx=() 00:24:48.313 14:29:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:48.313 14:29:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:48.313 14:29:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:48.313 14:29:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:48.313 14:29:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:48.313 14:29:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:48.313 14:29:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:48.313 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:48.313 14:29:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:48.313 14:29:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:48.313 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:48.313 14:29:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:48.313 14:29:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:48.313 14:29:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:48.313 14:29:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:48.313 14:29:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:48.313 14:29:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:48.313 Found net devices under 0000:af:00.0: cvl_0_0 00:24:48.313 14:29:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:48.313 14:29:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:48.313 14:29:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:48.313 14:29:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:48.313 14:29:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:48.313 14:29:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:48.313 Found net devices under 0000:af:00.1: cvl_0_1 00:24:48.313 14:29:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:48.313 14:29:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:48.313 14:29:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:48.313 14:29:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:48.313 14:29:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:48.313 14:29:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:48.313 14:29:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:48.313 14:29:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:48.313 14:29:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:48.313 14:29:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:48.313 14:29:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:48.313 14:29:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:48.313 14:29:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:48.313 14:29:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:48.313 14:29:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:48.314 14:29:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:48.314 14:29:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:48.314 14:29:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:48.314 14:29:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:48.314 14:29:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:48.314 14:29:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:48.314 14:29:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:48.314 14:29:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:48.314 14:29:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:48.314 14:29:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:48.314 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:48.314 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.388 ms 00:24:48.314 00:24:48.314 --- 10.0.0.2 ping statistics --- 00:24:48.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.314 rtt min/avg/max/mdev = 0.388/0.388/0.388/0.000 ms 00:24:48.314 14:29:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:48.314 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:48.314 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.078 ms 00:24:48.314 00:24:48.314 --- 10.0.0.1 ping statistics --- 00:24:48.314 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:48.314 rtt min/avg/max/mdev = 0.078/0.078/0.078/0.000 ms 00:24:48.314 14:29:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:48.314 14:29:02 -- nvmf/common.sh@410 -- # return 0 00:24:48.314 14:29:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:48.314 14:29:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:48.314 14:29:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:48.314 14:29:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:48.314 14:29:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:48.314 14:29:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:48.314 14:29:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:48.314 14:29:02 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:24:48.314 14:29:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:48.314 14:29:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:48.314 14:29:02 -- common/autotest_common.sh@10 -- # set +x 00:24:48.314 14:29:02 -- nvmf/common.sh@469 -- # nvmfpid=480230 00:24:48.314 14:29:02 -- nvmf/common.sh@470 -- # waitforlisten 480230 00:24:48.314 14:29:02 -- common/autotest_common.sh@829 -- # '[' -z 480230 ']' 00:24:48.314 14:29:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:48.314 14:29:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:48.314 14:29:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:48.314 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:48.314 14:29:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:24:48.314 14:29:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:48.314 14:29:02 -- common/autotest_common.sh@10 -- # set +x 00:24:48.314 [2024-12-16 14:29:02.642479] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:48.314 [2024-12-16 14:29:02.642521] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:48.314 EAL: No free 2048 kB hugepages reported on node 1 00:24:48.314 [2024-12-16 14:29:02.701433] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:48.314 [2024-12-16 14:29:02.778713] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:48.314 [2024-12-16 14:29:02.778834] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:48.314 [2024-12-16 14:29:02.778842] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:48.314 [2024-12-16 14:29:02.778848] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:48.314 [2024-12-16 14:29:02.778896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:48.314 [2024-12-16 14:29:02.779015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:48.314 [2024-12-16 14:29:02.779104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:48.314 [2024-12-16 14:29:02.779105] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:49.251 14:29:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:49.251 14:29:03 -- common/autotest_common.sh@862 -- # return 0 00:24:49.251 14:29:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:49.251 14:29:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:49.251 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.251 14:29:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:49.251 14:29:03 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:24:49.251 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.251 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.251 [2024-12-16 14:29:03.497181] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:49.251 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.251 14:29:03 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:24:49.251 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.251 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.251 Malloc0 00:24:49.251 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.251 14:29:03 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:24:49.251 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.251 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.251 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.251 14:29:03 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:24:49.251 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.251 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.251 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.251 14:29:03 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:49.251 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.251 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.251 [2024-12-16 14:29:03.540507] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:49.251 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.251 14:29:03 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:24:49.251 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.251 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.251 [2024-12-16 14:29:03.548291] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:24:49.251 [ 00:24:49.251 { 00:24:49.251 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:24:49.251 "subtype": "Discovery", 00:24:49.251 "listen_addresses": [], 00:24:49.251 "allow_any_host": true, 00:24:49.251 "hosts": [] 00:24:49.251 }, 00:24:49.251 { 00:24:49.251 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:24:49.251 "subtype": "NVMe", 00:24:49.251 "listen_addresses": [ 00:24:49.251 { 00:24:49.251 "transport": "TCP", 00:24:49.251 "trtype": "TCP", 00:24:49.251 "adrfam": "IPv4", 00:24:49.251 "traddr": "10.0.0.2", 00:24:49.251 "trsvcid": "4420" 00:24:49.251 } 00:24:49.251 ], 00:24:49.251 "allow_any_host": true, 00:24:49.251 "hosts": [], 00:24:49.251 "serial_number": "SPDK00000000000001", 00:24:49.251 "model_number": "SPDK bdev Controller", 00:24:49.251 "max_namespaces": 2, 00:24:49.251 "min_cntlid": 1, 00:24:49.251 "max_cntlid": 65519, 00:24:49.251 "namespaces": [ 00:24:49.251 { 00:24:49.251 "nsid": 1, 00:24:49.251 "bdev_name": "Malloc0", 00:24:49.251 "name": "Malloc0", 00:24:49.251 "nguid": "2FFD75C061D7440B888DF29265B15B44", 00:24:49.251 "uuid": "2ffd75c0-61d7-440b-888d-f29265b15b44" 00:24:49.251 } 00:24:49.251 ] 00:24:49.251 } 00:24:49.251 ] 00:24:49.251 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.251 14:29:03 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:24:49.251 14:29:03 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:24:49.251 14:29:03 -- host/aer.sh@33 -- # aerpid=480332 00:24:49.251 14:29:03 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:24:49.251 14:29:03 -- common/autotest_common.sh@1254 -- # local i=0 00:24:49.251 14:29:03 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:49.252 14:29:03 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:24:49.252 14:29:03 -- common/autotest_common.sh@1257 -- # i=1 00:24:49.252 14:29:03 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:24:49.252 14:29:03 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:24:49.252 EAL: No free 2048 kB hugepages reported on node 1 00:24:49.252 14:29:03 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:49.252 14:29:03 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:24:49.252 14:29:03 -- common/autotest_common.sh@1257 -- # i=2 00:24:49.252 14:29:03 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:24:49.252 14:29:03 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:49.252 14:29:03 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:24:49.252 14:29:03 -- common/autotest_common.sh@1265 -- # return 0 00:24:49.252 14:29:03 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:24:49.252 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.252 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.252 Malloc1 00:24:49.252 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.252 14:29:03 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:24:49.252 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.252 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.252 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.252 14:29:03 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:24:49.252 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.252 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.252 Asynchronous Event Request test 00:24:49.252 Attaching to 10.0.0.2 00:24:49.252 Attached to 10.0.0.2 00:24:49.252 Registering asynchronous event callbacks... 00:24:49.252 Starting namespace attribute notice tests for all controllers... 00:24:49.252 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:24:49.252 aer_cb - Changed Namespace 00:24:49.252 Cleaning up... 00:24:49.641 [ 00:24:49.641 { 00:24:49.641 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:24:49.641 "subtype": "Discovery", 00:24:49.641 "listen_addresses": [], 00:24:49.641 "allow_any_host": true, 00:24:49.641 "hosts": [] 00:24:49.641 }, 00:24:49.641 { 00:24:49.641 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:24:49.641 "subtype": "NVMe", 00:24:49.641 "listen_addresses": [ 00:24:49.641 { 00:24:49.641 "transport": "TCP", 00:24:49.641 "trtype": "TCP", 00:24:49.641 "adrfam": "IPv4", 00:24:49.641 "traddr": "10.0.0.2", 00:24:49.641 "trsvcid": "4420" 00:24:49.641 } 00:24:49.641 ], 00:24:49.641 "allow_any_host": true, 00:24:49.641 "hosts": [], 00:24:49.641 "serial_number": "SPDK00000000000001", 00:24:49.641 "model_number": "SPDK bdev Controller", 00:24:49.641 "max_namespaces": 2, 00:24:49.641 "min_cntlid": 1, 00:24:49.641 "max_cntlid": 65519, 00:24:49.641 "namespaces": [ 00:24:49.641 { 00:24:49.641 "nsid": 1, 00:24:49.641 "bdev_name": "Malloc0", 00:24:49.641 "name": "Malloc0", 00:24:49.641 "nguid": "2FFD75C061D7440B888DF29265B15B44", 00:24:49.641 "uuid": "2ffd75c0-61d7-440b-888d-f29265b15b44" 00:24:49.641 }, 00:24:49.641 { 00:24:49.641 "nsid": 2, 00:24:49.641 "bdev_name": "Malloc1", 00:24:49.641 "name": "Malloc1", 00:24:49.641 "nguid": "0D5D207D2A634142BC11DC69CCD4DBD3", 00:24:49.641 "uuid": "0d5d207d-2a63-4142-bc11-dc69ccd4dbd3" 00:24:49.641 } 00:24:49.641 ] 00:24:49.641 } 00:24:49.641 ] 00:24:49.641 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.641 14:29:03 -- host/aer.sh@43 -- # wait 480332 00:24:49.641 14:29:03 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:24:49.641 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.641 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.641 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.641 14:29:03 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:24:49.641 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.641 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.641 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.641 14:29:03 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:49.641 14:29:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:49.641 14:29:03 -- common/autotest_common.sh@10 -- # set +x 00:24:49.641 14:29:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:49.641 14:29:03 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:24:49.641 14:29:03 -- host/aer.sh@51 -- # nvmftestfini 00:24:49.641 14:29:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:49.641 14:29:03 -- nvmf/common.sh@116 -- # sync 00:24:49.641 14:29:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:49.641 14:29:03 -- nvmf/common.sh@119 -- # set +e 00:24:49.641 14:29:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:49.641 14:29:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:49.641 rmmod nvme_tcp 00:24:49.641 rmmod nvme_fabrics 00:24:49.641 rmmod nvme_keyring 00:24:49.641 14:29:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:49.641 14:29:03 -- nvmf/common.sh@123 -- # set -e 00:24:49.641 14:29:03 -- nvmf/common.sh@124 -- # return 0 00:24:49.641 14:29:03 -- nvmf/common.sh@477 -- # '[' -n 480230 ']' 00:24:49.641 14:29:03 -- nvmf/common.sh@478 -- # killprocess 480230 00:24:49.641 14:29:03 -- common/autotest_common.sh@936 -- # '[' -z 480230 ']' 00:24:49.641 14:29:03 -- common/autotest_common.sh@940 -- # kill -0 480230 00:24:49.641 14:29:03 -- common/autotest_common.sh@941 -- # uname 00:24:49.641 14:29:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:49.641 14:29:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 480230 00:24:49.641 14:29:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:49.641 14:29:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:49.641 14:29:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 480230' 00:24:49.641 killing process with pid 480230 00:24:49.641 14:29:04 -- common/autotest_common.sh@955 -- # kill 480230 00:24:49.641 [2024-12-16 14:29:04.004380] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:24:49.641 14:29:04 -- common/autotest_common.sh@960 -- # wait 480230 00:24:49.908 14:29:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:49.908 14:29:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:49.908 14:29:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:49.908 14:29:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:49.908 14:29:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:49.908 14:29:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:49.908 14:29:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:49.908 14:29:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:51.811 14:29:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:51.811 00:24:51.811 real 0m9.226s 00:24:51.811 user 0m7.159s 00:24:51.811 sys 0m4.445s 00:24:51.811 14:29:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:51.811 14:29:06 -- common/autotest_common.sh@10 -- # set +x 00:24:51.811 ************************************ 00:24:51.811 END TEST nvmf_aer 00:24:51.811 ************************************ 00:24:51.811 14:29:06 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:24:51.811 14:29:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:51.811 14:29:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:51.811 14:29:06 -- common/autotest_common.sh@10 -- # set +x 00:24:51.811 ************************************ 00:24:51.811 START TEST nvmf_async_init 00:24:51.811 ************************************ 00:24:51.811 14:29:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:24:52.069 * Looking for test storage... 00:24:52.069 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:24:52.069 14:29:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:52.069 14:29:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:52.069 14:29:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:52.069 14:29:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:52.069 14:29:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:52.069 14:29:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:52.069 14:29:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:52.069 14:29:06 -- scripts/common.sh@335 -- # IFS=.-: 00:24:52.069 14:29:06 -- scripts/common.sh@335 -- # read -ra ver1 00:24:52.069 14:29:06 -- scripts/common.sh@336 -- # IFS=.-: 00:24:52.069 14:29:06 -- scripts/common.sh@336 -- # read -ra ver2 00:24:52.069 14:29:06 -- scripts/common.sh@337 -- # local 'op=<' 00:24:52.069 14:29:06 -- scripts/common.sh@339 -- # ver1_l=2 00:24:52.069 14:29:06 -- scripts/common.sh@340 -- # ver2_l=1 00:24:52.069 14:29:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:52.069 14:29:06 -- scripts/common.sh@343 -- # case "$op" in 00:24:52.069 14:29:06 -- scripts/common.sh@344 -- # : 1 00:24:52.069 14:29:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:52.069 14:29:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:52.069 14:29:06 -- scripts/common.sh@364 -- # decimal 1 00:24:52.069 14:29:06 -- scripts/common.sh@352 -- # local d=1 00:24:52.069 14:29:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:52.069 14:29:06 -- scripts/common.sh@354 -- # echo 1 00:24:52.069 14:29:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:52.069 14:29:06 -- scripts/common.sh@365 -- # decimal 2 00:24:52.069 14:29:06 -- scripts/common.sh@352 -- # local d=2 00:24:52.069 14:29:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:52.069 14:29:06 -- scripts/common.sh@354 -- # echo 2 00:24:52.069 14:29:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:52.069 14:29:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:52.069 14:29:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:52.069 14:29:06 -- scripts/common.sh@367 -- # return 0 00:24:52.069 14:29:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:52.069 14:29:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:52.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:52.069 --rc genhtml_branch_coverage=1 00:24:52.069 --rc genhtml_function_coverage=1 00:24:52.069 --rc genhtml_legend=1 00:24:52.069 --rc geninfo_all_blocks=1 00:24:52.069 --rc geninfo_unexecuted_blocks=1 00:24:52.069 00:24:52.069 ' 00:24:52.069 14:29:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:52.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:52.069 --rc genhtml_branch_coverage=1 00:24:52.069 --rc genhtml_function_coverage=1 00:24:52.069 --rc genhtml_legend=1 00:24:52.069 --rc geninfo_all_blocks=1 00:24:52.069 --rc geninfo_unexecuted_blocks=1 00:24:52.069 00:24:52.069 ' 00:24:52.069 14:29:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:52.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:52.069 --rc genhtml_branch_coverage=1 00:24:52.069 --rc genhtml_function_coverage=1 00:24:52.069 --rc genhtml_legend=1 00:24:52.069 --rc geninfo_all_blocks=1 00:24:52.069 --rc geninfo_unexecuted_blocks=1 00:24:52.069 00:24:52.069 ' 00:24:52.069 14:29:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:52.069 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:52.069 --rc genhtml_branch_coverage=1 00:24:52.069 --rc genhtml_function_coverage=1 00:24:52.069 --rc genhtml_legend=1 00:24:52.069 --rc geninfo_all_blocks=1 00:24:52.069 --rc geninfo_unexecuted_blocks=1 00:24:52.069 00:24:52.069 ' 00:24:52.069 14:29:06 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:52.069 14:29:06 -- nvmf/common.sh@7 -- # uname -s 00:24:52.069 14:29:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:52.069 14:29:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:52.069 14:29:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:52.070 14:29:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:52.070 14:29:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:52.070 14:29:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:52.070 14:29:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:52.070 14:29:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:52.070 14:29:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:52.070 14:29:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:52.070 14:29:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:24:52.070 14:29:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:24:52.070 14:29:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:52.070 14:29:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:52.070 14:29:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:52.070 14:29:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:52.070 14:29:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:52.070 14:29:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:52.070 14:29:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:52.070 14:29:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:52.070 14:29:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:52.070 14:29:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:52.070 14:29:06 -- paths/export.sh@5 -- # export PATH 00:24:52.070 14:29:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:52.070 14:29:06 -- nvmf/common.sh@46 -- # : 0 00:24:52.070 14:29:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:52.070 14:29:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:52.070 14:29:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:52.070 14:29:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:52.070 14:29:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:52.070 14:29:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:52.070 14:29:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:52.070 14:29:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:52.070 14:29:06 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:24:52.070 14:29:06 -- host/async_init.sh@14 -- # null_block_size=512 00:24:52.070 14:29:06 -- host/async_init.sh@15 -- # null_bdev=null0 00:24:52.070 14:29:06 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:24:52.070 14:29:06 -- host/async_init.sh@20 -- # uuidgen 00:24:52.070 14:29:06 -- host/async_init.sh@20 -- # tr -d - 00:24:52.070 14:29:06 -- host/async_init.sh@20 -- # nguid=1336e2a11191429aab4a3e20467cbc5c 00:24:52.070 14:29:06 -- host/async_init.sh@22 -- # nvmftestinit 00:24:52.070 14:29:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:52.070 14:29:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:52.070 14:29:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:52.070 14:29:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:52.070 14:29:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:52.070 14:29:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:52.070 14:29:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:52.070 14:29:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:52.070 14:29:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:52.070 14:29:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:52.070 14:29:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:52.070 14:29:06 -- common/autotest_common.sh@10 -- # set +x 00:24:57.335 14:29:11 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:57.335 14:29:11 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:57.335 14:29:11 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:57.335 14:29:11 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:57.335 14:29:11 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:57.335 14:29:11 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:57.335 14:29:11 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:57.335 14:29:11 -- nvmf/common.sh@294 -- # net_devs=() 00:24:57.335 14:29:11 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:57.335 14:29:11 -- nvmf/common.sh@295 -- # e810=() 00:24:57.335 14:29:11 -- nvmf/common.sh@295 -- # local -ga e810 00:24:57.335 14:29:11 -- nvmf/common.sh@296 -- # x722=() 00:24:57.335 14:29:11 -- nvmf/common.sh@296 -- # local -ga x722 00:24:57.335 14:29:11 -- nvmf/common.sh@297 -- # mlx=() 00:24:57.335 14:29:11 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:57.335 14:29:11 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:57.335 14:29:11 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:57.335 14:29:11 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:57.335 14:29:11 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:57.335 14:29:11 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:57.335 14:29:11 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:57.336 14:29:11 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:57.336 14:29:11 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:57.336 14:29:11 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:57.336 14:29:11 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:57.336 14:29:11 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:57.336 14:29:11 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:57.336 14:29:11 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:57.336 14:29:11 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:57.336 14:29:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:57.336 14:29:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:24:57.336 Found 0000:af:00.0 (0x8086 - 0x159b) 00:24:57.336 14:29:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:57.336 14:29:11 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:24:57.336 Found 0000:af:00.1 (0x8086 - 0x159b) 00:24:57.336 14:29:11 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:57.336 14:29:11 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:57.336 14:29:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:57.336 14:29:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:57.336 14:29:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:57.336 14:29:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:24:57.336 Found net devices under 0000:af:00.0: cvl_0_0 00:24:57.336 14:29:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:57.336 14:29:11 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:57.336 14:29:11 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:57.336 14:29:11 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:57.336 14:29:11 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:57.336 14:29:11 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:24:57.336 Found net devices under 0000:af:00.1: cvl_0_1 00:24:57.336 14:29:11 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:57.336 14:29:11 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:57.336 14:29:11 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:57.336 14:29:11 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:57.336 14:29:11 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:57.336 14:29:11 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:57.336 14:29:11 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:57.336 14:29:11 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:57.336 14:29:11 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:57.336 14:29:11 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:57.336 14:29:11 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:57.336 14:29:11 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:57.336 14:29:11 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:57.336 14:29:11 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:57.336 14:29:11 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:57.336 14:29:11 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:57.336 14:29:11 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:57.336 14:29:11 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:57.336 14:29:11 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:57.336 14:29:11 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:57.336 14:29:11 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:57.336 14:29:11 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:57.336 14:29:11 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:57.336 14:29:11 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:57.336 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:57.336 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.266 ms 00:24:57.336 00:24:57.336 --- 10.0.0.2 ping statistics --- 00:24:57.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:57.336 rtt min/avg/max/mdev = 0.266/0.266/0.266/0.000 ms 00:24:57.336 14:29:11 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:57.336 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:57.336 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.160 ms 00:24:57.336 00:24:57.336 --- 10.0.0.1 ping statistics --- 00:24:57.336 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:57.336 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:24:57.336 14:29:11 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:57.336 14:29:11 -- nvmf/common.sh@410 -- # return 0 00:24:57.336 14:29:11 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:57.336 14:29:11 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:57.336 14:29:11 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:57.336 14:29:11 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:57.336 14:29:11 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:57.336 14:29:11 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:57.336 14:29:11 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:24:57.336 14:29:11 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:57.336 14:29:11 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:57.336 14:29:11 -- common/autotest_common.sh@10 -- # set +x 00:24:57.336 14:29:11 -- nvmf/common.sh@469 -- # nvmfpid=483824 00:24:57.336 14:29:11 -- nvmf/common.sh@470 -- # waitforlisten 483824 00:24:57.336 14:29:11 -- common/autotest_common.sh@829 -- # '[' -z 483824 ']' 00:24:57.337 14:29:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:57.337 14:29:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:57.337 14:29:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:57.337 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:57.337 14:29:11 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:24:57.337 14:29:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:57.337 14:29:11 -- common/autotest_common.sh@10 -- # set +x 00:24:57.337 [2024-12-16 14:29:11.849990] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:57.337 [2024-12-16 14:29:11.850032] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:57.337 EAL: No free 2048 kB hugepages reported on node 1 00:24:57.337 [2024-12-16 14:29:11.907599] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:24:57.595 [2024-12-16 14:29:11.983672] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:57.595 [2024-12-16 14:29:11.983789] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:57.595 [2024-12-16 14:29:11.983797] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:57.595 [2024-12-16 14:29:11.983803] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:57.595 [2024-12-16 14:29:11.983823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:58.161 14:29:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:58.161 14:29:12 -- common/autotest_common.sh@862 -- # return 0 00:24:58.161 14:29:12 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:58.161 14:29:12 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:58.161 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.161 14:29:12 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:58.161 14:29:12 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:24:58.161 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.161 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.161 [2024-12-16 14:29:12.690151] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:58.161 14:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.161 14:29:12 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:24:58.161 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.161 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.161 null0 00:24:58.161 14:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.161 14:29:12 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:24:58.161 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.161 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.161 14:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.161 14:29:12 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:24:58.161 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.161 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.161 14:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.161 14:29:12 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g 1336e2a11191429aab4a3e20467cbc5c 00:24:58.161 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.161 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.161 14:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.161 14:29:12 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:24:58.161 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.161 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.161 [2024-12-16 14:29:12.730358] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:58.161 14:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.420 14:29:12 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:24:58.420 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.420 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.420 nvme0n1 00:24:58.420 14:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.420 14:29:12 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:58.420 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.420 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.420 [ 00:24:58.420 { 00:24:58.420 "name": "nvme0n1", 00:24:58.420 "aliases": [ 00:24:58.420 "1336e2a1-1191-429a-ab4a-3e20467cbc5c" 00:24:58.420 ], 00:24:58.420 "product_name": "NVMe disk", 00:24:58.420 "block_size": 512, 00:24:58.420 "num_blocks": 2097152, 00:24:58.420 "uuid": "1336e2a1-1191-429a-ab4a-3e20467cbc5c", 00:24:58.420 "assigned_rate_limits": { 00:24:58.420 "rw_ios_per_sec": 0, 00:24:58.420 "rw_mbytes_per_sec": 0, 00:24:58.420 "r_mbytes_per_sec": 0, 00:24:58.420 "w_mbytes_per_sec": 0 00:24:58.420 }, 00:24:58.420 "claimed": false, 00:24:58.420 "zoned": false, 00:24:58.420 "supported_io_types": { 00:24:58.420 "read": true, 00:24:58.420 "write": true, 00:24:58.420 "unmap": false, 00:24:58.420 "write_zeroes": true, 00:24:58.420 "flush": true, 00:24:58.420 "reset": true, 00:24:58.420 "compare": true, 00:24:58.420 "compare_and_write": true, 00:24:58.420 "abort": true, 00:24:58.420 "nvme_admin": true, 00:24:58.420 "nvme_io": true 00:24:58.420 }, 00:24:58.420 "driver_specific": { 00:24:58.420 "nvme": [ 00:24:58.420 { 00:24:58.420 "trid": { 00:24:58.420 "trtype": "TCP", 00:24:58.420 "adrfam": "IPv4", 00:24:58.420 "traddr": "10.0.0.2", 00:24:58.420 "trsvcid": "4420", 00:24:58.420 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:58.420 }, 00:24:58.420 "ctrlr_data": { 00:24:58.420 "cntlid": 1, 00:24:58.420 "vendor_id": "0x8086", 00:24:58.420 "model_number": "SPDK bdev Controller", 00:24:58.420 "serial_number": "00000000000000000000", 00:24:58.420 "firmware_revision": "24.01.1", 00:24:58.420 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:58.420 "oacs": { 00:24:58.420 "security": 0, 00:24:58.420 "format": 0, 00:24:58.420 "firmware": 0, 00:24:58.420 "ns_manage": 0 00:24:58.420 }, 00:24:58.420 "multi_ctrlr": true, 00:24:58.420 "ana_reporting": false 00:24:58.420 }, 00:24:58.420 "vs": { 00:24:58.420 "nvme_version": "1.3" 00:24:58.420 }, 00:24:58.420 "ns_data": { 00:24:58.420 "id": 1, 00:24:58.420 "can_share": true 00:24:58.420 } 00:24:58.420 } 00:24:58.420 ], 00:24:58.420 "mp_policy": "active_passive" 00:24:58.420 } 00:24:58.420 } 00:24:58.420 ] 00:24:58.420 14:29:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.420 14:29:12 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:24:58.420 14:29:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.420 14:29:12 -- common/autotest_common.sh@10 -- # set +x 00:24:58.420 [2024-12-16 14:29:12.978876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:24:58.420 [2024-12-16 14:29:12.978948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1f227a0 (9): Bad file descriptor 00:24:58.679 [2024-12-16 14:29:13.110933] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:24:58.679 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.679 14:29:13 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:58.679 14:29:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.679 14:29:13 -- common/autotest_common.sh@10 -- # set +x 00:24:58.679 [ 00:24:58.679 { 00:24:58.679 "name": "nvme0n1", 00:24:58.679 "aliases": [ 00:24:58.679 "1336e2a1-1191-429a-ab4a-3e20467cbc5c" 00:24:58.679 ], 00:24:58.679 "product_name": "NVMe disk", 00:24:58.679 "block_size": 512, 00:24:58.679 "num_blocks": 2097152, 00:24:58.679 "uuid": "1336e2a1-1191-429a-ab4a-3e20467cbc5c", 00:24:58.679 "assigned_rate_limits": { 00:24:58.679 "rw_ios_per_sec": 0, 00:24:58.679 "rw_mbytes_per_sec": 0, 00:24:58.679 "r_mbytes_per_sec": 0, 00:24:58.679 "w_mbytes_per_sec": 0 00:24:58.679 }, 00:24:58.679 "claimed": false, 00:24:58.679 "zoned": false, 00:24:58.679 "supported_io_types": { 00:24:58.679 "read": true, 00:24:58.679 "write": true, 00:24:58.679 "unmap": false, 00:24:58.679 "write_zeroes": true, 00:24:58.679 "flush": true, 00:24:58.679 "reset": true, 00:24:58.679 "compare": true, 00:24:58.679 "compare_and_write": true, 00:24:58.679 "abort": true, 00:24:58.679 "nvme_admin": true, 00:24:58.679 "nvme_io": true 00:24:58.679 }, 00:24:58.679 "driver_specific": { 00:24:58.679 "nvme": [ 00:24:58.679 { 00:24:58.679 "trid": { 00:24:58.679 "trtype": "TCP", 00:24:58.679 "adrfam": "IPv4", 00:24:58.679 "traddr": "10.0.0.2", 00:24:58.679 "trsvcid": "4420", 00:24:58.679 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:58.679 }, 00:24:58.679 "ctrlr_data": { 00:24:58.679 "cntlid": 2, 00:24:58.679 "vendor_id": "0x8086", 00:24:58.679 "model_number": "SPDK bdev Controller", 00:24:58.679 "serial_number": "00000000000000000000", 00:24:58.679 "firmware_revision": "24.01.1", 00:24:58.679 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:58.679 "oacs": { 00:24:58.679 "security": 0, 00:24:58.679 "format": 0, 00:24:58.679 "firmware": 0, 00:24:58.679 "ns_manage": 0 00:24:58.679 }, 00:24:58.679 "multi_ctrlr": true, 00:24:58.679 "ana_reporting": false 00:24:58.679 }, 00:24:58.679 "vs": { 00:24:58.679 "nvme_version": "1.3" 00:24:58.679 }, 00:24:58.679 "ns_data": { 00:24:58.679 "id": 1, 00:24:58.679 "can_share": true 00:24:58.679 } 00:24:58.679 } 00:24:58.679 ], 00:24:58.679 "mp_policy": "active_passive" 00:24:58.679 } 00:24:58.679 } 00:24:58.679 ] 00:24:58.679 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.679 14:29:13 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:58.679 14:29:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.679 14:29:13 -- common/autotest_common.sh@10 -- # set +x 00:24:58.679 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.680 14:29:13 -- host/async_init.sh@53 -- # mktemp 00:24:58.680 14:29:13 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.PhEMi5cCHR 00:24:58.680 14:29:13 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:24:58.680 14:29:13 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.PhEMi5cCHR 00:24:58.680 14:29:13 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:24:58.680 14:29:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.680 14:29:13 -- common/autotest_common.sh@10 -- # set +x 00:24:58.680 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.680 14:29:13 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:24:58.680 14:29:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.680 14:29:13 -- common/autotest_common.sh@10 -- # set +x 00:24:58.680 [2024-12-16 14:29:13.155402] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:24:58.680 [2024-12-16 14:29:13.155505] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:24:58.680 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.680 14:29:13 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.PhEMi5cCHR 00:24:58.680 14:29:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.680 14:29:13 -- common/autotest_common.sh@10 -- # set +x 00:24:58.680 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.680 14:29:13 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.PhEMi5cCHR 00:24:58.680 14:29:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.680 14:29:13 -- common/autotest_common.sh@10 -- # set +x 00:24:58.680 [2024-12-16 14:29:13.171438] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:24:58.680 nvme0n1 00:24:58.680 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.680 14:29:13 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:24:58.680 14:29:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.680 14:29:13 -- common/autotest_common.sh@10 -- # set +x 00:24:58.680 [ 00:24:58.680 { 00:24:58.680 "name": "nvme0n1", 00:24:58.680 "aliases": [ 00:24:58.680 "1336e2a1-1191-429a-ab4a-3e20467cbc5c" 00:24:58.680 ], 00:24:58.680 "product_name": "NVMe disk", 00:24:58.680 "block_size": 512, 00:24:58.680 "num_blocks": 2097152, 00:24:58.680 "uuid": "1336e2a1-1191-429a-ab4a-3e20467cbc5c", 00:24:58.680 "assigned_rate_limits": { 00:24:58.680 "rw_ios_per_sec": 0, 00:24:58.680 "rw_mbytes_per_sec": 0, 00:24:58.680 "r_mbytes_per_sec": 0, 00:24:58.680 "w_mbytes_per_sec": 0 00:24:58.680 }, 00:24:58.680 "claimed": false, 00:24:58.680 "zoned": false, 00:24:58.680 "supported_io_types": { 00:24:58.680 "read": true, 00:24:58.680 "write": true, 00:24:58.680 "unmap": false, 00:24:58.680 "write_zeroes": true, 00:24:58.680 "flush": true, 00:24:58.680 "reset": true, 00:24:58.680 "compare": true, 00:24:58.680 "compare_and_write": true, 00:24:58.680 "abort": true, 00:24:58.680 "nvme_admin": true, 00:24:58.680 "nvme_io": true 00:24:58.680 }, 00:24:58.680 "driver_specific": { 00:24:58.680 "nvme": [ 00:24:58.680 { 00:24:58.680 "trid": { 00:24:58.680 "trtype": "TCP", 00:24:58.680 "adrfam": "IPv4", 00:24:58.680 "traddr": "10.0.0.2", 00:24:58.680 "trsvcid": "4421", 00:24:58.680 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:24:58.680 }, 00:24:58.680 "ctrlr_data": { 00:24:58.680 "cntlid": 3, 00:24:58.680 "vendor_id": "0x8086", 00:24:58.680 "model_number": "SPDK bdev Controller", 00:24:58.680 "serial_number": "00000000000000000000", 00:24:58.680 "firmware_revision": "24.01.1", 00:24:58.680 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:24:58.680 "oacs": { 00:24:58.680 "security": 0, 00:24:58.680 "format": 0, 00:24:58.680 "firmware": 0, 00:24:58.680 "ns_manage": 0 00:24:58.680 }, 00:24:58.680 "multi_ctrlr": true, 00:24:58.680 "ana_reporting": false 00:24:58.680 }, 00:24:58.680 "vs": { 00:24:58.680 "nvme_version": "1.3" 00:24:58.680 }, 00:24:58.680 "ns_data": { 00:24:58.680 "id": 1, 00:24:58.680 "can_share": true 00:24:58.680 } 00:24:58.680 } 00:24:58.680 ], 00:24:58.680 "mp_policy": "active_passive" 00:24:58.680 } 00:24:58.680 } 00:24:58.680 ] 00:24:58.680 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.680 14:29:13 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:24:58.680 14:29:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:58.680 14:29:13 -- common/autotest_common.sh@10 -- # set +x 00:24:58.939 14:29:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.939 14:29:13 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.PhEMi5cCHR 00:24:58.939 14:29:13 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:24:58.939 14:29:13 -- host/async_init.sh@78 -- # nvmftestfini 00:24:58.939 14:29:13 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:58.939 14:29:13 -- nvmf/common.sh@116 -- # sync 00:24:58.939 14:29:13 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:58.939 14:29:13 -- nvmf/common.sh@119 -- # set +e 00:24:58.939 14:29:13 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:58.939 14:29:13 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:58.939 rmmod nvme_tcp 00:24:58.939 rmmod nvme_fabrics 00:24:58.939 rmmod nvme_keyring 00:24:58.939 14:29:13 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:58.939 14:29:13 -- nvmf/common.sh@123 -- # set -e 00:24:58.939 14:29:13 -- nvmf/common.sh@124 -- # return 0 00:24:58.939 14:29:13 -- nvmf/common.sh@477 -- # '[' -n 483824 ']' 00:24:58.939 14:29:13 -- nvmf/common.sh@478 -- # killprocess 483824 00:24:58.939 14:29:13 -- common/autotest_common.sh@936 -- # '[' -z 483824 ']' 00:24:58.939 14:29:13 -- common/autotest_common.sh@940 -- # kill -0 483824 00:24:58.939 14:29:13 -- common/autotest_common.sh@941 -- # uname 00:24:58.939 14:29:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:58.939 14:29:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 483824 00:24:58.939 14:29:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:58.939 14:29:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:58.939 14:29:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 483824' 00:24:58.939 killing process with pid 483824 00:24:58.939 14:29:13 -- common/autotest_common.sh@955 -- # kill 483824 00:24:58.939 14:29:13 -- common/autotest_common.sh@960 -- # wait 483824 00:24:59.198 14:29:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:59.198 14:29:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:59.198 14:29:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:59.198 14:29:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:59.198 14:29:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:59.198 14:29:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:59.198 14:29:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:59.198 14:29:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:01.100 14:29:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:01.100 00:25:01.100 real 0m9.289s 00:25:01.100 user 0m3.525s 00:25:01.100 sys 0m4.250s 00:25:01.100 14:29:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:01.100 14:29:15 -- common/autotest_common.sh@10 -- # set +x 00:25:01.100 ************************************ 00:25:01.100 END TEST nvmf_async_init 00:25:01.100 ************************************ 00:25:01.100 14:29:15 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:01.100 14:29:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:01.100 14:29:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:01.100 14:29:15 -- common/autotest_common.sh@10 -- # set +x 00:25:01.100 ************************************ 00:25:01.100 START TEST dma 00:25:01.100 ************************************ 00:25:01.100 14:29:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:01.358 * Looking for test storage... 00:25:01.358 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:01.358 14:29:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:01.358 14:29:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:01.358 14:29:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:01.358 14:29:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:01.358 14:29:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:01.358 14:29:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:01.358 14:29:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:01.358 14:29:15 -- scripts/common.sh@335 -- # IFS=.-: 00:25:01.358 14:29:15 -- scripts/common.sh@335 -- # read -ra ver1 00:25:01.358 14:29:15 -- scripts/common.sh@336 -- # IFS=.-: 00:25:01.358 14:29:15 -- scripts/common.sh@336 -- # read -ra ver2 00:25:01.358 14:29:15 -- scripts/common.sh@337 -- # local 'op=<' 00:25:01.358 14:29:15 -- scripts/common.sh@339 -- # ver1_l=2 00:25:01.358 14:29:15 -- scripts/common.sh@340 -- # ver2_l=1 00:25:01.358 14:29:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:01.358 14:29:15 -- scripts/common.sh@343 -- # case "$op" in 00:25:01.358 14:29:15 -- scripts/common.sh@344 -- # : 1 00:25:01.358 14:29:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:01.358 14:29:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:01.358 14:29:15 -- scripts/common.sh@364 -- # decimal 1 00:25:01.358 14:29:15 -- scripts/common.sh@352 -- # local d=1 00:25:01.358 14:29:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:01.358 14:29:15 -- scripts/common.sh@354 -- # echo 1 00:25:01.358 14:29:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:01.358 14:29:15 -- scripts/common.sh@365 -- # decimal 2 00:25:01.358 14:29:15 -- scripts/common.sh@352 -- # local d=2 00:25:01.358 14:29:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:01.358 14:29:15 -- scripts/common.sh@354 -- # echo 2 00:25:01.358 14:29:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:01.358 14:29:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:01.358 14:29:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:01.358 14:29:15 -- scripts/common.sh@367 -- # return 0 00:25:01.358 14:29:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:01.358 14:29:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:01.358 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:01.358 --rc genhtml_branch_coverage=1 00:25:01.358 --rc genhtml_function_coverage=1 00:25:01.358 --rc genhtml_legend=1 00:25:01.358 --rc geninfo_all_blocks=1 00:25:01.358 --rc geninfo_unexecuted_blocks=1 00:25:01.358 00:25:01.358 ' 00:25:01.358 14:29:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:01.358 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:01.358 --rc genhtml_branch_coverage=1 00:25:01.358 --rc genhtml_function_coverage=1 00:25:01.358 --rc genhtml_legend=1 00:25:01.358 --rc geninfo_all_blocks=1 00:25:01.358 --rc geninfo_unexecuted_blocks=1 00:25:01.358 00:25:01.358 ' 00:25:01.358 14:29:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:01.358 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:01.358 --rc genhtml_branch_coverage=1 00:25:01.358 --rc genhtml_function_coverage=1 00:25:01.358 --rc genhtml_legend=1 00:25:01.359 --rc geninfo_all_blocks=1 00:25:01.359 --rc geninfo_unexecuted_blocks=1 00:25:01.359 00:25:01.359 ' 00:25:01.359 14:29:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:01.359 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:01.359 --rc genhtml_branch_coverage=1 00:25:01.359 --rc genhtml_function_coverage=1 00:25:01.359 --rc genhtml_legend=1 00:25:01.359 --rc geninfo_all_blocks=1 00:25:01.359 --rc geninfo_unexecuted_blocks=1 00:25:01.359 00:25:01.359 ' 00:25:01.359 14:29:15 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:01.359 14:29:15 -- nvmf/common.sh@7 -- # uname -s 00:25:01.359 14:29:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:01.359 14:29:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:01.359 14:29:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:01.359 14:29:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:01.359 14:29:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:01.359 14:29:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:01.359 14:29:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:01.359 14:29:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:01.359 14:29:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:01.359 14:29:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:01.359 14:29:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:25:01.359 14:29:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:25:01.359 14:29:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:01.359 14:29:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:01.359 14:29:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:01.359 14:29:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:01.359 14:29:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:01.359 14:29:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:01.359 14:29:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:01.359 14:29:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.359 14:29:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.359 14:29:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.359 14:29:15 -- paths/export.sh@5 -- # export PATH 00:25:01.359 14:29:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.359 14:29:15 -- nvmf/common.sh@46 -- # : 0 00:25:01.359 14:29:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:01.359 14:29:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:01.359 14:29:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:01.359 14:29:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:01.359 14:29:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:01.359 14:29:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:01.359 14:29:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:01.359 14:29:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:01.359 14:29:15 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:01.359 14:29:15 -- host/dma.sh@13 -- # exit 0 00:25:01.359 00:25:01.359 real 0m0.192s 00:25:01.359 user 0m0.119s 00:25:01.359 sys 0m0.086s 00:25:01.359 14:29:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:01.359 14:29:15 -- common/autotest_common.sh@10 -- # set +x 00:25:01.359 ************************************ 00:25:01.359 END TEST dma 00:25:01.359 ************************************ 00:25:01.359 14:29:15 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:01.359 14:29:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:01.359 14:29:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:01.359 14:29:15 -- common/autotest_common.sh@10 -- # set +x 00:25:01.359 ************************************ 00:25:01.359 START TEST nvmf_identify 00:25:01.359 ************************************ 00:25:01.359 14:29:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:01.619 * Looking for test storage... 00:25:01.619 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:01.619 14:29:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:01.619 14:29:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:01.619 14:29:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:01.619 14:29:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:01.619 14:29:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:01.619 14:29:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:01.619 14:29:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:01.619 14:29:16 -- scripts/common.sh@335 -- # IFS=.-: 00:25:01.619 14:29:16 -- scripts/common.sh@335 -- # read -ra ver1 00:25:01.619 14:29:16 -- scripts/common.sh@336 -- # IFS=.-: 00:25:01.619 14:29:16 -- scripts/common.sh@336 -- # read -ra ver2 00:25:01.619 14:29:16 -- scripts/common.sh@337 -- # local 'op=<' 00:25:01.619 14:29:16 -- scripts/common.sh@339 -- # ver1_l=2 00:25:01.619 14:29:16 -- scripts/common.sh@340 -- # ver2_l=1 00:25:01.619 14:29:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:01.619 14:29:16 -- scripts/common.sh@343 -- # case "$op" in 00:25:01.619 14:29:16 -- scripts/common.sh@344 -- # : 1 00:25:01.619 14:29:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:01.619 14:29:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:01.619 14:29:16 -- scripts/common.sh@364 -- # decimal 1 00:25:01.619 14:29:16 -- scripts/common.sh@352 -- # local d=1 00:25:01.619 14:29:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:01.619 14:29:16 -- scripts/common.sh@354 -- # echo 1 00:25:01.619 14:29:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:01.619 14:29:16 -- scripts/common.sh@365 -- # decimal 2 00:25:01.619 14:29:16 -- scripts/common.sh@352 -- # local d=2 00:25:01.619 14:29:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:01.619 14:29:16 -- scripts/common.sh@354 -- # echo 2 00:25:01.619 14:29:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:01.619 14:29:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:01.619 14:29:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:01.619 14:29:16 -- scripts/common.sh@367 -- # return 0 00:25:01.619 14:29:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:01.619 14:29:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:01.619 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:01.619 --rc genhtml_branch_coverage=1 00:25:01.619 --rc genhtml_function_coverage=1 00:25:01.619 --rc genhtml_legend=1 00:25:01.619 --rc geninfo_all_blocks=1 00:25:01.619 --rc geninfo_unexecuted_blocks=1 00:25:01.619 00:25:01.619 ' 00:25:01.619 14:29:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:01.619 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:01.619 --rc genhtml_branch_coverage=1 00:25:01.619 --rc genhtml_function_coverage=1 00:25:01.619 --rc genhtml_legend=1 00:25:01.619 --rc geninfo_all_blocks=1 00:25:01.619 --rc geninfo_unexecuted_blocks=1 00:25:01.619 00:25:01.619 ' 00:25:01.619 14:29:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:01.619 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:01.619 --rc genhtml_branch_coverage=1 00:25:01.619 --rc genhtml_function_coverage=1 00:25:01.619 --rc genhtml_legend=1 00:25:01.619 --rc geninfo_all_blocks=1 00:25:01.619 --rc geninfo_unexecuted_blocks=1 00:25:01.619 00:25:01.619 ' 00:25:01.619 14:29:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:01.619 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:01.619 --rc genhtml_branch_coverage=1 00:25:01.619 --rc genhtml_function_coverage=1 00:25:01.619 --rc genhtml_legend=1 00:25:01.619 --rc geninfo_all_blocks=1 00:25:01.619 --rc geninfo_unexecuted_blocks=1 00:25:01.619 00:25:01.619 ' 00:25:01.619 14:29:16 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:01.619 14:29:16 -- nvmf/common.sh@7 -- # uname -s 00:25:01.619 14:29:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:01.619 14:29:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:01.619 14:29:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:01.619 14:29:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:01.619 14:29:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:01.619 14:29:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:01.619 14:29:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:01.619 14:29:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:01.619 14:29:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:01.619 14:29:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:01.619 14:29:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:25:01.619 14:29:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:25:01.619 14:29:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:01.619 14:29:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:01.619 14:29:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:01.619 14:29:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:01.619 14:29:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:01.619 14:29:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:01.619 14:29:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:01.619 14:29:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.619 14:29:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.619 14:29:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.619 14:29:16 -- paths/export.sh@5 -- # export PATH 00:25:01.619 14:29:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:01.619 14:29:16 -- nvmf/common.sh@46 -- # : 0 00:25:01.619 14:29:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:01.619 14:29:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:01.620 14:29:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:01.620 14:29:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:01.620 14:29:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:01.620 14:29:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:01.620 14:29:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:01.620 14:29:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:01.620 14:29:16 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:01.620 14:29:16 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:01.620 14:29:16 -- host/identify.sh@14 -- # nvmftestinit 00:25:01.620 14:29:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:01.620 14:29:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:01.620 14:29:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:01.620 14:29:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:01.620 14:29:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:01.620 14:29:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:01.620 14:29:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:01.620 14:29:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:01.620 14:29:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:01.620 14:29:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:01.620 14:29:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:01.620 14:29:16 -- common/autotest_common.sh@10 -- # set +x 00:25:06.891 14:29:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:06.891 14:29:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:06.891 14:29:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:06.891 14:29:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:06.891 14:29:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:06.891 14:29:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:06.891 14:29:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:06.891 14:29:20 -- nvmf/common.sh@294 -- # net_devs=() 00:25:06.891 14:29:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:06.891 14:29:20 -- nvmf/common.sh@295 -- # e810=() 00:25:06.891 14:29:20 -- nvmf/common.sh@295 -- # local -ga e810 00:25:06.891 14:29:20 -- nvmf/common.sh@296 -- # x722=() 00:25:06.891 14:29:20 -- nvmf/common.sh@296 -- # local -ga x722 00:25:06.891 14:29:20 -- nvmf/common.sh@297 -- # mlx=() 00:25:06.891 14:29:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:06.891 14:29:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:06.891 14:29:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:06.891 14:29:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:06.891 14:29:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:06.891 14:29:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.891 14:29:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:25:06.891 Found 0000:af:00.0 (0x8086 - 0x159b) 00:25:06.891 14:29:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:06.891 14:29:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:25:06.891 Found 0000:af:00.1 (0x8086 - 0x159b) 00:25:06.891 14:29:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:06.891 14:29:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.891 14:29:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.891 14:29:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.891 14:29:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.891 14:29:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:25:06.891 Found net devices under 0000:af:00.0: cvl_0_0 00:25:06.891 14:29:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.891 14:29:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:06.891 14:29:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:06.891 14:29:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:06.891 14:29:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:06.891 14:29:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:25:06.891 Found net devices under 0000:af:00.1: cvl_0_1 00:25:06.891 14:29:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:06.891 14:29:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:06.891 14:29:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:06.891 14:29:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:06.891 14:29:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:06.891 14:29:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:06.891 14:29:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:06.891 14:29:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:06.891 14:29:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:06.891 14:29:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:06.891 14:29:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:06.891 14:29:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:06.891 14:29:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:06.891 14:29:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:06.891 14:29:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:06.891 14:29:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:06.891 14:29:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:06.891 14:29:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:06.891 14:29:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:06.891 14:29:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:06.891 14:29:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:06.891 14:29:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:06.891 14:29:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:06.891 14:29:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:06.891 14:29:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:06.891 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:06.891 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.362 ms 00:25:06.891 00:25:06.891 --- 10.0.0.2 ping statistics --- 00:25:06.891 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:06.891 rtt min/avg/max/mdev = 0.362/0.362/0.362/0.000 ms 00:25:06.891 14:29:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:06.892 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:06.892 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.205 ms 00:25:06.892 00:25:06.892 --- 10.0.0.1 ping statistics --- 00:25:06.892 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:06.892 rtt min/avg/max/mdev = 0.205/0.205/0.205/0.000 ms 00:25:06.892 14:29:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:06.892 14:29:21 -- nvmf/common.sh@410 -- # return 0 00:25:06.892 14:29:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:06.892 14:29:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:06.892 14:29:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:06.892 14:29:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:06.892 14:29:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:06.892 14:29:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:06.892 14:29:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:06.892 14:29:21 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:25:06.892 14:29:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:06.892 14:29:21 -- common/autotest_common.sh@10 -- # set +x 00:25:06.892 14:29:21 -- host/identify.sh@19 -- # nvmfpid=487599 00:25:06.892 14:29:21 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:06.892 14:29:21 -- host/identify.sh@23 -- # waitforlisten 487599 00:25:06.892 14:29:21 -- common/autotest_common.sh@829 -- # '[' -z 487599 ']' 00:25:06.892 14:29:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:06.892 14:29:21 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:06.892 14:29:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:06.892 14:29:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:06.892 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:06.892 14:29:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:06.892 14:29:21 -- common/autotest_common.sh@10 -- # set +x 00:25:06.892 [2024-12-16 14:29:21.203015] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:06.892 [2024-12-16 14:29:21.203055] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:06.892 EAL: No free 2048 kB hugepages reported on node 1 00:25:06.892 [2024-12-16 14:29:21.260802] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:06.892 [2024-12-16 14:29:21.338117] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:06.892 [2024-12-16 14:29:21.338223] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:06.892 [2024-12-16 14:29:21.338231] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:06.892 [2024-12-16 14:29:21.338237] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:06.892 [2024-12-16 14:29:21.338278] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:06.892 [2024-12-16 14:29:21.338387] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:06.892 [2024-12-16 14:29:21.338406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:06.892 [2024-12-16 14:29:21.338407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:07.460 14:29:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:07.460 14:29:22 -- common/autotest_common.sh@862 -- # return 0 00:25:07.460 14:29:22 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:07.460 14:29:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.460 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.460 [2024-12-16 14:29:22.026064] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:07.460 14:29:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.460 14:29:22 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:25:07.460 14:29:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:07.460 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.721 14:29:22 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:07.721 14:29:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.721 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.721 Malloc0 00:25:07.721 14:29:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.721 14:29:22 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:07.721 14:29:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.721 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.721 14:29:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.721 14:29:22 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:25:07.721 14:29:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.721 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.721 14:29:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.721 14:29:22 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:07.721 14:29:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.721 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.721 [2024-12-16 14:29:22.117944] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:07.721 14:29:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.721 14:29:22 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:07.721 14:29:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.721 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.721 14:29:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.721 14:29:22 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:25:07.721 14:29:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.721 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.721 [2024-12-16 14:29:22.133774] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:07.721 [ 00:25:07.721 { 00:25:07.721 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:07.721 "subtype": "Discovery", 00:25:07.721 "listen_addresses": [ 00:25:07.721 { 00:25:07.721 "transport": "TCP", 00:25:07.721 "trtype": "TCP", 00:25:07.721 "adrfam": "IPv4", 00:25:07.721 "traddr": "10.0.0.2", 00:25:07.721 "trsvcid": "4420" 00:25:07.721 } 00:25:07.721 ], 00:25:07.721 "allow_any_host": true, 00:25:07.721 "hosts": [] 00:25:07.721 }, 00:25:07.721 { 00:25:07.721 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:07.721 "subtype": "NVMe", 00:25:07.721 "listen_addresses": [ 00:25:07.721 { 00:25:07.721 "transport": "TCP", 00:25:07.721 "trtype": "TCP", 00:25:07.721 "adrfam": "IPv4", 00:25:07.721 "traddr": "10.0.0.2", 00:25:07.721 "trsvcid": "4420" 00:25:07.721 } 00:25:07.721 ], 00:25:07.721 "allow_any_host": true, 00:25:07.721 "hosts": [], 00:25:07.721 "serial_number": "SPDK00000000000001", 00:25:07.721 "model_number": "SPDK bdev Controller", 00:25:07.721 "max_namespaces": 32, 00:25:07.721 "min_cntlid": 1, 00:25:07.721 "max_cntlid": 65519, 00:25:07.721 "namespaces": [ 00:25:07.721 { 00:25:07.721 "nsid": 1, 00:25:07.721 "bdev_name": "Malloc0", 00:25:07.721 "name": "Malloc0", 00:25:07.721 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:25:07.721 "eui64": "ABCDEF0123456789", 00:25:07.721 "uuid": "010f4752-efe1-4940-be16-16e18023e589" 00:25:07.721 } 00:25:07.721 ] 00:25:07.721 } 00:25:07.721 ] 00:25:07.721 14:29:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.721 14:29:22 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:25:07.721 [2024-12-16 14:29:22.167766] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:07.721 [2024-12-16 14:29:22.167799] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid487688 ] 00:25:07.721 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.722 [2024-12-16 14:29:22.195171] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:25:07.722 [2024-12-16 14:29:22.195215] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:07.722 [2024-12-16 14:29:22.195219] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:07.722 [2024-12-16 14:29:22.195230] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:07.722 [2024-12-16 14:29:22.195237] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:07.722 [2024-12-16 14:29:22.195441] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:25:07.722 [2024-12-16 14:29:22.195478] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x8a3040 0 00:25:07.722 [2024-12-16 14:29:22.212864] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:07.722 [2024-12-16 14:29:22.212876] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:07.722 [2024-12-16 14:29:22.212880] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:07.722 [2024-12-16 14:29:22.212883] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:07.722 [2024-12-16 14:29:22.212917] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.212922] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.212926] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.722 [2024-12-16 14:29:22.212937] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:07.722 [2024-12-16 14:29:22.212951] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.722 [2024-12-16 14:29:22.220866] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.722 [2024-12-16 14:29:22.220875] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.722 [2024-12-16 14:29:22.220878] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.220881] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.722 [2024-12-16 14:29:22.220890] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:07.722 [2024-12-16 14:29:22.220896] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:25:07.722 [2024-12-16 14:29:22.220901] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:25:07.722 [2024-12-16 14:29:22.220912] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.220915] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.220918] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.722 [2024-12-16 14:29:22.220925] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.722 [2024-12-16 14:29:22.220937] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.722 [2024-12-16 14:29:22.221031] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.722 [2024-12-16 14:29:22.221036] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.722 [2024-12-16 14:29:22.221039] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221043] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.722 [2024-12-16 14:29:22.221047] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:25:07.722 [2024-12-16 14:29:22.221053] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:25:07.722 [2024-12-16 14:29:22.221059] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221062] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221065] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.722 [2024-12-16 14:29:22.221071] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.722 [2024-12-16 14:29:22.221080] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.722 [2024-12-16 14:29:22.221150] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.722 [2024-12-16 14:29:22.221156] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.722 [2024-12-16 14:29:22.221161] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221164] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.722 [2024-12-16 14:29:22.221169] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:25:07.722 [2024-12-16 14:29:22.221176] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:25:07.722 [2024-12-16 14:29:22.221181] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221185] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221187] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.722 [2024-12-16 14:29:22.221193] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.722 [2024-12-16 14:29:22.221202] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.722 [2024-12-16 14:29:22.221269] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.722 [2024-12-16 14:29:22.221275] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.722 [2024-12-16 14:29:22.221278] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221281] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.722 [2024-12-16 14:29:22.221285] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:07.722 [2024-12-16 14:29:22.221292] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221295] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221298] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.722 [2024-12-16 14:29:22.221304] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.722 [2024-12-16 14:29:22.221313] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.722 [2024-12-16 14:29:22.221377] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.722 [2024-12-16 14:29:22.221383] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.722 [2024-12-16 14:29:22.221385] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221389] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.722 [2024-12-16 14:29:22.221392] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:25:07.722 [2024-12-16 14:29:22.221396] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:25:07.722 [2024-12-16 14:29:22.221402] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:07.722 [2024-12-16 14:29:22.221507] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:25:07.722 [2024-12-16 14:29:22.221511] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:07.722 [2024-12-16 14:29:22.221518] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221521] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221524] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.722 [2024-12-16 14:29:22.221529] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.722 [2024-12-16 14:29:22.221540] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.722 [2024-12-16 14:29:22.221611] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.722 [2024-12-16 14:29:22.221617] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.722 [2024-12-16 14:29:22.221620] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221623] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.722 [2024-12-16 14:29:22.221627] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:07.722 [2024-12-16 14:29:22.221634] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221638] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221640] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.722 [2024-12-16 14:29:22.221646] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.722 [2024-12-16 14:29:22.221655] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.722 [2024-12-16 14:29:22.221722] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.722 [2024-12-16 14:29:22.221727] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.722 [2024-12-16 14:29:22.221730] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.722 [2024-12-16 14:29:22.221733] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.722 [2024-12-16 14:29:22.221737] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:07.722 [2024-12-16 14:29:22.221741] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:25:07.723 [2024-12-16 14:29:22.221747] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:25:07.723 [2024-12-16 14:29:22.221754] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:25:07.723 [2024-12-16 14:29:22.221762] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.221765] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.221768] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.723 [2024-12-16 14:29:22.221773] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.723 [2024-12-16 14:29:22.221782] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.723 [2024-12-16 14:29:22.221883] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.723 [2024-12-16 14:29:22.221890] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.723 [2024-12-16 14:29:22.221893] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.221896] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a3040): datao=0, datal=4096, cccid=0 00:25:07.723 [2024-12-16 14:29:22.221900] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x90dd50) on tqpair(0x8a3040): expected_datao=0, payload_size=4096 00:25:07.723 [2024-12-16 14:29:22.221907] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.221910] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.262932] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.723 [2024-12-16 14:29:22.262949] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.723 [2024-12-16 14:29:22.262953] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.262959] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.723 [2024-12-16 14:29:22.262968] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:25:07.723 [2024-12-16 14:29:22.262973] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:25:07.723 [2024-12-16 14:29:22.262976] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:25:07.723 [2024-12-16 14:29:22.262981] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:25:07.723 [2024-12-16 14:29:22.262985] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:25:07.723 [2024-12-16 14:29:22.262989] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:25:07.723 [2024-12-16 14:29:22.263001] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:25:07.723 [2024-12-16 14:29:22.263008] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263012] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263015] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.723 [2024-12-16 14:29:22.263022] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:07.723 [2024-12-16 14:29:22.263034] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.723 [2024-12-16 14:29:22.263111] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.723 [2024-12-16 14:29:22.263117] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.723 [2024-12-16 14:29:22.263120] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263123] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90dd50) on tqpair=0x8a3040 00:25:07.723 [2024-12-16 14:29:22.263129] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263133] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263136] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x8a3040) 00:25:07.723 [2024-12-16 14:29:22.263141] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.723 [2024-12-16 14:29:22.263146] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263149] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263152] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x8a3040) 00:25:07.723 [2024-12-16 14:29:22.263157] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.723 [2024-12-16 14:29:22.263162] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263165] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x8a3040) 00:25:07.723 [2024-12-16 14:29:22.263172] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.723 [2024-12-16 14:29:22.263178] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263181] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263184] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.723 [2024-12-16 14:29:22.263188] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.723 [2024-12-16 14:29:22.263195] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:25:07.723 [2024-12-16 14:29:22.263205] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:07.723 [2024-12-16 14:29:22.263211] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263214] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263217] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a3040) 00:25:07.723 [2024-12-16 14:29:22.263222] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.723 [2024-12-16 14:29:22.263233] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90dd50, cid 0, qid 0 00:25:07.723 [2024-12-16 14:29:22.263237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90deb0, cid 1, qid 0 00:25:07.723 [2024-12-16 14:29:22.263241] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e010, cid 2, qid 0 00:25:07.723 [2024-12-16 14:29:22.263245] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.723 [2024-12-16 14:29:22.263249] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e2d0, cid 4, qid 0 00:25:07.723 [2024-12-16 14:29:22.263349] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.723 [2024-12-16 14:29:22.263355] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.723 [2024-12-16 14:29:22.263358] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263361] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e2d0) on tqpair=0x8a3040 00:25:07.723 [2024-12-16 14:29:22.263365] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:25:07.723 [2024-12-16 14:29:22.263369] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:25:07.723 [2024-12-16 14:29:22.263379] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263383] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263386] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a3040) 00:25:07.723 [2024-12-16 14:29:22.263391] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.723 [2024-12-16 14:29:22.263401] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e2d0, cid 4, qid 0 00:25:07.723 [2024-12-16 14:29:22.263478] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.723 [2024-12-16 14:29:22.263483] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.723 [2024-12-16 14:29:22.263486] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263489] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a3040): datao=0, datal=4096, cccid=4 00:25:07.723 [2024-12-16 14:29:22.263493] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x90e2d0) on tqpair(0x8a3040): expected_datao=0, payload_size=4096 00:25:07.723 [2024-12-16 14:29:22.263500] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263503] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.723 [2024-12-16 14:29:22.263517] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.723 [2024-12-16 14:29:22.263522] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.724 [2024-12-16 14:29:22.263525] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263528] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e2d0) on tqpair=0x8a3040 00:25:07.724 [2024-12-16 14:29:22.263538] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:25:07.724 [2024-12-16 14:29:22.263560] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263564] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263567] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a3040) 00:25:07.724 [2024-12-16 14:29:22.263573] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.724 [2024-12-16 14:29:22.263578] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263581] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263584] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x8a3040) 00:25:07.724 [2024-12-16 14:29:22.263589] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.724 [2024-12-16 14:29:22.263601] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e2d0, cid 4, qid 0 00:25:07.724 [2024-12-16 14:29:22.263606] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e430, cid 5, qid 0 00:25:07.724 [2024-12-16 14:29:22.263701] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.724 [2024-12-16 14:29:22.263707] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.724 [2024-12-16 14:29:22.263710] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263712] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a3040): datao=0, datal=1024, cccid=4 00:25:07.724 [2024-12-16 14:29:22.263716] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x90e2d0) on tqpair(0x8a3040): expected_datao=0, payload_size=1024 00:25:07.724 [2024-12-16 14:29:22.263722] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263725] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263730] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.724 [2024-12-16 14:29:22.263735] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.724 [2024-12-16 14:29:22.263738] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.724 [2024-12-16 14:29:22.263741] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e430) on tqpair=0x8a3040 00:25:07.988 [2024-12-16 14:29:22.308865] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.988 [2024-12-16 14:29:22.308880] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.988 [2024-12-16 14:29:22.308883] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.308886] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e2d0) on tqpair=0x8a3040 00:25:07.988 [2024-12-16 14:29:22.308899] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.308903] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.308906] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a3040) 00:25:07.988 [2024-12-16 14:29:22.308913] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.988 [2024-12-16 14:29:22.308930] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e2d0, cid 4, qid 0 00:25:07.988 [2024-12-16 14:29:22.309028] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.988 [2024-12-16 14:29:22.309034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.988 [2024-12-16 14:29:22.309037] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.309040] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a3040): datao=0, datal=3072, cccid=4 00:25:07.988 [2024-12-16 14:29:22.309044] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x90e2d0) on tqpair(0x8a3040): expected_datao=0, payload_size=3072 00:25:07.988 [2024-12-16 14:29:22.309050] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.309056] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.309101] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.988 [2024-12-16 14:29:22.309106] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.988 [2024-12-16 14:29:22.309109] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.309112] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e2d0) on tqpair=0x8a3040 00:25:07.988 [2024-12-16 14:29:22.309120] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.309123] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.309126] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x8a3040) 00:25:07.988 [2024-12-16 14:29:22.309131] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.988 [2024-12-16 14:29:22.309144] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e2d0, cid 4, qid 0 00:25:07.988 [2024-12-16 14:29:22.309238] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.988 [2024-12-16 14:29:22.309243] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.988 [2024-12-16 14:29:22.309246] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.309249] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x8a3040): datao=0, datal=8, cccid=4 00:25:07.988 [2024-12-16 14:29:22.309253] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x90e2d0) on tqpair(0x8a3040): expected_datao=0, payload_size=8 00:25:07.988 [2024-12-16 14:29:22.309258] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.309261] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.349978] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.988 [2024-12-16 14:29:22.349988] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.988 [2024-12-16 14:29:22.349991] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.988 [2024-12-16 14:29:22.349995] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e2d0) on tqpair=0x8a3040 00:25:07.988 ===================================================== 00:25:07.988 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:25:07.988 ===================================================== 00:25:07.988 Controller Capabilities/Features 00:25:07.988 ================================ 00:25:07.988 Vendor ID: 0000 00:25:07.988 Subsystem Vendor ID: 0000 00:25:07.988 Serial Number: .................... 00:25:07.988 Model Number: ........................................ 00:25:07.988 Firmware Version: 24.01.1 00:25:07.988 Recommended Arb Burst: 0 00:25:07.988 IEEE OUI Identifier: 00 00 00 00:25:07.988 Multi-path I/O 00:25:07.988 May have multiple subsystem ports: No 00:25:07.988 May have multiple controllers: No 00:25:07.988 Associated with SR-IOV VF: No 00:25:07.988 Max Data Transfer Size: 131072 00:25:07.988 Max Number of Namespaces: 0 00:25:07.988 Max Number of I/O Queues: 1024 00:25:07.988 NVMe Specification Version (VS): 1.3 00:25:07.988 NVMe Specification Version (Identify): 1.3 00:25:07.988 Maximum Queue Entries: 128 00:25:07.988 Contiguous Queues Required: Yes 00:25:07.988 Arbitration Mechanisms Supported 00:25:07.988 Weighted Round Robin: Not Supported 00:25:07.988 Vendor Specific: Not Supported 00:25:07.988 Reset Timeout: 15000 ms 00:25:07.988 Doorbell Stride: 4 bytes 00:25:07.988 NVM Subsystem Reset: Not Supported 00:25:07.988 Command Sets Supported 00:25:07.988 NVM Command Set: Supported 00:25:07.988 Boot Partition: Not Supported 00:25:07.988 Memory Page Size Minimum: 4096 bytes 00:25:07.988 Memory Page Size Maximum: 4096 bytes 00:25:07.988 Persistent Memory Region: Not Supported 00:25:07.988 Optional Asynchronous Events Supported 00:25:07.988 Namespace Attribute Notices: Not Supported 00:25:07.988 Firmware Activation Notices: Not Supported 00:25:07.988 ANA Change Notices: Not Supported 00:25:07.988 PLE Aggregate Log Change Notices: Not Supported 00:25:07.988 LBA Status Info Alert Notices: Not Supported 00:25:07.988 EGE Aggregate Log Change Notices: Not Supported 00:25:07.988 Normal NVM Subsystem Shutdown event: Not Supported 00:25:07.988 Zone Descriptor Change Notices: Not Supported 00:25:07.989 Discovery Log Change Notices: Supported 00:25:07.989 Controller Attributes 00:25:07.989 128-bit Host Identifier: Not Supported 00:25:07.989 Non-Operational Permissive Mode: Not Supported 00:25:07.989 NVM Sets: Not Supported 00:25:07.989 Read Recovery Levels: Not Supported 00:25:07.989 Endurance Groups: Not Supported 00:25:07.989 Predictable Latency Mode: Not Supported 00:25:07.989 Traffic Based Keep ALive: Not Supported 00:25:07.989 Namespace Granularity: Not Supported 00:25:07.989 SQ Associations: Not Supported 00:25:07.989 UUID List: Not Supported 00:25:07.989 Multi-Domain Subsystem: Not Supported 00:25:07.989 Fixed Capacity Management: Not Supported 00:25:07.989 Variable Capacity Management: Not Supported 00:25:07.989 Delete Endurance Group: Not Supported 00:25:07.989 Delete NVM Set: Not Supported 00:25:07.989 Extended LBA Formats Supported: Not Supported 00:25:07.989 Flexible Data Placement Supported: Not Supported 00:25:07.989 00:25:07.989 Controller Memory Buffer Support 00:25:07.989 ================================ 00:25:07.989 Supported: No 00:25:07.989 00:25:07.989 Persistent Memory Region Support 00:25:07.989 ================================ 00:25:07.989 Supported: No 00:25:07.989 00:25:07.989 Admin Command Set Attributes 00:25:07.989 ============================ 00:25:07.989 Security Send/Receive: Not Supported 00:25:07.989 Format NVM: Not Supported 00:25:07.989 Firmware Activate/Download: Not Supported 00:25:07.989 Namespace Management: Not Supported 00:25:07.989 Device Self-Test: Not Supported 00:25:07.989 Directives: Not Supported 00:25:07.989 NVMe-MI: Not Supported 00:25:07.989 Virtualization Management: Not Supported 00:25:07.989 Doorbell Buffer Config: Not Supported 00:25:07.989 Get LBA Status Capability: Not Supported 00:25:07.989 Command & Feature Lockdown Capability: Not Supported 00:25:07.989 Abort Command Limit: 1 00:25:07.989 Async Event Request Limit: 4 00:25:07.989 Number of Firmware Slots: N/A 00:25:07.989 Firmware Slot 1 Read-Only: N/A 00:25:07.989 Firmware Activation Without Reset: N/A 00:25:07.989 Multiple Update Detection Support: N/A 00:25:07.989 Firmware Update Granularity: No Information Provided 00:25:07.989 Per-Namespace SMART Log: No 00:25:07.989 Asymmetric Namespace Access Log Page: Not Supported 00:25:07.989 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:25:07.989 Command Effects Log Page: Not Supported 00:25:07.989 Get Log Page Extended Data: Supported 00:25:07.989 Telemetry Log Pages: Not Supported 00:25:07.989 Persistent Event Log Pages: Not Supported 00:25:07.989 Supported Log Pages Log Page: May Support 00:25:07.989 Commands Supported & Effects Log Page: Not Supported 00:25:07.989 Feature Identifiers & Effects Log Page:May Support 00:25:07.989 NVMe-MI Commands & Effects Log Page: May Support 00:25:07.989 Data Area 4 for Telemetry Log: Not Supported 00:25:07.989 Error Log Page Entries Supported: 128 00:25:07.989 Keep Alive: Not Supported 00:25:07.989 00:25:07.989 NVM Command Set Attributes 00:25:07.989 ========================== 00:25:07.989 Submission Queue Entry Size 00:25:07.989 Max: 1 00:25:07.989 Min: 1 00:25:07.989 Completion Queue Entry Size 00:25:07.989 Max: 1 00:25:07.989 Min: 1 00:25:07.989 Number of Namespaces: 0 00:25:07.989 Compare Command: Not Supported 00:25:07.989 Write Uncorrectable Command: Not Supported 00:25:07.989 Dataset Management Command: Not Supported 00:25:07.989 Write Zeroes Command: Not Supported 00:25:07.989 Set Features Save Field: Not Supported 00:25:07.989 Reservations: Not Supported 00:25:07.989 Timestamp: Not Supported 00:25:07.989 Copy: Not Supported 00:25:07.989 Volatile Write Cache: Not Present 00:25:07.989 Atomic Write Unit (Normal): 1 00:25:07.989 Atomic Write Unit (PFail): 1 00:25:07.989 Atomic Compare & Write Unit: 1 00:25:07.989 Fused Compare & Write: Supported 00:25:07.989 Scatter-Gather List 00:25:07.989 SGL Command Set: Supported 00:25:07.989 SGL Keyed: Supported 00:25:07.989 SGL Bit Bucket Descriptor: Not Supported 00:25:07.989 SGL Metadata Pointer: Not Supported 00:25:07.989 Oversized SGL: Not Supported 00:25:07.989 SGL Metadata Address: Not Supported 00:25:07.989 SGL Offset: Supported 00:25:07.989 Transport SGL Data Block: Not Supported 00:25:07.989 Replay Protected Memory Block: Not Supported 00:25:07.989 00:25:07.989 Firmware Slot Information 00:25:07.989 ========================= 00:25:07.989 Active slot: 0 00:25:07.989 00:25:07.989 00:25:07.989 Error Log 00:25:07.989 ========= 00:25:07.989 00:25:07.989 Active Namespaces 00:25:07.989 ================= 00:25:07.989 Discovery Log Page 00:25:07.989 ================== 00:25:07.989 Generation Counter: 2 00:25:07.989 Number of Records: 2 00:25:07.989 Record Format: 0 00:25:07.989 00:25:07.989 Discovery Log Entry 0 00:25:07.989 ---------------------- 00:25:07.989 Transport Type: 3 (TCP) 00:25:07.989 Address Family: 1 (IPv4) 00:25:07.989 Subsystem Type: 3 (Current Discovery Subsystem) 00:25:07.989 Entry Flags: 00:25:07.989 Duplicate Returned Information: 1 00:25:07.989 Explicit Persistent Connection Support for Discovery: 1 00:25:07.989 Transport Requirements: 00:25:07.989 Secure Channel: Not Required 00:25:07.989 Port ID: 0 (0x0000) 00:25:07.989 Controller ID: 65535 (0xffff) 00:25:07.989 Admin Max SQ Size: 128 00:25:07.989 Transport Service Identifier: 4420 00:25:07.989 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:25:07.989 Transport Address: 10.0.0.2 00:25:07.989 Discovery Log Entry 1 00:25:07.989 ---------------------- 00:25:07.989 Transport Type: 3 (TCP) 00:25:07.989 Address Family: 1 (IPv4) 00:25:07.989 Subsystem Type: 2 (NVM Subsystem) 00:25:07.989 Entry Flags: 00:25:07.989 Duplicate Returned Information: 0 00:25:07.989 Explicit Persistent Connection Support for Discovery: 0 00:25:07.989 Transport Requirements: 00:25:07.989 Secure Channel: Not Required 00:25:07.989 Port ID: 0 (0x0000) 00:25:07.989 Controller ID: 65535 (0xffff) 00:25:07.989 Admin Max SQ Size: 128 00:25:07.989 Transport Service Identifier: 4420 00:25:07.989 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:25:07.989 Transport Address: 10.0.0.2 [2024-12-16 14:29:22.350075] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:25:07.989 [2024-12-16 14:29:22.350088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.989 [2024-12-16 14:29:22.350094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.989 [2024-12-16 14:29:22.350099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.989 [2024-12-16 14:29:22.350104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.989 [2024-12-16 14:29:22.350111] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350115] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350118] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.350125] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.350137] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.350221] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.350227] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.350230] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350233] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.350241] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350244] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350247] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.350253] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.350265] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.350357] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.350362] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.350365] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350369] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.350373] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:25:07.990 [2024-12-16 14:29:22.350376] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:25:07.990 [2024-12-16 14:29:22.350384] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350387] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350390] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.350396] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.350405] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.350472] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.350477] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.350480] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350483] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.350491] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350494] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350497] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.350503] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.350512] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.350593] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.350599] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.350602] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350605] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.350613] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350616] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350619] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.350625] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.350634] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.350707] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.350712] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.350717] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350720] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.350728] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350731] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350734] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.350740] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.350749] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.350824] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.350829] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.350832] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350835] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.350842] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350846] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350849] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.350859] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.350869] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.350938] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.350943] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.350946] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350949] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.350957] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350960] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.350963] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.350969] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.350978] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.351079] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.351084] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.351087] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.351090] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.351098] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.351101] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.351104] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.351110] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.351120] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.351183] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.351189] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.351191] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.351196] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.351204] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.351207] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.351210] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.990 [2024-12-16 14:29:22.351216] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.990 [2024-12-16 14:29:22.351225] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.990 [2024-12-16 14:29:22.351301] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.990 [2024-12-16 14:29:22.351306] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.990 [2024-12-16 14:29:22.351309] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.351312] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.990 [2024-12-16 14:29:22.351320] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.990 [2024-12-16 14:29:22.351323] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351326] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.351332] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.351341] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.351414] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.351419] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.351422] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351425] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.351434] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351437] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351440] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.351445] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.351455] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.351523] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.351528] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.351531] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351534] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.351542] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351545] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351548] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.351554] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.351563] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.351641] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.351646] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.351649] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351652] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.351662] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351666] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351669] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.351674] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.351683] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.351758] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.351763] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.351766] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351769] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.351777] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351780] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351783] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.351788] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.351797] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.351887] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.351893] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.351896] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351899] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.351907] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351910] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.351913] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.351919] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.351929] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.352001] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.352007] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.352009] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352012] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.352020] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352023] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352026] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.352032] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.352041] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.352118] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.352124] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.352127] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352130] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.352138] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352143] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352146] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.352152] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.352161] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.352235] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.352240] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.352243] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352246] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.352254] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352257] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352260] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.352266] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.352275] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.352335] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.352340] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.352343] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352346] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.352354] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352357] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352360] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.991 [2024-12-16 14:29:22.352365] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.991 [2024-12-16 14:29:22.352374] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.991 [2024-12-16 14:29:22.352437] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.991 [2024-12-16 14:29:22.352442] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.991 [2024-12-16 14:29:22.352445] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352448] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.991 [2024-12-16 14:29:22.352456] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352459] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.991 [2024-12-16 14:29:22.352462] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.992 [2024-12-16 14:29:22.352467] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.992 [2024-12-16 14:29:22.352476] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.992 [2024-12-16 14:29:22.352554] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.992 [2024-12-16 14:29:22.352559] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.992 [2024-12-16 14:29:22.352562] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352565] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.992 [2024-12-16 14:29:22.352573] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352576] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352581] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.992 [2024-12-16 14:29:22.352587] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.992 [2024-12-16 14:29:22.352596] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.992 [2024-12-16 14:29:22.352685] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.992 [2024-12-16 14:29:22.352691] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.992 [2024-12-16 14:29:22.352693] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352696] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.992 [2024-12-16 14:29:22.352705] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352708] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352711] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.992 [2024-12-16 14:29:22.352717] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.992 [2024-12-16 14:29:22.352726] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.992 [2024-12-16 14:29:22.352787] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.992 [2024-12-16 14:29:22.352793] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.992 [2024-12-16 14:29:22.352795] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352799] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.992 [2024-12-16 14:29:22.352806] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352810] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.352813] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.992 [2024-12-16 14:29:22.352818] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.992 [2024-12-16 14:29:22.352827] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.992 [2024-12-16 14:29:22.356867] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.992 [2024-12-16 14:29:22.356876] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.992 [2024-12-16 14:29:22.356879] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.356882] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.992 [2024-12-16 14:29:22.356892] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.356895] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.356898] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x8a3040) 00:25:07.992 [2024-12-16 14:29:22.356904] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.992 [2024-12-16 14:29:22.356915] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x90e170, cid 3, qid 0 00:25:07.992 [2024-12-16 14:29:22.357070] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.992 [2024-12-16 14:29:22.357075] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.992 [2024-12-16 14:29:22.357078] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.357081] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x90e170) on tqpair=0x8a3040 00:25:07.992 [2024-12-16 14:29:22.357087] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:25:07.992 00:25:07.992 14:29:22 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:25:07.992 [2024-12-16 14:29:22.391278] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:07.992 [2024-12-16 14:29:22.391310] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid487811 ] 00:25:07.992 EAL: No free 2048 kB hugepages reported on node 1 00:25:07.992 [2024-12-16 14:29:22.414844] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:25:07.992 [2024-12-16 14:29:22.418885] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:25:07.992 [2024-12-16 14:29:22.418890] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:25:07.992 [2024-12-16 14:29:22.418900] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:25:07.992 [2024-12-16 14:29:22.418906] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:25:07.992 [2024-12-16 14:29:22.419163] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:25:07.992 [2024-12-16 14:29:22.419188] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xdf7040 0 00:25:07.992 [2024-12-16 14:29:22.425863] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:25:07.992 [2024-12-16 14:29:22.425873] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:25:07.992 [2024-12-16 14:29:22.425876] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:25:07.992 [2024-12-16 14:29:22.425880] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:25:07.992 [2024-12-16 14:29:22.425908] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.425913] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.425916] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.992 [2024-12-16 14:29:22.425925] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:07.992 [2024-12-16 14:29:22.425940] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.992 [2024-12-16 14:29:22.432863] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.992 [2024-12-16 14:29:22.432872] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.992 [2024-12-16 14:29:22.432875] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.432878] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.992 [2024-12-16 14:29:22.432886] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:25:07.992 [2024-12-16 14:29:22.432891] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:25:07.992 [2024-12-16 14:29:22.432896] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:25:07.992 [2024-12-16 14:29:22.432904] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.432908] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.432912] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.992 [2024-12-16 14:29:22.432918] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.992 [2024-12-16 14:29:22.432930] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.992 [2024-12-16 14:29:22.433019] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.992 [2024-12-16 14:29:22.433027] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.992 [2024-12-16 14:29:22.433030] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.433033] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.992 [2024-12-16 14:29:22.433037] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:25:07.992 [2024-12-16 14:29:22.433044] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:25:07.992 [2024-12-16 14:29:22.433050] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.433053] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.992 [2024-12-16 14:29:22.433056] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.992 [2024-12-16 14:29:22.433062] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.992 [2024-12-16 14:29:22.433071] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.993 [2024-12-16 14:29:22.433133] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.993 [2024-12-16 14:29:22.433139] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.993 [2024-12-16 14:29:22.433142] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433145] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.993 [2024-12-16 14:29:22.433149] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:25:07.993 [2024-12-16 14:29:22.433156] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:25:07.993 [2024-12-16 14:29:22.433161] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433165] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433168] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.993 [2024-12-16 14:29:22.433173] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.993 [2024-12-16 14:29:22.433182] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.993 [2024-12-16 14:29:22.433246] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.993 [2024-12-16 14:29:22.433252] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.993 [2024-12-16 14:29:22.433255] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433258] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.993 [2024-12-16 14:29:22.433262] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:25:07.993 [2024-12-16 14:29:22.433270] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433273] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433276] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.993 [2024-12-16 14:29:22.433282] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.993 [2024-12-16 14:29:22.433291] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.993 [2024-12-16 14:29:22.433360] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.993 [2024-12-16 14:29:22.433366] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.993 [2024-12-16 14:29:22.433369] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433372] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.993 [2024-12-16 14:29:22.433377] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:25:07.993 [2024-12-16 14:29:22.433381] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:25:07.993 [2024-12-16 14:29:22.433388] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:25:07.993 [2024-12-16 14:29:22.433493] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:25:07.993 [2024-12-16 14:29:22.433496] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:25:07.993 [2024-12-16 14:29:22.433502] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433506] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433509] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.993 [2024-12-16 14:29:22.433514] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.993 [2024-12-16 14:29:22.433523] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.993 [2024-12-16 14:29:22.433600] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.993 [2024-12-16 14:29:22.433606] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.993 [2024-12-16 14:29:22.433608] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433611] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.993 [2024-12-16 14:29:22.433615] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:25:07.993 [2024-12-16 14:29:22.433623] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433626] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433629] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.993 [2024-12-16 14:29:22.433635] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.993 [2024-12-16 14:29:22.433644] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.993 [2024-12-16 14:29:22.433708] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.993 [2024-12-16 14:29:22.433713] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.993 [2024-12-16 14:29:22.433716] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433720] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.993 [2024-12-16 14:29:22.433723] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:25:07.993 [2024-12-16 14:29:22.433727] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:25:07.993 [2024-12-16 14:29:22.433734] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:25:07.993 [2024-12-16 14:29:22.433740] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:25:07.993 [2024-12-16 14:29:22.433748] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433751] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433754] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.993 [2024-12-16 14:29:22.433759] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.993 [2024-12-16 14:29:22.433770] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.993 [2024-12-16 14:29:22.433908] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.993 [2024-12-16 14:29:22.433913] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.993 [2024-12-16 14:29:22.433916] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433920] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xdf7040): datao=0, datal=4096, cccid=0 00:25:07.993 [2024-12-16 14:29:22.433923] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe61d50) on tqpair(0xdf7040): expected_datao=0, payload_size=4096 00:25:07.993 [2024-12-16 14:29:22.433930] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433933] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433955] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.993 [2024-12-16 14:29:22.433961] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.993 [2024-12-16 14:29:22.433963] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.993 [2024-12-16 14:29:22.433966] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.993 [2024-12-16 14:29:22.433972] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:25:07.993 [2024-12-16 14:29:22.433977] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:25:07.993 [2024-12-16 14:29:22.433980] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:25:07.993 [2024-12-16 14:29:22.433984] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:25:07.993 [2024-12-16 14:29:22.433988] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:25:07.994 [2024-12-16 14:29:22.433992] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434000] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434006] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434009] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434013] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434018] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:07.994 [2024-12-16 14:29:22.434029] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.994 [2024-12-16 14:29:22.434109] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.994 [2024-12-16 14:29:22.434114] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.994 [2024-12-16 14:29:22.434116] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434120] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe61d50) on tqpair=0xdf7040 00:25:07.994 [2024-12-16 14:29:22.434125] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434128] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434131] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434136] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.994 [2024-12-16 14:29:22.434141] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434144] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434149] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434154] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.994 [2024-12-16 14:29:22.434159] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434162] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434165] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.994 [2024-12-16 14:29:22.434175] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434178] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434181] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434185] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.994 [2024-12-16 14:29:22.434189] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434199] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434204] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434207] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434210] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434216] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.994 [2024-12-16 14:29:22.434227] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61d50, cid 0, qid 0 00:25:07.994 [2024-12-16 14:29:22.434231] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe61eb0, cid 1, qid 0 00:25:07.994 [2024-12-16 14:29:22.434235] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62010, cid 2, qid 0 00:25:07.994 [2024-12-16 14:29:22.434239] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62170, cid 3, qid 0 00:25:07.994 [2024-12-16 14:29:22.434243] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe622d0, cid 4, qid 0 00:25:07.994 [2024-12-16 14:29:22.434339] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.994 [2024-12-16 14:29:22.434344] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.994 [2024-12-16 14:29:22.434347] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434350] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe622d0) on tqpair=0xdf7040 00:25:07.994 [2024-12-16 14:29:22.434354] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:25:07.994 [2024-12-16 14:29:22.434359] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434366] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434373] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434378] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434381] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434384] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434390] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:25:07.994 [2024-12-16 14:29:22.434400] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe622d0, cid 4, qid 0 00:25:07.994 [2024-12-16 14:29:22.434465] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.994 [2024-12-16 14:29:22.434470] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.994 [2024-12-16 14:29:22.434473] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434476] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe622d0) on tqpair=0xdf7040 00:25:07.994 [2024-12-16 14:29:22.434525] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434534] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434540] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434543] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434546] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434552] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.994 [2024-12-16 14:29:22.434561] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe622d0, cid 4, qid 0 00:25:07.994 [2024-12-16 14:29:22.434632] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.994 [2024-12-16 14:29:22.434637] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.994 [2024-12-16 14:29:22.434640] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434643] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xdf7040): datao=0, datal=4096, cccid=4 00:25:07.994 [2024-12-16 14:29:22.434647] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe622d0) on tqpair(0xdf7040): expected_datao=0, payload_size=4096 00:25:07.994 [2024-12-16 14:29:22.434658] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434662] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434691] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.994 [2024-12-16 14:29:22.434697] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.994 [2024-12-16 14:29:22.434699] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434702] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe622d0) on tqpair=0xdf7040 00:25:07.994 [2024-12-16 14:29:22.434712] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:25:07.994 [2024-12-16 14:29:22.434719] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434729] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:25:07.994 [2024-12-16 14:29:22.434734] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434738] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434741] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xdf7040) 00:25:07.994 [2024-12-16 14:29:22.434746] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.994 [2024-12-16 14:29:22.434757] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe622d0, cid 4, qid 0 00:25:07.994 [2024-12-16 14:29:22.434833] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.994 [2024-12-16 14:29:22.434839] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.994 [2024-12-16 14:29:22.434842] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.994 [2024-12-16 14:29:22.434846] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xdf7040): datao=0, datal=4096, cccid=4 00:25:07.994 [2024-12-16 14:29:22.434850] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe622d0) on tqpair(0xdf7040): expected_datao=0, payload_size=4096 00:25:07.995 [2024-12-16 14:29:22.434865] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.434869] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.434896] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.995 [2024-12-16 14:29:22.434902] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.995 [2024-12-16 14:29:22.434905] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.434908] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe622d0) on tqpair=0xdf7040 00:25:07.995 [2024-12-16 14:29:22.434920] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:25:07.995 [2024-12-16 14:29:22.434928] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:25:07.995 [2024-12-16 14:29:22.434934] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.434937] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.434940] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.434946] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.995 [2024-12-16 14:29:22.434957] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe622d0, cid 4, qid 0 00:25:07.995 [2024-12-16 14:29:22.435028] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.995 [2024-12-16 14:29:22.435034] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.995 [2024-12-16 14:29:22.435037] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435040] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xdf7040): datao=0, datal=4096, cccid=4 00:25:07.995 [2024-12-16 14:29:22.435044] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe622d0) on tqpair(0xdf7040): expected_datao=0, payload_size=4096 00:25:07.995 [2024-12-16 14:29:22.435054] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435058] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435083] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.995 [2024-12-16 14:29:22.435088] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.995 [2024-12-16 14:29:22.435091] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435094] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe622d0) on tqpair=0xdf7040 00:25:07.995 [2024-12-16 14:29:22.435100] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:25:07.995 [2024-12-16 14:29:22.435107] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:25:07.995 [2024-12-16 14:29:22.435113] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:25:07.995 [2024-12-16 14:29:22.435119] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:25:07.995 [2024-12-16 14:29:22.435123] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:25:07.995 [2024-12-16 14:29:22.435127] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:25:07.995 [2024-12-16 14:29:22.435132] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:25:07.995 [2024-12-16 14:29:22.435137] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:25:07.995 [2024-12-16 14:29:22.435149] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435152] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435155] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.435160] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.995 [2024-12-16 14:29:22.435166] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435169] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435172] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.435177] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:25:07.995 [2024-12-16 14:29:22.435189] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe622d0, cid 4, qid 0 00:25:07.995 [2024-12-16 14:29:22.435194] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62430, cid 5, qid 0 00:25:07.995 [2024-12-16 14:29:22.435274] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.995 [2024-12-16 14:29:22.435280] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.995 [2024-12-16 14:29:22.435283] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435286] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe622d0) on tqpair=0xdf7040 00:25:07.995 [2024-12-16 14:29:22.435292] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.995 [2024-12-16 14:29:22.435297] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.995 [2024-12-16 14:29:22.435299] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435303] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62430) on tqpair=0xdf7040 00:25:07.995 [2024-12-16 14:29:22.435310] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435313] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435316] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.435322] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.995 [2024-12-16 14:29:22.435330] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62430, cid 5, qid 0 00:25:07.995 [2024-12-16 14:29:22.435395] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.995 [2024-12-16 14:29:22.435401] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.995 [2024-12-16 14:29:22.435404] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435407] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62430) on tqpair=0xdf7040 00:25:07.995 [2024-12-16 14:29:22.435414] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435418] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435421] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.435426] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.995 [2024-12-16 14:29:22.435435] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62430, cid 5, qid 0 00:25:07.995 [2024-12-16 14:29:22.435504] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.995 [2024-12-16 14:29:22.435510] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.995 [2024-12-16 14:29:22.435514] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435518] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62430) on tqpair=0xdf7040 00:25:07.995 [2024-12-16 14:29:22.435525] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435528] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435531] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.435536] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.995 [2024-12-16 14:29:22.435545] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62430, cid 5, qid 0 00:25:07.995 [2024-12-16 14:29:22.435618] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.995 [2024-12-16 14:29:22.435623] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.995 [2024-12-16 14:29:22.435626] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435629] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62430) on tqpair=0xdf7040 00:25:07.995 [2024-12-16 14:29:22.435640] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435644] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435646] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.435652] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.995 [2024-12-16 14:29:22.435658] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435661] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435664] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.435669] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.995 [2024-12-16 14:29:22.435675] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435678] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435681] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0xdf7040) 00:25:07.995 [2024-12-16 14:29:22.435686] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.995 [2024-12-16 14:29:22.435692] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435695] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.995 [2024-12-16 14:29:22.435698] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xdf7040) 00:25:07.996 [2024-12-16 14:29:22.435703] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.996 [2024-12-16 14:29:22.435714] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62430, cid 5, qid 0 00:25:07.996 [2024-12-16 14:29:22.435718] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe622d0, cid 4, qid 0 00:25:07.996 [2024-12-16 14:29:22.435722] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62590, cid 6, qid 0 00:25:07.996 [2024-12-16 14:29:22.435726] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe626f0, cid 7, qid 0 00:25:07.996 [2024-12-16 14:29:22.435883] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.996 [2024-12-16 14:29:22.435888] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.996 [2024-12-16 14:29:22.435891] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435896] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xdf7040): datao=0, datal=8192, cccid=5 00:25:07.996 [2024-12-16 14:29:22.435900] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe62430) on tqpair(0xdf7040): expected_datao=0, payload_size=8192 00:25:07.996 [2024-12-16 14:29:22.435912] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435915] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435923] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.996 [2024-12-16 14:29:22.435928] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.996 [2024-12-16 14:29:22.435931] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435934] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xdf7040): datao=0, datal=512, cccid=4 00:25:07.996 [2024-12-16 14:29:22.435937] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe622d0) on tqpair(0xdf7040): expected_datao=0, payload_size=512 00:25:07.996 [2024-12-16 14:29:22.435943] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435946] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435951] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.996 [2024-12-16 14:29:22.435956] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.996 [2024-12-16 14:29:22.435959] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435962] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xdf7040): datao=0, datal=512, cccid=6 00:25:07.996 [2024-12-16 14:29:22.435965] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe62590) on tqpair(0xdf7040): expected_datao=0, payload_size=512 00:25:07.996 [2024-12-16 14:29:22.435971] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435974] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435979] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:25:07.996 [2024-12-16 14:29:22.435984] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:25:07.996 [2024-12-16 14:29:22.435987] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.435990] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xdf7040): datao=0, datal=4096, cccid=7 00:25:07.996 [2024-12-16 14:29:22.435993] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xe626f0) on tqpair(0xdf7040): expected_datao=0, payload_size=4096 00:25:07.996 [2024-12-16 14:29:22.435999] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.436002] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.436010] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.996 [2024-12-16 14:29:22.436014] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.996 [2024-12-16 14:29:22.436017] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.436020] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62430) on tqpair=0xdf7040 00:25:07.996 [2024-12-16 14:29:22.436031] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.996 [2024-12-16 14:29:22.436036] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.996 [2024-12-16 14:29:22.436039] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.436042] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe622d0) on tqpair=0xdf7040 00:25:07.996 [2024-12-16 14:29:22.436050] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.996 [2024-12-16 14:29:22.436055] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.996 [2024-12-16 14:29:22.436058] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.436061] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62590) on tqpair=0xdf7040 00:25:07.996 [2024-12-16 14:29:22.436066] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.996 [2024-12-16 14:29:22.436072] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.996 [2024-12-16 14:29:22.436075] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.996 [2024-12-16 14:29:22.436079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe626f0) on tqpair=0xdf7040 00:25:07.996 ===================================================== 00:25:07.996 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:07.996 ===================================================== 00:25:07.996 Controller Capabilities/Features 00:25:07.996 ================================ 00:25:07.996 Vendor ID: 8086 00:25:07.996 Subsystem Vendor ID: 8086 00:25:07.996 Serial Number: SPDK00000000000001 00:25:07.996 Model Number: SPDK bdev Controller 00:25:07.996 Firmware Version: 24.01.1 00:25:07.996 Recommended Arb Burst: 6 00:25:07.996 IEEE OUI Identifier: e4 d2 5c 00:25:07.996 Multi-path I/O 00:25:07.996 May have multiple subsystem ports: Yes 00:25:07.996 May have multiple controllers: Yes 00:25:07.996 Associated with SR-IOV VF: No 00:25:07.996 Max Data Transfer Size: 131072 00:25:07.996 Max Number of Namespaces: 32 00:25:07.996 Max Number of I/O Queues: 127 00:25:07.996 NVMe Specification Version (VS): 1.3 00:25:07.996 NVMe Specification Version (Identify): 1.3 00:25:07.996 Maximum Queue Entries: 128 00:25:07.996 Contiguous Queues Required: Yes 00:25:07.996 Arbitration Mechanisms Supported 00:25:07.996 Weighted Round Robin: Not Supported 00:25:07.996 Vendor Specific: Not Supported 00:25:07.996 Reset Timeout: 15000 ms 00:25:07.996 Doorbell Stride: 4 bytes 00:25:07.996 NVM Subsystem Reset: Not Supported 00:25:07.996 Command Sets Supported 00:25:07.996 NVM Command Set: Supported 00:25:07.996 Boot Partition: Not Supported 00:25:07.996 Memory Page Size Minimum: 4096 bytes 00:25:07.996 Memory Page Size Maximum: 4096 bytes 00:25:07.996 Persistent Memory Region: Not Supported 00:25:07.996 Optional Asynchronous Events Supported 00:25:07.996 Namespace Attribute Notices: Supported 00:25:07.996 Firmware Activation Notices: Not Supported 00:25:07.996 ANA Change Notices: Not Supported 00:25:07.996 PLE Aggregate Log Change Notices: Not Supported 00:25:07.996 LBA Status Info Alert Notices: Not Supported 00:25:07.996 EGE Aggregate Log Change Notices: Not Supported 00:25:07.996 Normal NVM Subsystem Shutdown event: Not Supported 00:25:07.996 Zone Descriptor Change Notices: Not Supported 00:25:07.996 Discovery Log Change Notices: Not Supported 00:25:07.996 Controller Attributes 00:25:07.996 128-bit Host Identifier: Supported 00:25:07.996 Non-Operational Permissive Mode: Not Supported 00:25:07.996 NVM Sets: Not Supported 00:25:07.996 Read Recovery Levels: Not Supported 00:25:07.996 Endurance Groups: Not Supported 00:25:07.996 Predictable Latency Mode: Not Supported 00:25:07.996 Traffic Based Keep ALive: Not Supported 00:25:07.996 Namespace Granularity: Not Supported 00:25:07.996 SQ Associations: Not Supported 00:25:07.996 UUID List: Not Supported 00:25:07.996 Multi-Domain Subsystem: Not Supported 00:25:07.996 Fixed Capacity Management: Not Supported 00:25:07.996 Variable Capacity Management: Not Supported 00:25:07.996 Delete Endurance Group: Not Supported 00:25:07.996 Delete NVM Set: Not Supported 00:25:07.996 Extended LBA Formats Supported: Not Supported 00:25:07.996 Flexible Data Placement Supported: Not Supported 00:25:07.996 00:25:07.996 Controller Memory Buffer Support 00:25:07.996 ================================ 00:25:07.996 Supported: No 00:25:07.996 00:25:07.996 Persistent Memory Region Support 00:25:07.996 ================================ 00:25:07.996 Supported: No 00:25:07.996 00:25:07.996 Admin Command Set Attributes 00:25:07.996 ============================ 00:25:07.996 Security Send/Receive: Not Supported 00:25:07.996 Format NVM: Not Supported 00:25:07.996 Firmware Activate/Download: Not Supported 00:25:07.997 Namespace Management: Not Supported 00:25:07.997 Device Self-Test: Not Supported 00:25:07.997 Directives: Not Supported 00:25:07.997 NVMe-MI: Not Supported 00:25:07.997 Virtualization Management: Not Supported 00:25:07.997 Doorbell Buffer Config: Not Supported 00:25:07.997 Get LBA Status Capability: Not Supported 00:25:07.997 Command & Feature Lockdown Capability: Not Supported 00:25:07.997 Abort Command Limit: 4 00:25:07.997 Async Event Request Limit: 4 00:25:07.997 Number of Firmware Slots: N/A 00:25:07.997 Firmware Slot 1 Read-Only: N/A 00:25:07.997 Firmware Activation Without Reset: N/A 00:25:07.997 Multiple Update Detection Support: N/A 00:25:07.997 Firmware Update Granularity: No Information Provided 00:25:07.997 Per-Namespace SMART Log: No 00:25:07.997 Asymmetric Namespace Access Log Page: Not Supported 00:25:07.997 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:25:07.997 Command Effects Log Page: Supported 00:25:07.997 Get Log Page Extended Data: Supported 00:25:07.997 Telemetry Log Pages: Not Supported 00:25:07.997 Persistent Event Log Pages: Not Supported 00:25:07.997 Supported Log Pages Log Page: May Support 00:25:07.997 Commands Supported & Effects Log Page: Not Supported 00:25:07.997 Feature Identifiers & Effects Log Page:May Support 00:25:07.997 NVMe-MI Commands & Effects Log Page: May Support 00:25:07.997 Data Area 4 for Telemetry Log: Not Supported 00:25:07.997 Error Log Page Entries Supported: 128 00:25:07.997 Keep Alive: Supported 00:25:07.997 Keep Alive Granularity: 10000 ms 00:25:07.997 00:25:07.997 NVM Command Set Attributes 00:25:07.997 ========================== 00:25:07.997 Submission Queue Entry Size 00:25:07.997 Max: 64 00:25:07.997 Min: 64 00:25:07.997 Completion Queue Entry Size 00:25:07.997 Max: 16 00:25:07.997 Min: 16 00:25:07.997 Number of Namespaces: 32 00:25:07.997 Compare Command: Supported 00:25:07.997 Write Uncorrectable Command: Not Supported 00:25:07.997 Dataset Management Command: Supported 00:25:07.997 Write Zeroes Command: Supported 00:25:07.997 Set Features Save Field: Not Supported 00:25:07.997 Reservations: Supported 00:25:07.997 Timestamp: Not Supported 00:25:07.997 Copy: Supported 00:25:07.997 Volatile Write Cache: Present 00:25:07.997 Atomic Write Unit (Normal): 1 00:25:07.997 Atomic Write Unit (PFail): 1 00:25:07.997 Atomic Compare & Write Unit: 1 00:25:07.997 Fused Compare & Write: Supported 00:25:07.997 Scatter-Gather List 00:25:07.997 SGL Command Set: Supported 00:25:07.997 SGL Keyed: Supported 00:25:07.997 SGL Bit Bucket Descriptor: Not Supported 00:25:07.997 SGL Metadata Pointer: Not Supported 00:25:07.997 Oversized SGL: Not Supported 00:25:07.997 SGL Metadata Address: Not Supported 00:25:07.997 SGL Offset: Supported 00:25:07.997 Transport SGL Data Block: Not Supported 00:25:07.997 Replay Protected Memory Block: Not Supported 00:25:07.997 00:25:07.997 Firmware Slot Information 00:25:07.997 ========================= 00:25:07.997 Active slot: 1 00:25:07.997 Slot 1 Firmware Revision: 24.01.1 00:25:07.997 00:25:07.997 00:25:07.997 Commands Supported and Effects 00:25:07.997 ============================== 00:25:07.997 Admin Commands 00:25:07.997 -------------- 00:25:07.997 Get Log Page (02h): Supported 00:25:07.997 Identify (06h): Supported 00:25:07.997 Abort (08h): Supported 00:25:07.997 Set Features (09h): Supported 00:25:07.997 Get Features (0Ah): Supported 00:25:07.997 Asynchronous Event Request (0Ch): Supported 00:25:07.997 Keep Alive (18h): Supported 00:25:07.997 I/O Commands 00:25:07.997 ------------ 00:25:07.997 Flush (00h): Supported LBA-Change 00:25:07.997 Write (01h): Supported LBA-Change 00:25:07.997 Read (02h): Supported 00:25:07.997 Compare (05h): Supported 00:25:07.997 Write Zeroes (08h): Supported LBA-Change 00:25:07.997 Dataset Management (09h): Supported LBA-Change 00:25:07.997 Copy (19h): Supported LBA-Change 00:25:07.997 Unknown (79h): Supported LBA-Change 00:25:07.997 Unknown (7Ah): Supported 00:25:07.997 00:25:07.997 Error Log 00:25:07.997 ========= 00:25:07.997 00:25:07.997 Arbitration 00:25:07.997 =========== 00:25:07.997 Arbitration Burst: 1 00:25:07.997 00:25:07.997 Power Management 00:25:07.997 ================ 00:25:07.997 Number of Power States: 1 00:25:07.997 Current Power State: Power State #0 00:25:07.997 Power State #0: 00:25:07.997 Max Power: 0.00 W 00:25:07.997 Non-Operational State: Operational 00:25:07.997 Entry Latency: Not Reported 00:25:07.997 Exit Latency: Not Reported 00:25:07.997 Relative Read Throughput: 0 00:25:07.997 Relative Read Latency: 0 00:25:07.997 Relative Write Throughput: 0 00:25:07.997 Relative Write Latency: 0 00:25:07.997 Idle Power: Not Reported 00:25:07.997 Active Power: Not Reported 00:25:07.997 Non-Operational Permissive Mode: Not Supported 00:25:07.997 00:25:07.997 Health Information 00:25:07.997 ================== 00:25:07.997 Critical Warnings: 00:25:07.997 Available Spare Space: OK 00:25:07.997 Temperature: OK 00:25:07.997 Device Reliability: OK 00:25:07.997 Read Only: No 00:25:07.997 Volatile Memory Backup: OK 00:25:07.997 Current Temperature: 0 Kelvin (-273 Celsius) 00:25:07.997 Temperature Threshold: [2024-12-16 14:29:22.436163] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.997 [2024-12-16 14:29:22.436168] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.997 [2024-12-16 14:29:22.436171] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0xdf7040) 00:25:07.997 [2024-12-16 14:29:22.436177] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.997 [2024-12-16 14:29:22.436188] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe626f0, cid 7, qid 0 00:25:07.997 [2024-12-16 14:29:22.436266] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.997 [2024-12-16 14:29:22.436272] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.997 [2024-12-16 14:29:22.436275] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.997 [2024-12-16 14:29:22.436278] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe626f0) on tqpair=0xdf7040 00:25:07.997 [2024-12-16 14:29:22.436304] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:25:07.997 [2024-12-16 14:29:22.436314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.997 [2024-12-16 14:29:22.436320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.997 [2024-12-16 14:29:22.436325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.997 [2024-12-16 14:29:22.436330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:07.997 [2024-12-16 14:29:22.436337] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.997 [2024-12-16 14:29:22.436340] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436343] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xdf7040) 00:25:07.998 [2024-12-16 14:29:22.436349] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.998 [2024-12-16 14:29:22.436360] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62170, cid 3, qid 0 00:25:07.998 [2024-12-16 14:29:22.436432] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.998 [2024-12-16 14:29:22.436437] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.998 [2024-12-16 14:29:22.436440] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436443] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62170) on tqpair=0xdf7040 00:25:07.998 [2024-12-16 14:29:22.436449] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436452] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436455] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xdf7040) 00:25:07.998 [2024-12-16 14:29:22.436460] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.998 [2024-12-16 14:29:22.436472] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62170, cid 3, qid 0 00:25:07.998 [2024-12-16 14:29:22.436548] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.998 [2024-12-16 14:29:22.436554] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.998 [2024-12-16 14:29:22.436557] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436560] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62170) on tqpair=0xdf7040 00:25:07.998 [2024-12-16 14:29:22.436565] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:25:07.998 [2024-12-16 14:29:22.436569] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:25:07.998 [2024-12-16 14:29:22.436577] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436580] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436584] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xdf7040) 00:25:07.998 [2024-12-16 14:29:22.436589] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.998 [2024-12-16 14:29:22.436598] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62170, cid 3, qid 0 00:25:07.998 [2024-12-16 14:29:22.436658] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.998 [2024-12-16 14:29:22.436664] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.998 [2024-12-16 14:29:22.436667] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436670] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62170) on tqpair=0xdf7040 00:25:07.998 [2024-12-16 14:29:22.436677] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436681] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436684] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xdf7040) 00:25:07.998 [2024-12-16 14:29:22.436690] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.998 [2024-12-16 14:29:22.436698] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62170, cid 3, qid 0 00:25:07.998 [2024-12-16 14:29:22.436774] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.998 [2024-12-16 14:29:22.436779] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.998 [2024-12-16 14:29:22.436782] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436785] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62170) on tqpair=0xdf7040 00:25:07.998 [2024-12-16 14:29:22.436794] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436797] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.436800] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xdf7040) 00:25:07.998 [2024-12-16 14:29:22.436806] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.998 [2024-12-16 14:29:22.436815] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62170, cid 3, qid 0 00:25:07.998 [2024-12-16 14:29:22.440861] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.998 [2024-12-16 14:29:22.440876] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.998 [2024-12-16 14:29:22.440879] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.440882] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62170) on tqpair=0xdf7040 00:25:07.998 [2024-12-16 14:29:22.440891] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.440895] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.440898] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xdf7040) 00:25:07.998 [2024-12-16 14:29:22.440904] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:07.998 [2024-12-16 14:29:22.440915] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xe62170, cid 3, qid 0 00:25:07.998 [2024-12-16 14:29:22.440982] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:25:07.998 [2024-12-16 14:29:22.440988] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:25:07.998 [2024-12-16 14:29:22.440993] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:25:07.998 [2024-12-16 14:29:22.440996] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xe62170) on tqpair=0xdf7040 00:25:07.998 [2024-12-16 14:29:22.441003] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:25:07.998 0 Kelvin (-273 Celsius) 00:25:07.998 Available Spare: 0% 00:25:07.998 Available Spare Threshold: 0% 00:25:07.998 Life Percentage Used: 0% 00:25:07.998 Data Units Read: 0 00:25:07.998 Data Units Written: 0 00:25:07.998 Host Read Commands: 0 00:25:07.998 Host Write Commands: 0 00:25:07.998 Controller Busy Time: 0 minutes 00:25:07.998 Power Cycles: 0 00:25:07.998 Power On Hours: 0 hours 00:25:07.998 Unsafe Shutdowns: 0 00:25:07.998 Unrecoverable Media Errors: 0 00:25:07.998 Lifetime Error Log Entries: 0 00:25:07.998 Warning Temperature Time: 0 minutes 00:25:07.998 Critical Temperature Time: 0 minutes 00:25:07.998 00:25:07.998 Number of Queues 00:25:07.998 ================ 00:25:07.998 Number of I/O Submission Queues: 127 00:25:07.998 Number of I/O Completion Queues: 127 00:25:07.998 00:25:07.998 Active Namespaces 00:25:07.998 ================= 00:25:07.998 Namespace ID:1 00:25:07.998 Error Recovery Timeout: Unlimited 00:25:07.998 Command Set Identifier: NVM (00h) 00:25:07.998 Deallocate: Supported 00:25:07.998 Deallocated/Unwritten Error: Not Supported 00:25:07.998 Deallocated Read Value: Unknown 00:25:07.998 Deallocate in Write Zeroes: Not Supported 00:25:07.998 Deallocated Guard Field: 0xFFFF 00:25:07.998 Flush: Supported 00:25:07.998 Reservation: Supported 00:25:07.998 Namespace Sharing Capabilities: Multiple Controllers 00:25:07.998 Size (in LBAs): 131072 (0GiB) 00:25:07.998 Capacity (in LBAs): 131072 (0GiB) 00:25:07.998 Utilization (in LBAs): 131072 (0GiB) 00:25:07.998 NGUID: ABCDEF0123456789ABCDEF0123456789 00:25:07.998 EUI64: ABCDEF0123456789 00:25:07.998 UUID: 010f4752-efe1-4940-be16-16e18023e589 00:25:07.998 Thin Provisioning: Not Supported 00:25:07.998 Per-NS Atomic Units: Yes 00:25:07.998 Atomic Boundary Size (Normal): 0 00:25:07.998 Atomic Boundary Size (PFail): 0 00:25:07.998 Atomic Boundary Offset: 0 00:25:07.998 Maximum Single Source Range Length: 65535 00:25:07.998 Maximum Copy Length: 65535 00:25:07.998 Maximum Source Range Count: 1 00:25:07.998 NGUID/EUI64 Never Reused: No 00:25:07.998 Namespace Write Protected: No 00:25:07.998 Number of LBA Formats: 1 00:25:07.998 Current LBA Format: LBA Format #00 00:25:07.998 LBA Format #00: Data Size: 512 Metadata Size: 0 00:25:07.998 00:25:07.998 14:29:22 -- host/identify.sh@51 -- # sync 00:25:07.998 14:29:22 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:07.998 14:29:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:07.998 14:29:22 -- common/autotest_common.sh@10 -- # set +x 00:25:07.998 14:29:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:07.998 14:29:22 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:25:07.998 14:29:22 -- host/identify.sh@56 -- # nvmftestfini 00:25:07.998 14:29:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:07.998 14:29:22 -- nvmf/common.sh@116 -- # sync 00:25:07.998 14:29:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:07.998 14:29:22 -- nvmf/common.sh@119 -- # set +e 00:25:07.998 14:29:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:07.998 14:29:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:07.998 rmmod nvme_tcp 00:25:07.998 rmmod nvme_fabrics 00:25:07.998 rmmod nvme_keyring 00:25:07.998 14:29:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:07.998 14:29:22 -- nvmf/common.sh@123 -- # set -e 00:25:07.998 14:29:22 -- nvmf/common.sh@124 -- # return 0 00:25:07.999 14:29:22 -- nvmf/common.sh@477 -- # '[' -n 487599 ']' 00:25:07.999 14:29:22 -- nvmf/common.sh@478 -- # killprocess 487599 00:25:07.999 14:29:22 -- common/autotest_common.sh@936 -- # '[' -z 487599 ']' 00:25:07.999 14:29:22 -- common/autotest_common.sh@940 -- # kill -0 487599 00:25:07.999 14:29:22 -- common/autotest_common.sh@941 -- # uname 00:25:07.999 14:29:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:07.999 14:29:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 487599 00:25:08.258 14:29:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:08.258 14:29:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:08.258 14:29:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 487599' 00:25:08.258 killing process with pid 487599 00:25:08.258 14:29:22 -- common/autotest_common.sh@955 -- # kill 487599 00:25:08.258 [2024-12-16 14:29:22.595025] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:08.258 14:29:22 -- common/autotest_common.sh@960 -- # wait 487599 00:25:08.258 14:29:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:08.258 14:29:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:08.258 14:29:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:08.258 14:29:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:08.258 14:29:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:08.258 14:29:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:08.258 14:29:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:08.258 14:29:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:10.794 14:29:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:10.794 00:25:10.794 real 0m9.009s 00:25:10.794 user 0m7.298s 00:25:10.794 sys 0m4.232s 00:25:10.794 14:29:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:10.794 14:29:24 -- common/autotest_common.sh@10 -- # set +x 00:25:10.794 ************************************ 00:25:10.794 END TEST nvmf_identify 00:25:10.794 ************************************ 00:25:10.794 14:29:24 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:10.794 14:29:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:10.794 14:29:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:10.794 14:29:24 -- common/autotest_common.sh@10 -- # set +x 00:25:10.794 ************************************ 00:25:10.794 START TEST nvmf_perf 00:25:10.794 ************************************ 00:25:10.794 14:29:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:25:10.794 * Looking for test storage... 00:25:10.794 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:10.794 14:29:25 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:10.794 14:29:25 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:10.794 14:29:25 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:10.794 14:29:25 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:10.794 14:29:25 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:10.794 14:29:25 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:10.794 14:29:25 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:10.794 14:29:25 -- scripts/common.sh@335 -- # IFS=.-: 00:25:10.794 14:29:25 -- scripts/common.sh@335 -- # read -ra ver1 00:25:10.794 14:29:25 -- scripts/common.sh@336 -- # IFS=.-: 00:25:10.794 14:29:25 -- scripts/common.sh@336 -- # read -ra ver2 00:25:10.794 14:29:25 -- scripts/common.sh@337 -- # local 'op=<' 00:25:10.794 14:29:25 -- scripts/common.sh@339 -- # ver1_l=2 00:25:10.794 14:29:25 -- scripts/common.sh@340 -- # ver2_l=1 00:25:10.794 14:29:25 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:10.794 14:29:25 -- scripts/common.sh@343 -- # case "$op" in 00:25:10.794 14:29:25 -- scripts/common.sh@344 -- # : 1 00:25:10.794 14:29:25 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:10.794 14:29:25 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:10.794 14:29:25 -- scripts/common.sh@364 -- # decimal 1 00:25:10.794 14:29:25 -- scripts/common.sh@352 -- # local d=1 00:25:10.794 14:29:25 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:10.794 14:29:25 -- scripts/common.sh@354 -- # echo 1 00:25:10.794 14:29:25 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:10.794 14:29:25 -- scripts/common.sh@365 -- # decimal 2 00:25:10.794 14:29:25 -- scripts/common.sh@352 -- # local d=2 00:25:10.794 14:29:25 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:10.794 14:29:25 -- scripts/common.sh@354 -- # echo 2 00:25:10.794 14:29:25 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:10.794 14:29:25 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:10.794 14:29:25 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:10.794 14:29:25 -- scripts/common.sh@367 -- # return 0 00:25:10.794 14:29:25 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:10.794 14:29:25 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:10.794 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:10.794 --rc genhtml_branch_coverage=1 00:25:10.794 --rc genhtml_function_coverage=1 00:25:10.794 --rc genhtml_legend=1 00:25:10.794 --rc geninfo_all_blocks=1 00:25:10.794 --rc geninfo_unexecuted_blocks=1 00:25:10.794 00:25:10.794 ' 00:25:10.794 14:29:25 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:10.794 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:10.794 --rc genhtml_branch_coverage=1 00:25:10.794 --rc genhtml_function_coverage=1 00:25:10.794 --rc genhtml_legend=1 00:25:10.794 --rc geninfo_all_blocks=1 00:25:10.794 --rc geninfo_unexecuted_blocks=1 00:25:10.794 00:25:10.794 ' 00:25:10.794 14:29:25 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:10.794 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:10.794 --rc genhtml_branch_coverage=1 00:25:10.794 --rc genhtml_function_coverage=1 00:25:10.794 --rc genhtml_legend=1 00:25:10.794 --rc geninfo_all_blocks=1 00:25:10.794 --rc geninfo_unexecuted_blocks=1 00:25:10.794 00:25:10.794 ' 00:25:10.794 14:29:25 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:10.794 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:10.794 --rc genhtml_branch_coverage=1 00:25:10.794 --rc genhtml_function_coverage=1 00:25:10.794 --rc genhtml_legend=1 00:25:10.794 --rc geninfo_all_blocks=1 00:25:10.794 --rc geninfo_unexecuted_blocks=1 00:25:10.794 00:25:10.794 ' 00:25:10.794 14:29:25 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:10.794 14:29:25 -- nvmf/common.sh@7 -- # uname -s 00:25:10.794 14:29:25 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:10.794 14:29:25 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:10.794 14:29:25 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:10.794 14:29:25 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:10.794 14:29:25 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:10.794 14:29:25 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:10.794 14:29:25 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:10.794 14:29:25 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:10.794 14:29:25 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:10.794 14:29:25 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:10.794 14:29:25 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:25:10.794 14:29:25 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:25:10.794 14:29:25 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:10.794 14:29:25 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:10.794 14:29:25 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:10.794 14:29:25 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:10.794 14:29:25 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:10.794 14:29:25 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:10.794 14:29:25 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:10.794 14:29:25 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:10.794 14:29:25 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:10.794 14:29:25 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:10.794 14:29:25 -- paths/export.sh@5 -- # export PATH 00:25:10.794 14:29:25 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:10.794 14:29:25 -- nvmf/common.sh@46 -- # : 0 00:25:10.794 14:29:25 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:10.794 14:29:25 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:10.794 14:29:25 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:10.794 14:29:25 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:10.794 14:29:25 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:10.794 14:29:25 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:10.794 14:29:25 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:10.794 14:29:25 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:10.794 14:29:25 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:25:10.794 14:29:25 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:25:10.794 14:29:25 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:25:10.794 14:29:25 -- host/perf.sh@17 -- # nvmftestinit 00:25:10.794 14:29:25 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:10.794 14:29:25 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:10.794 14:29:25 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:10.794 14:29:25 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:10.794 14:29:25 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:10.794 14:29:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:10.794 14:29:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:10.794 14:29:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:10.794 14:29:25 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:10.794 14:29:25 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:10.794 14:29:25 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:10.794 14:29:25 -- common/autotest_common.sh@10 -- # set +x 00:25:16.070 14:29:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:16.070 14:29:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:16.070 14:29:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:16.070 14:29:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:16.070 14:29:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:16.070 14:29:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:16.070 14:29:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:16.070 14:29:30 -- nvmf/common.sh@294 -- # net_devs=() 00:25:16.070 14:29:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:16.070 14:29:30 -- nvmf/common.sh@295 -- # e810=() 00:25:16.070 14:29:30 -- nvmf/common.sh@295 -- # local -ga e810 00:25:16.070 14:29:30 -- nvmf/common.sh@296 -- # x722=() 00:25:16.070 14:29:30 -- nvmf/common.sh@296 -- # local -ga x722 00:25:16.070 14:29:30 -- nvmf/common.sh@297 -- # mlx=() 00:25:16.070 14:29:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:16.070 14:29:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:16.070 14:29:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:16.070 14:29:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:16.070 14:29:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:16.070 14:29:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:16.070 14:29:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:16.071 14:29:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:16.071 14:29:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:16.071 14:29:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:16.071 14:29:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:16.071 14:29:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:16.071 14:29:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:16.071 14:29:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:16.071 14:29:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:16.071 14:29:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:16.071 14:29:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:25:16.071 Found 0000:af:00.0 (0x8086 - 0x159b) 00:25:16.071 14:29:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:16.071 14:29:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:25:16.071 Found 0000:af:00.1 (0x8086 - 0x159b) 00:25:16.071 14:29:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:16.071 14:29:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:16.071 14:29:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:16.071 14:29:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:16.071 14:29:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:16.071 14:29:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:25:16.071 Found net devices under 0000:af:00.0: cvl_0_0 00:25:16.071 14:29:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:16.071 14:29:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:16.071 14:29:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:16.071 14:29:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:16.071 14:29:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:16.071 14:29:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:25:16.071 Found net devices under 0000:af:00.1: cvl_0_1 00:25:16.071 14:29:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:16.071 14:29:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:16.071 14:29:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:16.071 14:29:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:16.071 14:29:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:16.071 14:29:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:16.071 14:29:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:16.071 14:29:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:16.071 14:29:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:16.071 14:29:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:16.071 14:29:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:16.071 14:29:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:16.071 14:29:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:16.071 14:29:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:16.071 14:29:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:16.071 14:29:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:16.071 14:29:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:16.071 14:29:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:16.071 14:29:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:16.071 14:29:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:16.071 14:29:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:16.071 14:29:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:16.071 14:29:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:16.071 14:29:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:16.071 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:16.071 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.282 ms 00:25:16.071 00:25:16.071 --- 10.0.0.2 ping statistics --- 00:25:16.071 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:16.071 rtt min/avg/max/mdev = 0.282/0.282/0.282/0.000 ms 00:25:16.071 14:29:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:16.071 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:16.071 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:25:16.071 00:25:16.071 --- 10.0.0.1 ping statistics --- 00:25:16.071 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:16.071 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:25:16.071 14:29:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:16.071 14:29:30 -- nvmf/common.sh@410 -- # return 0 00:25:16.071 14:29:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:16.071 14:29:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:16.071 14:29:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:16.071 14:29:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:16.071 14:29:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:16.071 14:29:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:16.331 14:29:30 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:25:16.331 14:29:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:16.331 14:29:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:16.331 14:29:30 -- common/autotest_common.sh@10 -- # set +x 00:25:16.331 14:29:30 -- nvmf/common.sh@469 -- # nvmfpid=491225 00:25:16.331 14:29:30 -- nvmf/common.sh@470 -- # waitforlisten 491225 00:25:16.331 14:29:30 -- common/autotest_common.sh@829 -- # '[' -z 491225 ']' 00:25:16.331 14:29:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:16.331 14:29:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:16.331 14:29:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:16.331 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:16.331 14:29:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:16.331 14:29:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:16.331 14:29:30 -- common/autotest_common.sh@10 -- # set +x 00:25:16.331 [2024-12-16 14:29:30.699443] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:16.331 [2024-12-16 14:29:30.699487] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:16.331 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.331 [2024-12-16 14:29:30.756995] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:16.331 [2024-12-16 14:29:30.834000] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:16.331 [2024-12-16 14:29:30.834107] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:16.331 [2024-12-16 14:29:30.834114] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:16.331 [2024-12-16 14:29:30.834121] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:16.331 [2024-12-16 14:29:30.834166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:16.331 [2024-12-16 14:29:30.834257] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:16.331 [2024-12-16 14:29:30.834281] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:16.331 [2024-12-16 14:29:30.834282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:17.268 14:29:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:17.268 14:29:31 -- common/autotest_common.sh@862 -- # return 0 00:25:17.268 14:29:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:17.268 14:29:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:17.268 14:29:31 -- common/autotest_common.sh@10 -- # set +x 00:25:17.268 14:29:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:17.268 14:29:31 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:25:17.268 14:29:31 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:25:20.557 14:29:34 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:25:20.557 14:29:34 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:25:20.557 14:29:34 -- host/perf.sh@30 -- # local_nvme_trid=0000:5e:00.0 00:25:20.557 14:29:34 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:25:20.557 14:29:34 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:25:20.557 14:29:34 -- host/perf.sh@33 -- # '[' -n 0000:5e:00.0 ']' 00:25:20.557 14:29:34 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:25:20.557 14:29:34 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:25:20.557 14:29:34 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:25:20.816 [2024-12-16 14:29:35.150010] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:20.816 14:29:35 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:20.816 14:29:35 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:20.816 14:29:35 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:21.074 14:29:35 -- host/perf.sh@45 -- # for bdev in $bdevs 00:25:21.074 14:29:35 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:25:21.333 14:29:35 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:21.333 [2024-12-16 14:29:35.898966] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:21.592 14:29:35 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:25:21.592 14:29:36 -- host/perf.sh@52 -- # '[' -n 0000:5e:00.0 ']' 00:25:21.592 14:29:36 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:25:21.592 14:29:36 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:25:21.592 14:29:36 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:5e:00.0' 00:25:22.969 Initializing NVMe Controllers 00:25:22.969 Attached to NVMe Controller at 0000:5e:00.0 [8086:0a54] 00:25:22.969 Associating PCIE (0000:5e:00.0) NSID 1 with lcore 0 00:25:22.969 Initialization complete. Launching workers. 00:25:22.969 ======================================================== 00:25:22.969 Latency(us) 00:25:22.969 Device Information : IOPS MiB/s Average min max 00:25:22.969 PCIE (0000:5e:00.0) NSID 1 from core 0: 101665.08 397.13 314.38 16.22 4283.60 00:25:22.969 ======================================================== 00:25:22.969 Total : 101665.08 397.13 314.38 16.22 4283.60 00:25:22.969 00:25:22.969 14:29:37 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:22.969 EAL: No free 2048 kB hugepages reported on node 1 00:25:24.346 Initializing NVMe Controllers 00:25:24.346 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:24.346 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:24.346 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:24.346 Initialization complete. Launching workers. 00:25:24.346 ======================================================== 00:25:24.346 Latency(us) 00:25:24.346 Device Information : IOPS MiB/s Average min max 00:25:24.346 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 121.57 0.47 8251.83 115.11 45938.56 00:25:24.346 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 51.82 0.20 19605.29 7958.20 54866.49 00:25:24.346 ======================================================== 00:25:24.346 Total : 173.39 0.68 11644.82 115.11 54866.49 00:25:24.346 00:25:24.346 14:29:38 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:24.346 EAL: No free 2048 kB hugepages reported on node 1 00:25:25.281 Initializing NVMe Controllers 00:25:25.281 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:25.281 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:25.281 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:25.281 Initialization complete. Launching workers. 00:25:25.281 ======================================================== 00:25:25.281 Latency(us) 00:25:25.281 Device Information : IOPS MiB/s Average min max 00:25:25.281 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 11691.86 45.67 2736.74 412.34 8735.39 00:25:25.281 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 3795.67 14.83 8443.89 5787.14 16462.66 00:25:25.281 ======================================================== 00:25:25.281 Total : 15487.53 60.50 4135.44 412.34 16462.66 00:25:25.281 00:25:25.281 14:29:39 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:25:25.281 14:29:39 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:25:25.281 14:29:39 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:25.281 EAL: No free 2048 kB hugepages reported on node 1 00:25:27.815 Initializing NVMe Controllers 00:25:27.815 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:27.815 Controller IO queue size 128, less than required. 00:25:27.815 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:27.815 Controller IO queue size 128, less than required. 00:25:27.815 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:27.815 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:27.815 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:27.815 Initialization complete. Launching workers. 00:25:27.815 ======================================================== 00:25:27.815 Latency(us) 00:25:27.815 Device Information : IOPS MiB/s Average min max 00:25:27.815 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1853.65 463.41 70291.20 47733.72 127179.35 00:25:27.815 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 602.91 150.73 220447.86 63295.80 335088.21 00:25:27.815 ======================================================== 00:25:27.815 Total : 2456.56 614.14 107143.95 47733.72 335088.21 00:25:27.815 00:25:27.815 14:29:42 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:25:27.815 EAL: No free 2048 kB hugepages reported on node 1 00:25:28.074 No valid NVMe controllers or AIO or URING devices found 00:25:28.074 Initializing NVMe Controllers 00:25:28.074 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:28.074 Controller IO queue size 128, less than required. 00:25:28.074 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:28.074 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:25:28.074 Controller IO queue size 128, less than required. 00:25:28.074 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:28.074 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:25:28.074 WARNING: Some requested NVMe devices were skipped 00:25:28.074 14:29:42 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:25:28.074 EAL: No free 2048 kB hugepages reported on node 1 00:25:30.611 Initializing NVMe Controllers 00:25:30.611 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:30.611 Controller IO queue size 128, less than required. 00:25:30.611 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:30.611 Controller IO queue size 128, less than required. 00:25:30.611 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:25:30.611 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:30.611 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:25:30.611 Initialization complete. Launching workers. 00:25:30.611 00:25:30.611 ==================== 00:25:30.611 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:25:30.611 TCP transport: 00:25:30.611 polls: 16214 00:25:30.611 idle_polls: 12226 00:25:30.611 sock_completions: 3988 00:25:30.611 nvme_completions: 6511 00:25:30.611 submitted_requests: 9941 00:25:30.611 queued_requests: 1 00:25:30.611 00:25:30.611 ==================== 00:25:30.611 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:25:30.611 TCP transport: 00:25:30.611 polls: 16479 00:25:30.611 idle_polls: 11545 00:25:30.611 sock_completions: 4934 00:25:30.611 nvme_completions: 6992 00:25:30.611 submitted_requests: 10638 00:25:30.611 queued_requests: 1 00:25:30.611 ======================================================== 00:25:30.611 Latency(us) 00:25:30.611 Device Information : IOPS MiB/s Average min max 00:25:30.611 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1688.71 422.18 77534.97 41842.31 127659.83 00:25:30.611 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1808.52 452.13 70967.17 32983.43 103092.38 00:25:30.611 ======================================================== 00:25:30.611 Total : 3497.23 874.31 74138.58 32983.43 127659.83 00:25:30.611 00:25:30.611 14:29:44 -- host/perf.sh@66 -- # sync 00:25:30.611 14:29:44 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:30.611 14:29:45 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:25:30.611 14:29:45 -- host/perf.sh@71 -- # '[' -n 0000:5e:00.0 ']' 00:25:30.611 14:29:45 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:25:33.896 14:29:48 -- host/perf.sh@72 -- # ls_guid=db44faec-c04f-4c50-8fa2-1bb9c695fd88 00:25:33.896 14:29:48 -- host/perf.sh@73 -- # get_lvs_free_mb db44faec-c04f-4c50-8fa2-1bb9c695fd88 00:25:33.896 14:29:48 -- common/autotest_common.sh@1353 -- # local lvs_uuid=db44faec-c04f-4c50-8fa2-1bb9c695fd88 00:25:33.896 14:29:48 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:33.896 14:29:48 -- common/autotest_common.sh@1355 -- # local fc 00:25:33.896 14:29:48 -- common/autotest_common.sh@1356 -- # local cs 00:25:33.896 14:29:48 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:33.896 14:29:48 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:33.896 { 00:25:33.896 "uuid": "db44faec-c04f-4c50-8fa2-1bb9c695fd88", 00:25:33.896 "name": "lvs_0", 00:25:33.896 "base_bdev": "Nvme0n1", 00:25:33.896 "total_data_clusters": 238234, 00:25:33.896 "free_clusters": 238234, 00:25:33.896 "block_size": 512, 00:25:33.896 "cluster_size": 4194304 00:25:33.896 } 00:25:33.896 ]' 00:25:33.896 14:29:48 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="db44faec-c04f-4c50-8fa2-1bb9c695fd88") .free_clusters' 00:25:33.896 14:29:48 -- common/autotest_common.sh@1358 -- # fc=238234 00:25:33.896 14:29:48 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="db44faec-c04f-4c50-8fa2-1bb9c695fd88") .cluster_size' 00:25:34.155 14:29:48 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:34.155 14:29:48 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:25:34.155 14:29:48 -- common/autotest_common.sh@1363 -- # echo 952936 00:25:34.155 952936 00:25:34.155 14:29:48 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:25:34.155 14:29:48 -- host/perf.sh@78 -- # free_mb=20480 00:25:34.155 14:29:48 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u db44faec-c04f-4c50-8fa2-1bb9c695fd88 lbd_0 20480 00:25:34.723 14:29:49 -- host/perf.sh@80 -- # lb_guid=ef8c6b02-0f8f-41e1-b877-148ca4683765 00:25:34.723 14:29:49 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore ef8c6b02-0f8f-41e1-b877-148ca4683765 lvs_n_0 00:25:35.291 14:29:49 -- host/perf.sh@83 -- # ls_nested_guid=8dc42e61-e904-41be-8369-8853bff29f6a 00:25:35.291 14:29:49 -- host/perf.sh@84 -- # get_lvs_free_mb 8dc42e61-e904-41be-8369-8853bff29f6a 00:25:35.291 14:29:49 -- common/autotest_common.sh@1353 -- # local lvs_uuid=8dc42e61-e904-41be-8369-8853bff29f6a 00:25:35.291 14:29:49 -- common/autotest_common.sh@1354 -- # local lvs_info 00:25:35.291 14:29:49 -- common/autotest_common.sh@1355 -- # local fc 00:25:35.291 14:29:49 -- common/autotest_common.sh@1356 -- # local cs 00:25:35.291 14:29:49 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:25:35.550 14:29:49 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:25:35.550 { 00:25:35.550 "uuid": "db44faec-c04f-4c50-8fa2-1bb9c695fd88", 00:25:35.550 "name": "lvs_0", 00:25:35.550 "base_bdev": "Nvme0n1", 00:25:35.550 "total_data_clusters": 238234, 00:25:35.550 "free_clusters": 233114, 00:25:35.550 "block_size": 512, 00:25:35.550 "cluster_size": 4194304 00:25:35.550 }, 00:25:35.550 { 00:25:35.550 "uuid": "8dc42e61-e904-41be-8369-8853bff29f6a", 00:25:35.550 "name": "lvs_n_0", 00:25:35.550 "base_bdev": "ef8c6b02-0f8f-41e1-b877-148ca4683765", 00:25:35.550 "total_data_clusters": 5114, 00:25:35.550 "free_clusters": 5114, 00:25:35.550 "block_size": 512, 00:25:35.550 "cluster_size": 4194304 00:25:35.550 } 00:25:35.550 ]' 00:25:35.550 14:29:49 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="8dc42e61-e904-41be-8369-8853bff29f6a") .free_clusters' 00:25:35.550 14:29:49 -- common/autotest_common.sh@1358 -- # fc=5114 00:25:35.550 14:29:49 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="8dc42e61-e904-41be-8369-8853bff29f6a") .cluster_size' 00:25:35.550 14:29:49 -- common/autotest_common.sh@1359 -- # cs=4194304 00:25:35.550 14:29:49 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:25:35.550 14:29:49 -- common/autotest_common.sh@1363 -- # echo 20456 00:25:35.550 20456 00:25:35.550 14:29:49 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:25:35.550 14:29:49 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 8dc42e61-e904-41be-8369-8853bff29f6a lbd_nest_0 20456 00:25:35.809 14:29:50 -- host/perf.sh@88 -- # lb_nested_guid=f045999e-bd91-4e57-840e-4cf00015dc9b 00:25:35.809 14:29:50 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:35.809 14:29:50 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:25:35.809 14:29:50 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 f045999e-bd91-4e57-840e-4cf00015dc9b 00:25:36.068 14:29:50 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:36.327 14:29:50 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:25:36.327 14:29:50 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:25:36.327 14:29:50 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:25:36.327 14:29:50 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:36.327 14:29:50 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:36.327 EAL: No free 2048 kB hugepages reported on node 1 00:25:48.530 Initializing NVMe Controllers 00:25:48.530 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:48.530 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:48.530 Initialization complete. Launching workers. 00:25:48.530 ======================================================== 00:25:48.530 Latency(us) 00:25:48.530 Device Information : IOPS MiB/s Average min max 00:25:48.530 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 48.60 0.02 20655.58 127.31 45678.34 00:25:48.530 ======================================================== 00:25:48.531 Total : 48.60 0.02 20655.58 127.31 45678.34 00:25:48.531 00:25:48.531 14:30:01 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:48.531 14:30:01 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:48.531 EAL: No free 2048 kB hugepages reported on node 1 00:25:58.506 Initializing NVMe Controllers 00:25:58.506 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:58.506 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:25:58.506 Initialization complete. Launching workers. 00:25:58.506 ======================================================== 00:25:58.506 Latency(us) 00:25:58.506 Device Information : IOPS MiB/s Average min max 00:25:58.506 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 69.70 8.71 14356.25 4038.95 55865.14 00:25:58.506 ======================================================== 00:25:58.506 Total : 69.70 8.71 14356.25 4038.95 55865.14 00:25:58.506 00:25:58.506 14:30:11 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:25:58.506 14:30:11 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:25:58.506 14:30:11 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:25:58.506 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.622 Initializing NVMe Controllers 00:26:08.622 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:08.622 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:08.622 Initialization complete. Launching workers. 00:26:08.622 ======================================================== 00:26:08.622 Latency(us) 00:26:08.622 Device Information : IOPS MiB/s Average min max 00:26:08.622 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8692.07 4.24 3689.19 233.25 43133.80 00:26:08.622 ======================================================== 00:26:08.622 Total : 8692.07 4.24 3689.19 233.25 43133.80 00:26:08.622 00:26:08.622 14:30:21 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:08.622 14:30:21 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:08.622 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.603 Initializing NVMe Controllers 00:26:18.603 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:18.603 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:18.603 Initialization complete. Launching workers. 00:26:18.603 ======================================================== 00:26:18.603 Latency(us) 00:26:18.603 Device Information : IOPS MiB/s Average min max 00:26:18.603 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4174.49 521.81 7664.95 629.10 18979.37 00:26:18.603 ======================================================== 00:26:18.603 Total : 4174.49 521.81 7664.95 629.10 18979.37 00:26:18.603 00:26:18.603 14:30:32 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:18.603 14:30:32 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:18.604 14:30:32 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:18.604 EAL: No free 2048 kB hugepages reported on node 1 00:26:28.582 Initializing NVMe Controllers 00:26:28.582 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:28.582 Controller IO queue size 128, less than required. 00:26:28.582 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:28.582 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:28.582 Initialization complete. Launching workers. 00:26:28.582 ======================================================== 00:26:28.582 Latency(us) 00:26:28.582 Device Information : IOPS MiB/s Average min max 00:26:28.582 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15953.60 7.79 8027.17 1350.93 47792.16 00:26:28.582 ======================================================== 00:26:28.582 Total : 15953.60 7.79 8027.17 1350.93 47792.16 00:26:28.582 00:26:28.582 14:30:42 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:28.582 14:30:42 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:28.582 EAL: No free 2048 kB hugepages reported on node 1 00:26:38.562 Initializing NVMe Controllers 00:26:38.562 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:38.562 Controller IO queue size 128, less than required. 00:26:38.562 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:38.562 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:38.562 Initialization complete. Launching workers. 00:26:38.562 ======================================================== 00:26:38.562 Latency(us) 00:26:38.562 Device Information : IOPS MiB/s Average min max 00:26:38.562 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1193.90 149.24 107615.07 23775.72 205824.29 00:26:38.562 ======================================================== 00:26:38.562 Total : 1193.90 149.24 107615.07 23775.72 205824.29 00:26:38.562 00:26:38.562 14:30:52 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:38.821 14:30:53 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete f045999e-bd91-4e57-840e-4cf00015dc9b 00:26:39.388 14:30:53 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:26:39.646 14:30:54 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete ef8c6b02-0f8f-41e1-b877-148ca4683765 00:26:39.905 14:30:54 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:26:39.905 14:30:54 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:26:39.905 14:30:54 -- host/perf.sh@114 -- # nvmftestfini 00:26:39.905 14:30:54 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:39.905 14:30:54 -- nvmf/common.sh@116 -- # sync 00:26:39.905 14:30:54 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:39.905 14:30:54 -- nvmf/common.sh@119 -- # set +e 00:26:39.905 14:30:54 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:39.905 14:30:54 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:39.905 rmmod nvme_tcp 00:26:39.905 rmmod nvme_fabrics 00:26:39.905 rmmod nvme_keyring 00:26:40.164 14:30:54 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:40.164 14:30:54 -- nvmf/common.sh@123 -- # set -e 00:26:40.164 14:30:54 -- nvmf/common.sh@124 -- # return 0 00:26:40.164 14:30:54 -- nvmf/common.sh@477 -- # '[' -n 491225 ']' 00:26:40.164 14:30:54 -- nvmf/common.sh@478 -- # killprocess 491225 00:26:40.164 14:30:54 -- common/autotest_common.sh@936 -- # '[' -z 491225 ']' 00:26:40.164 14:30:54 -- common/autotest_common.sh@940 -- # kill -0 491225 00:26:40.164 14:30:54 -- common/autotest_common.sh@941 -- # uname 00:26:40.164 14:30:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:40.164 14:30:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 491225 00:26:40.164 14:30:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:40.164 14:30:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:40.164 14:30:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 491225' 00:26:40.164 killing process with pid 491225 00:26:40.164 14:30:54 -- common/autotest_common.sh@955 -- # kill 491225 00:26:40.164 14:30:54 -- common/autotest_common.sh@960 -- # wait 491225 00:26:41.543 14:30:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:41.543 14:30:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:41.543 14:30:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:41.543 14:30:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:41.543 14:30:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:41.543 14:30:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:41.543 14:30:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:41.543 14:30:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:44.076 14:30:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:44.076 00:26:44.076 real 1m33.200s 00:26:44.076 user 5m33.076s 00:26:44.076 sys 0m16.893s 00:26:44.076 14:30:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:44.076 14:30:58 -- common/autotest_common.sh@10 -- # set +x 00:26:44.076 ************************************ 00:26:44.076 END TEST nvmf_perf 00:26:44.076 ************************************ 00:26:44.076 14:30:58 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:26:44.076 14:30:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:44.076 14:30:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:44.076 14:30:58 -- common/autotest_common.sh@10 -- # set +x 00:26:44.076 ************************************ 00:26:44.076 START TEST nvmf_fio_host 00:26:44.076 ************************************ 00:26:44.076 14:30:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:26:44.076 * Looking for test storage... 00:26:44.076 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:44.076 14:30:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:44.076 14:30:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:44.076 14:30:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:44.076 14:30:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:44.076 14:30:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:44.076 14:30:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:44.076 14:30:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:44.076 14:30:58 -- scripts/common.sh@335 -- # IFS=.-: 00:26:44.076 14:30:58 -- scripts/common.sh@335 -- # read -ra ver1 00:26:44.076 14:30:58 -- scripts/common.sh@336 -- # IFS=.-: 00:26:44.076 14:30:58 -- scripts/common.sh@336 -- # read -ra ver2 00:26:44.076 14:30:58 -- scripts/common.sh@337 -- # local 'op=<' 00:26:44.076 14:30:58 -- scripts/common.sh@339 -- # ver1_l=2 00:26:44.076 14:30:58 -- scripts/common.sh@340 -- # ver2_l=1 00:26:44.076 14:30:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:44.076 14:30:58 -- scripts/common.sh@343 -- # case "$op" in 00:26:44.076 14:30:58 -- scripts/common.sh@344 -- # : 1 00:26:44.076 14:30:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:44.076 14:30:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:44.076 14:30:58 -- scripts/common.sh@364 -- # decimal 1 00:26:44.076 14:30:58 -- scripts/common.sh@352 -- # local d=1 00:26:44.076 14:30:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:44.076 14:30:58 -- scripts/common.sh@354 -- # echo 1 00:26:44.076 14:30:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:44.076 14:30:58 -- scripts/common.sh@365 -- # decimal 2 00:26:44.076 14:30:58 -- scripts/common.sh@352 -- # local d=2 00:26:44.076 14:30:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:44.076 14:30:58 -- scripts/common.sh@354 -- # echo 2 00:26:44.076 14:30:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:44.076 14:30:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:44.076 14:30:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:44.076 14:30:58 -- scripts/common.sh@367 -- # return 0 00:26:44.076 14:30:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:44.076 14:30:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:44.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:44.076 --rc genhtml_branch_coverage=1 00:26:44.076 --rc genhtml_function_coverage=1 00:26:44.076 --rc genhtml_legend=1 00:26:44.076 --rc geninfo_all_blocks=1 00:26:44.076 --rc geninfo_unexecuted_blocks=1 00:26:44.076 00:26:44.076 ' 00:26:44.076 14:30:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:44.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:44.076 --rc genhtml_branch_coverage=1 00:26:44.076 --rc genhtml_function_coverage=1 00:26:44.076 --rc genhtml_legend=1 00:26:44.076 --rc geninfo_all_blocks=1 00:26:44.076 --rc geninfo_unexecuted_blocks=1 00:26:44.076 00:26:44.076 ' 00:26:44.076 14:30:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:44.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:44.076 --rc genhtml_branch_coverage=1 00:26:44.076 --rc genhtml_function_coverage=1 00:26:44.076 --rc genhtml_legend=1 00:26:44.076 --rc geninfo_all_blocks=1 00:26:44.076 --rc geninfo_unexecuted_blocks=1 00:26:44.076 00:26:44.076 ' 00:26:44.076 14:30:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:44.076 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:44.076 --rc genhtml_branch_coverage=1 00:26:44.076 --rc genhtml_function_coverage=1 00:26:44.076 --rc genhtml_legend=1 00:26:44.076 --rc geninfo_all_blocks=1 00:26:44.076 --rc geninfo_unexecuted_blocks=1 00:26:44.076 00:26:44.076 ' 00:26:44.076 14:30:58 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:44.076 14:30:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:44.076 14:30:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:44.076 14:30:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:44.077 14:30:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.077 14:30:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.077 14:30:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.077 14:30:58 -- paths/export.sh@5 -- # export PATH 00:26:44.077 14:30:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.077 14:30:58 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:44.077 14:30:58 -- nvmf/common.sh@7 -- # uname -s 00:26:44.077 14:30:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:44.077 14:30:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:44.077 14:30:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:44.077 14:30:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:44.077 14:30:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:44.077 14:30:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:44.077 14:30:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:44.077 14:30:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:44.077 14:30:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:44.077 14:30:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:44.077 14:30:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:26:44.077 14:30:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:26:44.077 14:30:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:44.077 14:30:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:44.077 14:30:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:44.077 14:30:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:44.077 14:30:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:44.077 14:30:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:44.077 14:30:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:44.077 14:30:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.077 14:30:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.077 14:30:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.077 14:30:58 -- paths/export.sh@5 -- # export PATH 00:26:44.077 14:30:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:44.077 14:30:58 -- nvmf/common.sh@46 -- # : 0 00:26:44.077 14:30:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:44.077 14:30:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:44.077 14:30:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:44.077 14:30:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:44.077 14:30:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:44.077 14:30:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:44.077 14:30:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:44.077 14:30:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:44.077 14:30:58 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:44.077 14:30:58 -- host/fio.sh@14 -- # nvmftestinit 00:26:44.077 14:30:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:44.077 14:30:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:44.077 14:30:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:44.077 14:30:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:44.077 14:30:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:44.077 14:30:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:44.077 14:30:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:44.077 14:30:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:44.077 14:30:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:44.077 14:30:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:44.077 14:30:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:44.077 14:30:58 -- common/autotest_common.sh@10 -- # set +x 00:26:49.343 14:31:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:49.343 14:31:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:49.343 14:31:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:49.343 14:31:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:49.343 14:31:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:49.343 14:31:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:49.343 14:31:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:49.343 14:31:03 -- nvmf/common.sh@294 -- # net_devs=() 00:26:49.343 14:31:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:49.343 14:31:03 -- nvmf/common.sh@295 -- # e810=() 00:26:49.343 14:31:03 -- nvmf/common.sh@295 -- # local -ga e810 00:26:49.343 14:31:03 -- nvmf/common.sh@296 -- # x722=() 00:26:49.343 14:31:03 -- nvmf/common.sh@296 -- # local -ga x722 00:26:49.343 14:31:03 -- nvmf/common.sh@297 -- # mlx=() 00:26:49.343 14:31:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:49.343 14:31:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:49.343 14:31:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:49.343 14:31:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:49.344 14:31:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:49.344 14:31:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:49.344 14:31:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:49.344 14:31:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:49.344 14:31:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:26:49.344 Found 0000:af:00.0 (0x8086 - 0x159b) 00:26:49.344 14:31:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:49.344 14:31:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:26:49.344 Found 0000:af:00.1 (0x8086 - 0x159b) 00:26:49.344 14:31:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:49.344 14:31:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:49.344 14:31:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:49.344 14:31:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:49.344 14:31:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:49.344 14:31:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:26:49.344 Found net devices under 0000:af:00.0: cvl_0_0 00:26:49.344 14:31:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:49.344 14:31:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:49.344 14:31:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:49.344 14:31:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:49.344 14:31:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:49.344 14:31:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:26:49.344 Found net devices under 0000:af:00.1: cvl_0_1 00:26:49.344 14:31:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:49.344 14:31:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:49.344 14:31:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:49.344 14:31:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:49.344 14:31:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:49.344 14:31:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:49.344 14:31:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:49.344 14:31:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:49.344 14:31:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:49.344 14:31:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:49.344 14:31:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:49.344 14:31:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:49.344 14:31:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:49.344 14:31:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:49.344 14:31:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:49.344 14:31:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:49.344 14:31:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:49.344 14:31:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:49.344 14:31:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:49.344 14:31:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:49.344 14:31:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:49.344 14:31:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:49.344 14:31:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:49.344 14:31:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:49.344 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:49.344 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.349 ms 00:26:49.344 00:26:49.344 --- 10.0.0.2 ping statistics --- 00:26:49.344 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:49.344 rtt min/avg/max/mdev = 0.349/0.349/0.349/0.000 ms 00:26:49.344 14:31:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:49.344 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:49.344 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.218 ms 00:26:49.344 00:26:49.344 --- 10.0.0.1 ping statistics --- 00:26:49.344 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:49.344 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:26:49.344 14:31:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:49.344 14:31:03 -- nvmf/common.sh@410 -- # return 0 00:26:49.344 14:31:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:49.344 14:31:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:49.344 14:31:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:49.344 14:31:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:49.344 14:31:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:49.344 14:31:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:49.344 14:31:03 -- host/fio.sh@16 -- # [[ y != y ]] 00:26:49.344 14:31:03 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:26:49.344 14:31:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:49.344 14:31:03 -- common/autotest_common.sh@10 -- # set +x 00:26:49.344 14:31:03 -- host/fio.sh@24 -- # nvmfpid=508947 00:26:49.344 14:31:03 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:49.344 14:31:03 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:49.344 14:31:03 -- host/fio.sh@28 -- # waitforlisten 508947 00:26:49.344 14:31:03 -- common/autotest_common.sh@829 -- # '[' -z 508947 ']' 00:26:49.344 14:31:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:49.344 14:31:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:49.344 14:31:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:49.344 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:49.344 14:31:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:49.344 14:31:03 -- common/autotest_common.sh@10 -- # set +x 00:26:49.344 [2024-12-16 14:31:03.752863] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:49.344 [2024-12-16 14:31:03.752909] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:49.344 EAL: No free 2048 kB hugepages reported on node 1 00:26:49.344 [2024-12-16 14:31:03.811121] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:49.344 [2024-12-16 14:31:03.886659] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:49.344 [2024-12-16 14:31:03.886765] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:49.344 [2024-12-16 14:31:03.886773] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:49.344 [2024-12-16 14:31:03.886779] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:49.344 [2024-12-16 14:31:03.886839] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:49.344 [2024-12-16 14:31:03.886956] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:49.344 [2024-12-16 14:31:03.886979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:49.344 [2024-12-16 14:31:03.886979] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:50.280 14:31:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:50.280 14:31:04 -- common/autotest_common.sh@862 -- # return 0 00:26:50.280 14:31:04 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:26:50.280 [2024-12-16 14:31:04.737640] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:50.280 14:31:04 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:26:50.280 14:31:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:50.280 14:31:04 -- common/autotest_common.sh@10 -- # set +x 00:26:50.280 14:31:04 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:26:50.538 Malloc1 00:26:50.538 14:31:05 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:50.795 14:31:05 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:26:51.054 14:31:05 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:51.054 [2024-12-16 14:31:05.551628] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:51.054 14:31:05 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:51.312 14:31:05 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:26:51.312 14:31:05 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:51.312 14:31:05 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:51.312 14:31:05 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:26:51.312 14:31:05 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:51.313 14:31:05 -- common/autotest_common.sh@1328 -- # local sanitizers 00:26:51.313 14:31:05 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:51.313 14:31:05 -- common/autotest_common.sh@1330 -- # shift 00:26:51.313 14:31:05 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:26:51.313 14:31:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:26:51.313 14:31:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:51.313 14:31:05 -- common/autotest_common.sh@1334 -- # grep libasan 00:26:51.313 14:31:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:26:51.313 14:31:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:26:51.313 14:31:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:26:51.313 14:31:05 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:26:51.313 14:31:05 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:51.313 14:31:05 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:26:51.313 14:31:05 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:26:51.313 14:31:05 -- common/autotest_common.sh@1334 -- # asan_lib= 00:26:51.313 14:31:05 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:26:51.313 14:31:05 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:51.313 14:31:05 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:26:51.571 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:26:51.571 fio-3.35 00:26:51.571 Starting 1 thread 00:26:51.571 EAL: No free 2048 kB hugepages reported on node 1 00:26:54.131 00:26:54.131 test: (groupid=0, jobs=1): err= 0: pid=509398: Mon Dec 16 14:31:08 2024 00:26:54.131 read: IOPS=12.8k, BW=49.9MiB/s (52.4MB/s)(100MiB/2005msec) 00:26:54.131 slat (nsec): min=1527, max=237406, avg=1705.79, stdev=2099.24 00:26:54.131 clat (usec): min=3012, max=9710, avg=5538.83, stdev=408.90 00:26:54.131 lat (usec): min=3040, max=9712, avg=5540.53, stdev=408.86 00:26:54.131 clat percentiles (usec): 00:26:54.131 | 1.00th=[ 4555], 5.00th=[ 4883], 10.00th=[ 5014], 20.00th=[ 5211], 00:26:54.131 | 30.00th=[ 5342], 40.00th=[ 5473], 50.00th=[ 5538], 60.00th=[ 5604], 00:26:54.131 | 70.00th=[ 5735], 80.00th=[ 5866], 90.00th=[ 5997], 95.00th=[ 6194], 00:26:54.131 | 99.00th=[ 6456], 99.50th=[ 6652], 99.90th=[ 7308], 99.95th=[ 8848], 00:26:54.131 | 99.99th=[ 9634] 00:26:54.131 bw ( KiB/s): min=50152, max=51600, per=99.95%, avg=51104.00, stdev=675.20, samples=4 00:26:54.131 iops : min=12538, max=12898, avg=12776.00, stdev=168.31, samples=4 00:26:54.131 write: IOPS=12.7k, BW=49.8MiB/s (52.2MB/s)(99.8MiB/2005msec); 0 zone resets 00:26:54.131 slat (nsec): min=1557, max=207373, avg=1775.16, stdev=1469.69 00:26:54.131 clat (usec): min=2376, max=9014, avg=4442.92, stdev=344.47 00:26:54.131 lat (usec): min=2391, max=9016, avg=4444.69, stdev=344.46 00:26:54.131 clat percentiles (usec): 00:26:54.131 | 1.00th=[ 3621], 5.00th=[ 3916], 10.00th=[ 4047], 20.00th=[ 4178], 00:26:54.131 | 30.00th=[ 4293], 40.00th=[ 4359], 50.00th=[ 4424], 60.00th=[ 4555], 00:26:54.131 | 70.00th=[ 4621], 80.00th=[ 4686], 90.00th=[ 4817], 95.00th=[ 4948], 00:26:54.131 | 99.00th=[ 5211], 99.50th=[ 5342], 99.90th=[ 6849], 99.95th=[ 7504], 00:26:54.131 | 99.99th=[ 8848] 00:26:54.131 bw ( KiB/s): min=50656, max=51328, per=100.00%, avg=50996.00, stdev=291.35, samples=4 00:26:54.131 iops : min=12664, max=12832, avg=12749.00, stdev=72.84, samples=4 00:26:54.131 lat (msec) : 4=4.33%, 10=95.67% 00:26:54.131 cpu : usr=74.15%, sys=24.40%, ctx=51, majf=0, minf=5 00:26:54.131 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.9% 00:26:54.131 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:54.132 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:54.132 issued rwts: total=25629,25548,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:54.132 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:54.132 00:26:54.132 Run status group 0 (all jobs): 00:26:54.132 READ: bw=49.9MiB/s (52.4MB/s), 49.9MiB/s-49.9MiB/s (52.4MB/s-52.4MB/s), io=100MiB (105MB), run=2005-2005msec 00:26:54.132 WRITE: bw=49.8MiB/s (52.2MB/s), 49.8MiB/s-49.8MiB/s (52.2MB/s-52.2MB/s), io=99.8MiB (105MB), run=2005-2005msec 00:26:54.132 14:31:08 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:54.132 14:31:08 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:54.132 14:31:08 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:26:54.132 14:31:08 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:26:54.132 14:31:08 -- common/autotest_common.sh@1328 -- # local sanitizers 00:26:54.132 14:31:08 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:54.132 14:31:08 -- common/autotest_common.sh@1330 -- # shift 00:26:54.132 14:31:08 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:26:54.132 14:31:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:26:54.132 14:31:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:54.132 14:31:08 -- common/autotest_common.sh@1334 -- # grep libasan 00:26:54.132 14:31:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:26:54.132 14:31:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:26:54.132 14:31:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:26:54.132 14:31:08 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:26:54.132 14:31:08 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:26:54.132 14:31:08 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:26:54.132 14:31:08 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:26:54.132 14:31:08 -- common/autotest_common.sh@1334 -- # asan_lib= 00:26:54.132 14:31:08 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:26:54.132 14:31:08 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:26:54.132 14:31:08 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:26:54.390 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:26:54.390 fio-3.35 00:26:54.390 Starting 1 thread 00:26:54.390 EAL: No free 2048 kB hugepages reported on node 1 00:26:56.912 00:26:56.913 test: (groupid=0, jobs=1): err= 0: pid=509955: Mon Dec 16 14:31:11 2024 00:26:56.913 read: IOPS=11.4k, BW=177MiB/s (186MB/s)(356MiB/2008msec) 00:26:56.913 slat (nsec): min=2515, max=85734, avg=2849.38, stdev=1265.70 00:26:56.913 clat (usec): min=1676, max=13593, avg=6567.31, stdev=1577.85 00:26:56.913 lat (usec): min=1679, max=13596, avg=6570.16, stdev=1577.96 00:26:56.913 clat percentiles (usec): 00:26:56.913 | 1.00th=[ 3523], 5.00th=[ 4113], 10.00th=[ 4555], 20.00th=[ 5145], 00:26:56.913 | 30.00th=[ 5604], 40.00th=[ 6063], 50.00th=[ 6587], 60.00th=[ 7046], 00:26:56.913 | 70.00th=[ 7439], 80.00th=[ 7832], 90.00th=[ 8455], 95.00th=[ 9110], 00:26:56.913 | 99.00th=[10814], 99.50th=[11207], 99.90th=[13304], 99.95th=[13435], 00:26:56.913 | 99.99th=[13566] 00:26:56.913 bw ( KiB/s): min=91136, max=98560, per=51.51%, avg=93592.00, stdev=3390.93, samples=4 00:26:56.913 iops : min= 5696, max= 6160, avg=5849.50, stdev=211.93, samples=4 00:26:56.913 write: IOPS=6784, BW=106MiB/s (111MB/s)(191MiB/1803msec); 0 zone resets 00:26:56.913 slat (usec): min=29, max=250, avg=31.56, stdev= 4.86 00:26:56.913 clat (usec): min=4015, max=13714, avg=8046.60, stdev=1363.81 00:26:56.913 lat (usec): min=4045, max=13746, avg=8078.16, stdev=1364.42 00:26:56.913 clat percentiles (usec): 00:26:56.913 | 1.00th=[ 5538], 5.00th=[ 6128], 10.00th=[ 6456], 20.00th=[ 6915], 00:26:56.913 | 30.00th=[ 7242], 40.00th=[ 7570], 50.00th=[ 7832], 60.00th=[ 8160], 00:26:56.913 | 70.00th=[ 8586], 80.00th=[ 9110], 90.00th=[10028], 95.00th=[10683], 00:26:56.913 | 99.00th=[11731], 99.50th=[11994], 99.90th=[12780], 99.95th=[12911], 00:26:56.913 | 99.99th=[13042] 00:26:56.913 bw ( KiB/s): min=94240, max=103168, per=89.84%, avg=97520.00, stdev=3896.52, samples=4 00:26:56.913 iops : min= 5890, max= 6448, avg=6095.00, stdev=243.53, samples=4 00:26:56.913 lat (msec) : 2=0.03%, 4=2.44%, 10=92.36%, 20=5.17% 00:26:56.913 cpu : usr=86.75%, sys=12.46%, ctx=32, majf=0, minf=1 00:26:56.913 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.7% 00:26:56.913 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:26:56.913 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:26:56.913 issued rwts: total=22801,12232,0,0 short=0,0,0,0 dropped=0,0,0,0 00:26:56.913 latency : target=0, window=0, percentile=100.00%, depth=128 00:26:56.913 00:26:56.913 Run status group 0 (all jobs): 00:26:56.913 READ: bw=177MiB/s (186MB/s), 177MiB/s-177MiB/s (186MB/s-186MB/s), io=356MiB (374MB), run=2008-2008msec 00:26:56.913 WRITE: bw=106MiB/s (111MB/s), 106MiB/s-106MiB/s (111MB/s-111MB/s), io=191MiB (200MB), run=1803-1803msec 00:26:56.913 14:31:11 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:56.913 14:31:11 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:26:56.913 14:31:11 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:26:56.913 14:31:11 -- host/fio.sh@51 -- # get_nvme_bdfs 00:26:56.913 14:31:11 -- common/autotest_common.sh@1508 -- # bdfs=() 00:26:56.913 14:31:11 -- common/autotest_common.sh@1508 -- # local bdfs 00:26:56.913 14:31:11 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:26:56.913 14:31:11 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:56.913 14:31:11 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:26:56.913 14:31:11 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:26:56.913 14:31:11 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:5e:00.0 00:26:56.913 14:31:11 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:5e:00.0 -i 10.0.0.2 00:27:00.183 Nvme0n1 00:27:00.183 14:31:14 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:03.457 14:31:17 -- host/fio.sh@53 -- # ls_guid=eddb4c7a-34f5-4886-8304-d0aee82e8316 00:27:03.457 14:31:17 -- host/fio.sh@54 -- # get_lvs_free_mb eddb4c7a-34f5-4886-8304-d0aee82e8316 00:27:03.457 14:31:17 -- common/autotest_common.sh@1353 -- # local lvs_uuid=eddb4c7a-34f5-4886-8304-d0aee82e8316 00:27:03.457 14:31:17 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:03.457 14:31:17 -- common/autotest_common.sh@1355 -- # local fc 00:27:03.457 14:31:17 -- common/autotest_common.sh@1356 -- # local cs 00:27:03.457 14:31:17 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:03.457 14:31:17 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:03.457 { 00:27:03.457 "uuid": "eddb4c7a-34f5-4886-8304-d0aee82e8316", 00:27:03.457 "name": "lvs_0", 00:27:03.457 "base_bdev": "Nvme0n1", 00:27:03.457 "total_data_clusters": 930, 00:27:03.457 "free_clusters": 930, 00:27:03.457 "block_size": 512, 00:27:03.457 "cluster_size": 1073741824 00:27:03.457 } 00:27:03.457 ]' 00:27:03.457 14:31:17 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="eddb4c7a-34f5-4886-8304-d0aee82e8316") .free_clusters' 00:27:03.457 14:31:17 -- common/autotest_common.sh@1358 -- # fc=930 00:27:03.457 14:31:17 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="eddb4c7a-34f5-4886-8304-d0aee82e8316") .cluster_size' 00:27:03.457 14:31:17 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:03.457 14:31:17 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:03.457 14:31:17 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:03.457 952320 00:27:03.457 14:31:17 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:03.457 7c5520a1-aec0-40e2-ba13-e231f44b538d 00:27:03.457 14:31:17 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:03.713 14:31:18 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:03.970 14:31:18 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:03.970 14:31:18 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:03.970 14:31:18 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:03.970 14:31:18 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:03.970 14:31:18 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:03.970 14:31:18 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:03.970 14:31:18 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:03.970 14:31:18 -- common/autotest_common.sh@1330 -- # shift 00:27:03.970 14:31:18 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:03.970 14:31:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:03.970 14:31:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:03.970 14:31:18 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:03.970 14:31:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:03.970 14:31:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:03.970 14:31:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:03.970 14:31:18 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:03.970 14:31:18 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:03.970 14:31:18 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:03.970 14:31:18 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:03.970 14:31:18 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:03.970 14:31:18 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:03.970 14:31:18 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:03.970 14:31:18 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:04.226 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:04.226 fio-3.35 00:27:04.226 Starting 1 thread 00:27:04.483 EAL: No free 2048 kB hugepages reported on node 1 00:27:07.002 00:27:07.002 test: (groupid=0, jobs=1): err= 0: pid=511704: Mon Dec 16 14:31:21 2024 00:27:07.002 read: IOPS=8586, BW=33.5MiB/s (35.2MB/s)(67.2MiB/2005msec) 00:27:07.002 slat (nsec): min=1519, max=98731, avg=1642.97, stdev=1105.82 00:27:07.002 clat (usec): min=577, max=169459, avg=8228.82, stdev=9967.08 00:27:07.002 lat (usec): min=579, max=169474, avg=8230.46, stdev=9967.25 00:27:07.002 clat percentiles (msec): 00:27:07.002 | 1.00th=[ 7], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], 00:27:07.002 | 30.00th=[ 8], 40.00th=[ 8], 50.00th=[ 8], 60.00th=[ 8], 00:27:07.002 | 70.00th=[ 8], 80.00th=[ 9], 90.00th=[ 9], 95.00th=[ 9], 00:27:07.002 | 99.00th=[ 11], 99.50th=[ 12], 99.90th=[ 169], 99.95th=[ 169], 00:27:07.002 | 99.99th=[ 169] 00:27:07.002 bw ( KiB/s): min=24512, max=37752, per=99.77%, avg=34266.00, stdev=6504.80, samples=4 00:27:07.002 iops : min= 6128, max= 9438, avg=8566.50, stdev=1626.20, samples=4 00:27:07.002 write: IOPS=8579, BW=33.5MiB/s (35.1MB/s)(67.2MiB/2005msec); 0 zone resets 00:27:07.002 slat (nsec): min=1564, max=90764, avg=1722.11, stdev=815.18 00:27:07.002 clat (usec): min=248, max=168231, avg=6595.01, stdev=9313.95 00:27:07.002 lat (usec): min=250, max=168236, avg=6596.73, stdev=9314.13 00:27:07.002 clat percentiles (msec): 00:27:07.002 | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], 00:27:07.002 | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 7], 60.00th=[ 7], 00:27:07.002 | 70.00th=[ 7], 80.00th=[ 7], 90.00th=[ 7], 95.00th=[ 7], 00:27:07.002 | 99.00th=[ 9], 99.50th=[ 10], 99.90th=[ 167], 99.95th=[ 169], 00:27:07.002 | 99.99th=[ 169] 00:27:07.002 bw ( KiB/s): min=25704, max=37504, per=99.99%, avg=34314.00, stdev=5749.27, samples=4 00:27:07.002 iops : min= 6426, max= 9376, avg=8578.50, stdev=1437.32, samples=4 00:27:07.002 lat (usec) : 250=0.01%, 500=0.01%, 750=0.01%, 1000=0.01% 00:27:07.002 lat (msec) : 2=0.05%, 4=0.26%, 10=98.82%, 20=0.47%, 250=0.37% 00:27:07.002 cpu : usr=70.81%, sys=27.99%, ctx=117, majf=0, minf=5 00:27:07.002 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:07.002 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:07.002 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:07.002 issued rwts: total=17215,17202,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:07.002 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:07.002 00:27:07.002 Run status group 0 (all jobs): 00:27:07.002 READ: bw=33.5MiB/s (35.2MB/s), 33.5MiB/s-33.5MiB/s (35.2MB/s-35.2MB/s), io=67.2MiB (70.5MB), run=2005-2005msec 00:27:07.002 WRITE: bw=33.5MiB/s (35.1MB/s), 33.5MiB/s-33.5MiB/s (35.1MB/s-35.1MB/s), io=67.2MiB (70.5MB), run=2005-2005msec 00:27:07.002 14:31:21 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:07.002 14:31:21 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:07.931 14:31:22 -- host/fio.sh@64 -- # ls_nested_guid=b4acb7a5-803d-457e-bb44-4875e3c8c0c1 00:27:07.931 14:31:22 -- host/fio.sh@65 -- # get_lvs_free_mb b4acb7a5-803d-457e-bb44-4875e3c8c0c1 00:27:07.931 14:31:22 -- common/autotest_common.sh@1353 -- # local lvs_uuid=b4acb7a5-803d-457e-bb44-4875e3c8c0c1 00:27:07.931 14:31:22 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:07.931 14:31:22 -- common/autotest_common.sh@1355 -- # local fc 00:27:07.931 14:31:22 -- common/autotest_common.sh@1356 -- # local cs 00:27:07.931 14:31:22 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:08.187 14:31:22 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:08.187 { 00:27:08.187 "uuid": "eddb4c7a-34f5-4886-8304-d0aee82e8316", 00:27:08.187 "name": "lvs_0", 00:27:08.187 "base_bdev": "Nvme0n1", 00:27:08.187 "total_data_clusters": 930, 00:27:08.187 "free_clusters": 0, 00:27:08.187 "block_size": 512, 00:27:08.187 "cluster_size": 1073741824 00:27:08.187 }, 00:27:08.187 { 00:27:08.187 "uuid": "b4acb7a5-803d-457e-bb44-4875e3c8c0c1", 00:27:08.187 "name": "lvs_n_0", 00:27:08.187 "base_bdev": "7c5520a1-aec0-40e2-ba13-e231f44b538d", 00:27:08.187 "total_data_clusters": 237847, 00:27:08.187 "free_clusters": 237847, 00:27:08.187 "block_size": 512, 00:27:08.187 "cluster_size": 4194304 00:27:08.187 } 00:27:08.187 ]' 00:27:08.187 14:31:22 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="b4acb7a5-803d-457e-bb44-4875e3c8c0c1") .free_clusters' 00:27:08.187 14:31:22 -- common/autotest_common.sh@1358 -- # fc=237847 00:27:08.187 14:31:22 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="b4acb7a5-803d-457e-bb44-4875e3c8c0c1") .cluster_size' 00:27:08.187 14:31:22 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:08.187 14:31:22 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:27:08.187 14:31:22 -- common/autotest_common.sh@1363 -- # echo 951388 00:27:08.187 951388 00:27:08.187 14:31:22 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:27:08.750 fa5a0289-5967-4572-bfa9-bcd46a0e0a08 00:27:08.750 14:31:23 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:27:09.006 14:31:23 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:27:09.263 14:31:23 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:27:09.264 14:31:23 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:09.264 14:31:23 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:09.264 14:31:23 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:09.264 14:31:23 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:09.264 14:31:23 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:09.264 14:31:23 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:09.264 14:31:23 -- common/autotest_common.sh@1330 -- # shift 00:27:09.264 14:31:23 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:09.264 14:31:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:09.264 14:31:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:09.264 14:31:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:09.264 14:31:23 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:09.264 14:31:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:09.264 14:31:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:09.264 14:31:23 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:09.264 14:31:23 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:09.264 14:31:23 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:09.264 14:31:23 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:09.264 14:31:23 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:09.264 14:31:23 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:09.264 14:31:23 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:09.264 14:31:23 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:09.519 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:09.519 fio-3.35 00:27:09.519 Starting 1 thread 00:27:09.776 EAL: No free 2048 kB hugepages reported on node 1 00:27:12.295 00:27:12.295 test: (groupid=0, jobs=1): err= 0: pid=512705: Mon Dec 16 14:31:26 2024 00:27:12.295 read: IOPS=8208, BW=32.1MiB/s (33.6MB/s)(64.4MiB/2007msec) 00:27:12.295 slat (nsec): min=1498, max=100108, avg=1671.95, stdev=1086.89 00:27:12.295 clat (usec): min=3042, max=13545, avg=8595.77, stdev=715.77 00:27:12.295 lat (usec): min=3046, max=13546, avg=8597.44, stdev=715.70 00:27:12.295 clat percentiles (usec): 00:27:12.295 | 1.00th=[ 6915], 5.00th=[ 7439], 10.00th=[ 7701], 20.00th=[ 8029], 00:27:12.295 | 30.00th=[ 8291], 40.00th=[ 8455], 50.00th=[ 8586], 60.00th=[ 8717], 00:27:12.295 | 70.00th=[ 8979], 80.00th=[ 9110], 90.00th=[ 9503], 95.00th=[ 9634], 00:27:12.295 | 99.00th=[10159], 99.50th=[10421], 99.90th=[11731], 99.95th=[12518], 00:27:12.295 | 99.99th=[13566] 00:27:12.295 bw ( KiB/s): min=31584, max=33552, per=99.96%, avg=32822.00, stdev=864.73, samples=4 00:27:12.295 iops : min= 7896, max= 8388, avg=8205.50, stdev=216.18, samples=4 00:27:12.295 write: IOPS=8216, BW=32.1MiB/s (33.7MB/s)(64.4MiB/2007msec); 0 zone resets 00:27:12.295 slat (nsec): min=1543, max=94477, avg=1756.51, stdev=833.10 00:27:12.295 clat (usec): min=1445, max=12553, avg=6863.39, stdev=628.84 00:27:12.295 lat (usec): min=1450, max=12555, avg=6865.15, stdev=628.81 00:27:12.295 clat percentiles (usec): 00:27:12.295 | 1.00th=[ 5407], 5.00th=[ 5932], 10.00th=[ 6128], 20.00th=[ 6390], 00:27:12.295 | 30.00th=[ 6587], 40.00th=[ 6718], 50.00th=[ 6849], 60.00th=[ 6980], 00:27:12.295 | 70.00th=[ 7177], 80.00th=[ 7373], 90.00th=[ 7570], 95.00th=[ 7767], 00:27:12.295 | 99.00th=[ 8225], 99.50th=[ 8455], 99.90th=[10945], 99.95th=[12387], 00:27:12.295 | 99.99th=[12518] 00:27:12.295 bw ( KiB/s): min=32400, max=33232, per=99.97%, avg=32856.00, stdev=346.75, samples=4 00:27:12.295 iops : min= 8100, max= 8308, avg=8214.00, stdev=86.69, samples=4 00:27:12.295 lat (msec) : 2=0.01%, 4=0.11%, 10=98.92%, 20=0.97% 00:27:12.295 cpu : usr=68.49%, sys=30.36%, ctx=86, majf=0, minf=5 00:27:12.295 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:12.295 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:12.295 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:12.295 issued rwts: total=16475,16491,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:12.295 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:12.295 00:27:12.295 Run status group 0 (all jobs): 00:27:12.295 READ: bw=32.1MiB/s (33.6MB/s), 32.1MiB/s-32.1MiB/s (33.6MB/s-33.6MB/s), io=64.4MiB (67.5MB), run=2007-2007msec 00:27:12.295 WRITE: bw=32.1MiB/s (33.7MB/s), 32.1MiB/s-32.1MiB/s (33.7MB/s-33.7MB/s), io=64.4MiB (67.5MB), run=2007-2007msec 00:27:12.295 14:31:26 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:27:12.295 14:31:26 -- host/fio.sh@74 -- # sync 00:27:12.295 14:31:26 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:27:16.466 14:31:30 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:16.466 14:31:30 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:27:19.019 14:31:33 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:19.299 14:31:33 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:27:21.232 14:31:35 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:27:21.232 14:31:35 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:27:21.232 14:31:35 -- host/fio.sh@86 -- # nvmftestfini 00:27:21.232 14:31:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:21.232 14:31:35 -- nvmf/common.sh@116 -- # sync 00:27:21.232 14:31:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:21.232 14:31:35 -- nvmf/common.sh@119 -- # set +e 00:27:21.232 14:31:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:21.232 14:31:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:21.232 rmmod nvme_tcp 00:27:21.232 rmmod nvme_fabrics 00:27:21.232 rmmod nvme_keyring 00:27:21.232 14:31:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:21.232 14:31:35 -- nvmf/common.sh@123 -- # set -e 00:27:21.232 14:31:35 -- nvmf/common.sh@124 -- # return 0 00:27:21.232 14:31:35 -- nvmf/common.sh@477 -- # '[' -n 508947 ']' 00:27:21.232 14:31:35 -- nvmf/common.sh@478 -- # killprocess 508947 00:27:21.232 14:31:35 -- common/autotest_common.sh@936 -- # '[' -z 508947 ']' 00:27:21.232 14:31:35 -- common/autotest_common.sh@940 -- # kill -0 508947 00:27:21.232 14:31:35 -- common/autotest_common.sh@941 -- # uname 00:27:21.232 14:31:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:21.232 14:31:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 508947 00:27:21.232 14:31:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:21.232 14:31:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:21.232 14:31:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 508947' 00:27:21.232 killing process with pid 508947 00:27:21.232 14:31:35 -- common/autotest_common.sh@955 -- # kill 508947 00:27:21.232 14:31:35 -- common/autotest_common.sh@960 -- # wait 508947 00:27:21.490 14:31:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:21.490 14:31:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:21.490 14:31:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:21.490 14:31:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:21.490 14:31:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:21.490 14:31:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:21.490 14:31:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:21.490 14:31:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:23.389 14:31:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:23.389 00:27:23.389 real 0m39.750s 00:27:23.389 user 2m41.526s 00:27:23.389 sys 0m8.342s 00:27:23.389 14:31:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:23.389 14:31:37 -- common/autotest_common.sh@10 -- # set +x 00:27:23.389 ************************************ 00:27:23.389 END TEST nvmf_fio_host 00:27:23.389 ************************************ 00:27:23.389 14:31:37 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:23.389 14:31:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:23.389 14:31:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:23.389 14:31:37 -- common/autotest_common.sh@10 -- # set +x 00:27:23.389 ************************************ 00:27:23.389 START TEST nvmf_failover 00:27:23.389 ************************************ 00:27:23.389 14:31:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:27:23.648 * Looking for test storage... 00:27:23.648 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:23.648 14:31:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:23.648 14:31:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:23.648 14:31:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:23.648 14:31:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:23.648 14:31:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:23.648 14:31:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:23.648 14:31:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:23.648 14:31:38 -- scripts/common.sh@335 -- # IFS=.-: 00:27:23.648 14:31:38 -- scripts/common.sh@335 -- # read -ra ver1 00:27:23.648 14:31:38 -- scripts/common.sh@336 -- # IFS=.-: 00:27:23.648 14:31:38 -- scripts/common.sh@336 -- # read -ra ver2 00:27:23.648 14:31:38 -- scripts/common.sh@337 -- # local 'op=<' 00:27:23.648 14:31:38 -- scripts/common.sh@339 -- # ver1_l=2 00:27:23.648 14:31:38 -- scripts/common.sh@340 -- # ver2_l=1 00:27:23.648 14:31:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:23.648 14:31:38 -- scripts/common.sh@343 -- # case "$op" in 00:27:23.648 14:31:38 -- scripts/common.sh@344 -- # : 1 00:27:23.648 14:31:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:23.648 14:31:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:23.648 14:31:38 -- scripts/common.sh@364 -- # decimal 1 00:27:23.648 14:31:38 -- scripts/common.sh@352 -- # local d=1 00:27:23.648 14:31:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:23.648 14:31:38 -- scripts/common.sh@354 -- # echo 1 00:27:23.648 14:31:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:23.648 14:31:38 -- scripts/common.sh@365 -- # decimal 2 00:27:23.648 14:31:38 -- scripts/common.sh@352 -- # local d=2 00:27:23.648 14:31:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:23.648 14:31:38 -- scripts/common.sh@354 -- # echo 2 00:27:23.648 14:31:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:23.648 14:31:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:23.648 14:31:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:23.648 14:31:38 -- scripts/common.sh@367 -- # return 0 00:27:23.648 14:31:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:23.648 14:31:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:23.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:23.648 --rc genhtml_branch_coverage=1 00:27:23.648 --rc genhtml_function_coverage=1 00:27:23.648 --rc genhtml_legend=1 00:27:23.648 --rc geninfo_all_blocks=1 00:27:23.648 --rc geninfo_unexecuted_blocks=1 00:27:23.648 00:27:23.648 ' 00:27:23.648 14:31:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:23.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:23.648 --rc genhtml_branch_coverage=1 00:27:23.648 --rc genhtml_function_coverage=1 00:27:23.648 --rc genhtml_legend=1 00:27:23.648 --rc geninfo_all_blocks=1 00:27:23.648 --rc geninfo_unexecuted_blocks=1 00:27:23.648 00:27:23.648 ' 00:27:23.648 14:31:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:23.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:23.648 --rc genhtml_branch_coverage=1 00:27:23.648 --rc genhtml_function_coverage=1 00:27:23.648 --rc genhtml_legend=1 00:27:23.648 --rc geninfo_all_blocks=1 00:27:23.648 --rc geninfo_unexecuted_blocks=1 00:27:23.648 00:27:23.648 ' 00:27:23.648 14:31:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:23.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:23.648 --rc genhtml_branch_coverage=1 00:27:23.648 --rc genhtml_function_coverage=1 00:27:23.648 --rc genhtml_legend=1 00:27:23.648 --rc geninfo_all_blocks=1 00:27:23.648 --rc geninfo_unexecuted_blocks=1 00:27:23.648 00:27:23.648 ' 00:27:23.648 14:31:38 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:23.648 14:31:38 -- nvmf/common.sh@7 -- # uname -s 00:27:23.648 14:31:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:23.648 14:31:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:23.648 14:31:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:23.648 14:31:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:23.648 14:31:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:23.648 14:31:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:23.648 14:31:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:23.648 14:31:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:23.648 14:31:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:23.648 14:31:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:23.648 14:31:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:27:23.648 14:31:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:27:23.648 14:31:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:23.648 14:31:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:23.648 14:31:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:23.648 14:31:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:23.648 14:31:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:23.648 14:31:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:23.648 14:31:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:23.648 14:31:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:23.648 14:31:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:23.648 14:31:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:23.648 14:31:38 -- paths/export.sh@5 -- # export PATH 00:27:23.648 14:31:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:23.648 14:31:38 -- nvmf/common.sh@46 -- # : 0 00:27:23.648 14:31:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:23.648 14:31:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:23.648 14:31:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:23.648 14:31:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:23.648 14:31:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:23.648 14:31:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:23.648 14:31:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:23.648 14:31:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:23.648 14:31:38 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:27:23.648 14:31:38 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:27:23.648 14:31:38 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:23.648 14:31:38 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:27:23.648 14:31:38 -- host/failover.sh@18 -- # nvmftestinit 00:27:23.648 14:31:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:23.648 14:31:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:23.648 14:31:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:23.648 14:31:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:23.648 14:31:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:23.648 14:31:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:23.648 14:31:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:23.648 14:31:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:23.648 14:31:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:23.648 14:31:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:23.648 14:31:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:23.648 14:31:38 -- common/autotest_common.sh@10 -- # set +x 00:27:28.912 14:31:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:28.912 14:31:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:28.912 14:31:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:28.912 14:31:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:28.912 14:31:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:28.912 14:31:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:28.912 14:31:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:28.912 14:31:43 -- nvmf/common.sh@294 -- # net_devs=() 00:27:28.912 14:31:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:28.912 14:31:43 -- nvmf/common.sh@295 -- # e810=() 00:27:28.912 14:31:43 -- nvmf/common.sh@295 -- # local -ga e810 00:27:28.912 14:31:43 -- nvmf/common.sh@296 -- # x722=() 00:27:28.912 14:31:43 -- nvmf/common.sh@296 -- # local -ga x722 00:27:28.912 14:31:43 -- nvmf/common.sh@297 -- # mlx=() 00:27:28.912 14:31:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:28.912 14:31:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:28.912 14:31:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:28.912 14:31:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:28.912 14:31:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:28.912 14:31:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:28.912 14:31:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:28.912 14:31:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:28.912 14:31:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:28.912 14:31:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:27:28.912 Found 0000:af:00.0 (0x8086 - 0x159b) 00:27:28.912 14:31:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:28.912 14:31:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:28.912 14:31:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:28.912 14:31:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:28.912 14:31:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:28.912 14:31:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:28.912 14:31:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:27:28.912 Found 0000:af:00.1 (0x8086 - 0x159b) 00:27:28.912 14:31:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:28.913 14:31:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:28.913 14:31:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:28.913 14:31:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:28.913 14:31:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:28.913 14:31:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:27:28.913 Found net devices under 0000:af:00.0: cvl_0_0 00:27:28.913 14:31:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:28.913 14:31:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:28.913 14:31:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:28.913 14:31:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:28.913 14:31:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:28.913 14:31:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:27:28.913 Found net devices under 0000:af:00.1: cvl_0_1 00:27:28.913 14:31:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:28.913 14:31:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:28.913 14:31:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:28.913 14:31:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:28.913 14:31:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:28.913 14:31:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:28.913 14:31:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:28.913 14:31:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:28.913 14:31:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:28.913 14:31:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:28.913 14:31:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:28.913 14:31:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:28.913 14:31:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:28.913 14:31:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:28.913 14:31:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:28.913 14:31:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:28.913 14:31:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:28.913 14:31:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:28.913 14:31:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:28.913 14:31:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:28.913 14:31:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:28.913 14:31:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:29.171 14:31:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:29.171 14:31:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:29.171 14:31:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:29.171 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:29.171 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.358 ms 00:27:29.171 00:27:29.171 --- 10.0.0.2 ping statistics --- 00:27:29.171 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:29.171 rtt min/avg/max/mdev = 0.358/0.358/0.358/0.000 ms 00:27:29.171 14:31:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:29.171 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:29.171 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.198 ms 00:27:29.171 00:27:29.171 --- 10.0.0.1 ping statistics --- 00:27:29.171 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:29.171 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:27:29.171 14:31:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:29.171 14:31:43 -- nvmf/common.sh@410 -- # return 0 00:27:29.171 14:31:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:29.171 14:31:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:29.171 14:31:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:29.171 14:31:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:29.171 14:31:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:29.171 14:31:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:29.171 14:31:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:29.171 14:31:43 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:27:29.171 14:31:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:27:29.171 14:31:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:29.171 14:31:43 -- common/autotest_common.sh@10 -- # set +x 00:27:29.171 14:31:43 -- nvmf/common.sh@469 -- # nvmfpid=518001 00:27:29.171 14:31:43 -- nvmf/common.sh@470 -- # waitforlisten 518001 00:27:29.171 14:31:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:27:29.171 14:31:43 -- common/autotest_common.sh@829 -- # '[' -z 518001 ']' 00:27:29.171 14:31:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:29.171 14:31:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:29.171 14:31:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:29.171 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:29.171 14:31:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:29.171 14:31:43 -- common/autotest_common.sh@10 -- # set +x 00:27:29.171 [2024-12-16 14:31:43.678312] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:29.171 [2024-12-16 14:31:43.678354] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:29.171 EAL: No free 2048 kB hugepages reported on node 1 00:27:29.171 [2024-12-16 14:31:43.737844] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:27:29.429 [2024-12-16 14:31:43.812599] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:29.429 [2024-12-16 14:31:43.812702] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:29.429 [2024-12-16 14:31:43.812709] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:29.429 [2024-12-16 14:31:43.812715] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:29.429 [2024-12-16 14:31:43.812808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:29.429 [2024-12-16 14:31:43.812895] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:29.429 [2024-12-16 14:31:43.812896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:29.994 14:31:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:29.994 14:31:44 -- common/autotest_common.sh@862 -- # return 0 00:27:29.994 14:31:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:27:29.994 14:31:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:29.994 14:31:44 -- common/autotest_common.sh@10 -- # set +x 00:27:29.994 14:31:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:27:29.994 14:31:44 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:30.251 [2024-12-16 14:31:44.713050] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:30.251 14:31:44 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:27:30.508 Malloc0 00:27:30.508 14:31:44 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:30.766 14:31:45 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:27:30.766 14:31:45 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:31.023 [2024-12-16 14:31:45.452038] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:31.024 14:31:45 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:31.280 [2024-12-16 14:31:45.624565] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:31.280 14:31:45 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:31.280 [2024-12-16 14:31:45.821255] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:27:31.280 14:31:45 -- host/failover.sh@31 -- # bdevperf_pid=518367 00:27:31.280 14:31:45 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:27:31.280 14:31:45 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:31.280 14:31:45 -- host/failover.sh@34 -- # waitforlisten 518367 /var/tmp/bdevperf.sock 00:27:31.280 14:31:45 -- common/autotest_common.sh@829 -- # '[' -z 518367 ']' 00:27:31.281 14:31:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:31.281 14:31:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:31.281 14:31:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:31.281 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:31.281 14:31:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:31.281 14:31:45 -- common/autotest_common.sh@10 -- # set +x 00:27:32.212 14:31:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:32.212 14:31:46 -- common/autotest_common.sh@862 -- # return 0 00:27:32.212 14:31:46 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:32.777 NVMe0n1 00:27:32.777 14:31:47 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:33.035 00:27:33.035 14:31:47 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:33.035 14:31:47 -- host/failover.sh@39 -- # run_test_pid=518715 00:27:33.035 14:31:47 -- host/failover.sh@41 -- # sleep 1 00:27:33.968 14:31:48 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:34.226 [2024-12-16 14:31:48.672231] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672278] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672286] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672298] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672315] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672338] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672344] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672356] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672373] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672379] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672385] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672397] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672408] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672419] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672425] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672430] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672442] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.226 [2024-12-16 14:31:48.672448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672454] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672466] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672478] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672484] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672490] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672496] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672502] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672508] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672567] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672584] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 [2024-12-16 14:31:48.672590] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266d7c0 is same with the state(5) to be set 00:27:34.227 14:31:48 -- host/failover.sh@45 -- # sleep 3 00:27:37.506 14:31:51 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:37.506 00:27:37.506 14:31:52 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:37.765 [2024-12-16 14:31:52.175318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175361] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175369] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175382] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175388] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175393] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175405] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175423] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175465] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175472] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175479] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175486] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175518] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175524] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175530] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175536] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 [2024-12-16 14:31:52.175541] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x266e340 is same with the state(5) to be set 00:27:37.765 14:31:52 -- host/failover.sh@50 -- # sleep 3 00:27:41.044 14:31:55 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:41.044 [2024-12-16 14:31:55.372358] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:41.044 14:31:55 -- host/failover.sh@55 -- # sleep 1 00:27:41.976 14:31:56 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:42.234 [2024-12-16 14:31:56.569215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569253] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569283] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569290] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569312] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569318] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569324] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569329] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569335] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569363] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569370] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569375] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569392] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569404] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569415] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569421] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569434] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569463] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.234 [2024-12-16 14:31:56.569504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569509] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569527] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569533] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569545] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569550] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569556] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569568] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 [2024-12-16 14:31:56.569573] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x24c8a80 is same with the state(5) to be set 00:27:42.235 14:31:56 -- host/failover.sh@59 -- # wait 518715 00:27:48.798 0 00:27:48.798 14:32:02 -- host/failover.sh@61 -- # killprocess 518367 00:27:48.798 14:32:02 -- common/autotest_common.sh@936 -- # '[' -z 518367 ']' 00:27:48.798 14:32:02 -- common/autotest_common.sh@940 -- # kill -0 518367 00:27:48.798 14:32:02 -- common/autotest_common.sh@941 -- # uname 00:27:48.798 14:32:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:48.798 14:32:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 518367 00:27:48.798 14:32:02 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:48.798 14:32:02 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:48.798 14:32:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 518367' 00:27:48.798 killing process with pid 518367 00:27:48.798 14:32:02 -- common/autotest_common.sh@955 -- # kill 518367 00:27:48.798 14:32:02 -- common/autotest_common.sh@960 -- # wait 518367 00:27:48.798 14:32:02 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:48.798 [2024-12-16 14:31:45.892417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:48.798 [2024-12-16 14:31:45.892469] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid518367 ] 00:27:48.798 EAL: No free 2048 kB hugepages reported on node 1 00:27:48.798 [2024-12-16 14:31:45.949034] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:48.798 [2024-12-16 14:31:46.019506] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:48.798 Running I/O for 15 seconds... 00:27:48.798 [2024-12-16 14:31:48.672813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:22880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.798 [2024-12-16 14:31:48.672845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.798 [2024-12-16 14:31:48.672869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:22896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.798 [2024-12-16 14:31:48.672878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.798 [2024-12-16 14:31:48.672886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.798 [2024-12-16 14:31:48.672894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.798 [2024-12-16 14:31:48.672902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:22336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.798 [2024-12-16 14:31:48.672908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.798 [2024-12-16 14:31:48.672917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:22344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.798 [2024-12-16 14:31:48.672923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.672931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:22352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.672938] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.672946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:22376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.672952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.672960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:22400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.672967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.672986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:22408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.672993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:22416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:22432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:22952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:22968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:22976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:22984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:22992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:23000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:23016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:23032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:23040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:23056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:23072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:23080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673202] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:23112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:23120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:23136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:23144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.799 [2024-12-16 14:31:48.673262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:23152 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.799 [2024-12-16 14:31:48.673277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673285] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:23160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:23168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.799 [2024-12-16 14:31:48.673306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:23176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.799 [2024-12-16 14:31:48.673320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:23184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:23200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.799 [2024-12-16 14:31:48.673363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:22440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:22464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:22504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:22520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:22528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.799 [2024-12-16 14:31:48.673478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.799 [2024-12-16 14:31:48.673486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:22560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:22592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:22600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:22608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:22616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:22632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:22656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:22680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:23208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:23216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:23224 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.673639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:23232 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.673654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:23240 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.673667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673675] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:23256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.673695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:23264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:23272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.673724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:23280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:23288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:23296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:23304 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.673786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:23312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:23320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:22704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:22760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:22776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:22808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:22848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:22864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:23328 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.673948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:23336 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.673964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:23344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.673986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:23352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.673992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.674000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:23360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.674006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.674014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:23368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.800 [2024-12-16 14:31:48.674020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.800 [2024-12-16 14:31:48.674028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:23376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.800 [2024-12-16 14:31:48.674034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:23384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:23392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:23400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:23408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:23416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:23424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:23432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:23440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:23448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:23456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:23464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:22872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:22888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:22904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:22928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:22936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:22944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:22960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:23480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:23488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:23496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:23504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:23512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674413] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:23528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:23536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:121 nsid:1 lba:23544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674447] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:23552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:23560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:23568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:23576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:23584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:104 nsid:1 lba:23592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:23600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.801 [2024-12-16 14:31:48.674547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.801 [2024-12-16 14:31:48.674554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:23608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.801 [2024-12-16 14:31:48.674561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:23616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.802 [2024-12-16 14:31:48.674575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:23624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.802 [2024-12-16 14:31:48.674590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:89 nsid:1 lba:23632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.802 [2024-12-16 14:31:48.674604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:23008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:48.674618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:23024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:48.674632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:23048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:48.674646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:23064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:48.674661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:23088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:48.674676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674684] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:23096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:48.674690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:23104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:48.674704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674711] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x79d820 is same with the state(5) to be set 00:27:48.802 [2024-12-16 14:31:48.674719] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:48.802 [2024-12-16 14:31:48.674725] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:48.802 [2024-12-16 14:31:48.674731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23128 len:8 PRP1 0x0 PRP2 0x0 00:27:48.802 [2024-12-16 14:31:48.674737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674778] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x79d820 was disconnected and freed. reset controller. 00:27:48.802 [2024-12-16 14:31:48.674792] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:27:48.802 [2024-12-16 14:31:48.674813] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.802 [2024-12-16 14:31:48.674821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674828] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.802 [2024-12-16 14:31:48.674835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674841] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.802 [2024-12-16 14:31:48.674847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674859] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.802 [2024-12-16 14:31:48.674867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:48.674874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.802 [2024-12-16 14:31:48.676626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.802 [2024-12-16 14:31:48.676649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x77ea40 (9): Bad file descriptor 00:27:48.802 [2024-12-16 14:31:48.696709] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:48.802 [2024-12-16 14:31:52.175425] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.802 [2024-12-16 14:31:52.175457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175467] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.802 [2024-12-16 14:31:52.175479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175487] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.802 [2024-12-16 14:31:52.175494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175502] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.802 [2024-12-16 14:31:52.175509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175516] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x77ea40 is same with the state(5) to be set 00:27:48.802 [2024-12-16 14:31:52.175697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:127872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:127896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:127904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:127344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:127352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:127368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:127376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:127392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:127400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:127408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:127424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:127920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:127936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.802 [2024-12-16 14:31:52.175902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.802 [2024-12-16 14:31:52.175910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:127960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.175916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.175924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:127968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.175931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.175938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:127992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.175945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.175953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:128016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.175959] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.175967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:128024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.175974] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.175982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:128032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.175989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.175996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:128040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:128048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:128056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:128072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:128088 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.803 [2024-12-16 14:31:52.176062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:128096 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.803 [2024-12-16 14:31:52.176077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:128104 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.803 [2024-12-16 14:31:52.176091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:127432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:127440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:127448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:127464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:127504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:127512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:127560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:127584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176212] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:128112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:128120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:128128 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.803 [2024-12-16 14:31:52.176248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:127592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:127600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:127672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:127680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:127704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:127712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:127776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.803 [2024-12-16 14:31:52.176348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.803 [2024-12-16 14:31:52.176356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:127824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176363] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:128136 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:128144 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:128152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176408] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:128160 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:128168 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:128176 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:128184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:128192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:128200 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:128208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:128216 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:128224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:128232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:128240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:88 nsid:1 lba:128248 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:128256 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:128264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:128272 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:128280 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:128288 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:128296 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:128304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:128312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:128320 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:128328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:128336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:128344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:128352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:128360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:128368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:128376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:128384 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:128392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:128400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:69 nsid:1 lba:128408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.804 [2024-12-16 14:31:52.176872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:128416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.804 [2024-12-16 14:31:52.176888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.804 [2024-12-16 14:31:52.176896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:128424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.176903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.176910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:128432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.176917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.176925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:119 nsid:1 lba:128440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.176931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.176939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:128448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.176945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.176955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:128456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.176961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.176968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:83 nsid:1 lba:128464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.176975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.176982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:128472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.176989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.176996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:128480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177010] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:128488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177024] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:128496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:128504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:128512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:128520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:128528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:128536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:128544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:128552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:128560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:128568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:128576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:128584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:128592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:128600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:128608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:128616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:128624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:128632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:86 nsid:1 lba:128640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:128648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.805 [2024-12-16 14:31:52.177304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:128656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:128664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177342] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:127840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:127848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:127856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:127864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:127880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:127888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:127912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:127928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:127944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.805 [2024-12-16 14:31:52.177466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:127952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.805 [2024-12-16 14:31:52.177472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:52.177479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:127976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:52.177487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:52.177496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:127984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:52.177502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:52.177510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:128000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:52.177516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:52.177524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:128008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:52.177531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:52.177539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:128064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:52.177545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:52.177564] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:48.806 [2024-12-16 14:31:52.177570] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:48.806 [2024-12-16 14:31:52.177576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:128080 len:8 PRP1 0x0 PRP2 0x0 00:27:48.806 [2024-12-16 14:31:52.177582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:52.177623] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x78aef0 was disconnected and freed. reset controller. 00:27:48.806 [2024-12-16 14:31:52.177632] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:27:48.806 [2024-12-16 14:31:52.177639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.806 [2024-12-16 14:31:52.179354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.806 [2024-12-16 14:31:52.179376] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x77ea40 (9): Bad file descriptor 00:27:48.806 [2024-12-16 14:31:52.250824] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:48.806 [2024-12-16 14:31:56.569661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:122176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569708] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:122184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:122200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:122208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:122216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:122232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:121664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:121672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:121680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:121712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:121728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:121800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:121824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:121832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:122264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:122272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:122328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569962] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:122336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.569985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:122360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.569992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:122368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.570006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570014] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:122376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.570021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:98 nsid:1 lba:122400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.806 [2024-12-16 14:31:56.570035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570043] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:122408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.806 [2024-12-16 14:31:56.570050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:124 nsid:1 lba:122416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.806 [2024-12-16 14:31:56.570064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:122424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.570079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:122432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.806 [2024-12-16 14:31:56.570093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:122440 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.806 [2024-12-16 14:31:56.570107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:122448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.570121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:122456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.570143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.806 [2024-12-16 14:31:56.570151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:122464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.806 [2024-12-16 14:31:56.570158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:122472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:122480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:122488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.807 [2024-12-16 14:31:56.570203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:122496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.807 [2024-12-16 14:31:56.570217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:122504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.807 [2024-12-16 14:31:56.570230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:122512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:122520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:74 nsid:1 lba:122528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.807 [2024-12-16 14:31:56.570273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:122536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:122544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:122552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:122560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570344] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:122568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.807 [2024-12-16 14:31:56.570351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:122576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.807 [2024-12-16 14:31:56.570365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:122584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:122592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:122600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:121840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:121856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:121864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:121872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:121880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:121888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:121896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:121912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:121936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:121944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:121952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:121976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:121984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:121992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:122000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570620] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:122008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:122608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:122616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:122624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:122632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.807 [2024-12-16 14:31:56.570695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.807 [2024-12-16 14:31:56.570702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:122640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.808 [2024-12-16 14:31:56.570709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:122648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.808 [2024-12-16 14:31:56.570724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:64 nsid:1 lba:122656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.808 [2024-12-16 14:31:56.570738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:122664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:122672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:122680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:122688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:122696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:122016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:122048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:122056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:122064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:122080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:122128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:122136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:122144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:122704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:122712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570958] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:122160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:122168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.570987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.570995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:122192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:122240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:122248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:122256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:122280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:122288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:122720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:122728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.808 [2024-12-16 14:31:56.571103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:122736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:122744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:122752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:122760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.808 [2024-12-16 14:31:56.571161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:122768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:122776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:122784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:122792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:122800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:122808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:122816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.808 [2024-12-16 14:31:56.571261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.808 [2024-12-16 14:31:56.571269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:122824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:122832 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.809 [2024-12-16 14:31:56.571289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:122840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.809 [2024-12-16 14:31:56.571303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:122848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:122856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.809 [2024-12-16 14:31:56.571333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:122864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:122872 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.809 [2024-12-16 14:31:56.571361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:122880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:85 nsid:1 lba:122888 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.809 [2024-12-16 14:31:56.571389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:122896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:122904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.809 [2024-12-16 14:31:56.571419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:122912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.809 [2024-12-16 14:31:56.571434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:122920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:27:48.809 [2024-12-16 14:31:56.571448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:122296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:122304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:122312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:122320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:122344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:122352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:122384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:27:48.809 [2024-12-16 14:31:56.571546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7a1770 is same with the state(5) to be set 00:27:48.809 [2024-12-16 14:31:56.571562] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:27:48.809 [2024-12-16 14:31:56.571567] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:27:48.809 [2024-12-16 14:31:56.571573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:122392 len:8 PRP1 0x0 PRP2 0x0 00:27:48.809 [2024-12-16 14:31:56.571579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571619] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x7a1770 was disconnected and freed. reset controller. 00:27:48.809 [2024-12-16 14:31:56.571627] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:27:48.809 [2024-12-16 14:31:56.571650] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.809 [2024-12-16 14:31:56.571657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571665] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.809 [2024-12-16 14:31:56.571671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571678] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.809 [2024-12-16 14:31:56.571684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571691] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:48.809 [2024-12-16 14:31:56.571697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:48.809 [2024-12-16 14:31:56.571704] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:48.809 [2024-12-16 14:31:56.573616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:48.809 [2024-12-16 14:31:56.573643] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x77ea40 (9): Bad file descriptor 00:27:48.809 [2024-12-16 14:31:56.682416] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:48.809 00:27:48.809 Latency(us) 00:27:48.809 [2024-12-16T13:32:03.383Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:48.809 [2024-12-16T13:32:03.383Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:48.809 Verification LBA range: start 0x0 length 0x4000 00:27:48.809 NVMe0n1 : 15.00 17302.39 67.59 978.23 0.00 6989.14 462.26 13606.52 00:27:48.809 [2024-12-16T13:32:03.383Z] =================================================================================================================== 00:27:48.809 [2024-12-16T13:32:03.383Z] Total : 17302.39 67.59 978.23 0.00 6989.14 462.26 13606.52 00:27:48.809 Received shutdown signal, test time was about 15.000000 seconds 00:27:48.809 00:27:48.809 Latency(us) 00:27:48.809 [2024-12-16T13:32:03.383Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:48.809 [2024-12-16T13:32:03.383Z] =================================================================================================================== 00:27:48.809 [2024-12-16T13:32:03.383Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:27:48.809 14:32:02 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:27:48.809 14:32:02 -- host/failover.sh@65 -- # count=3 00:27:48.809 14:32:02 -- host/failover.sh@67 -- # (( count != 3 )) 00:27:48.809 14:32:02 -- host/failover.sh@73 -- # bdevperf_pid=521125 00:27:48.809 14:32:02 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:27:48.809 14:32:02 -- host/failover.sh@75 -- # waitforlisten 521125 /var/tmp/bdevperf.sock 00:27:48.809 14:32:02 -- common/autotest_common.sh@829 -- # '[' -z 521125 ']' 00:27:48.809 14:32:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:27:48.809 14:32:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:48.809 14:32:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:27:48.809 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:27:48.809 14:32:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:48.809 14:32:02 -- common/autotest_common.sh@10 -- # set +x 00:27:49.375 14:32:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:49.375 14:32:03 -- common/autotest_common.sh@862 -- # return 0 00:27:49.375 14:32:03 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:27:49.375 [2024-12-16 14:32:03.919531] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:27:49.633 14:32:03 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:27:49.633 [2024-12-16 14:32:04.108067] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:27:49.633 14:32:04 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:49.890 NVMe0n1 00:27:49.890 14:32:04 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:50.148 00:27:50.148 14:32:04 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:50.405 00:27:50.405 14:32:04 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:50.405 14:32:04 -- host/failover.sh@82 -- # grep -q NVMe0 00:27:50.662 14:32:05 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:50.920 14:32:05 -- host/failover.sh@87 -- # sleep 3 00:27:54.197 14:32:08 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:54.197 14:32:08 -- host/failover.sh@88 -- # grep -q NVMe0 00:27:54.197 14:32:08 -- host/failover.sh@90 -- # run_test_pid=522039 00:27:54.197 14:32:08 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:27:54.197 14:32:08 -- host/failover.sh@92 -- # wait 522039 00:27:55.130 0 00:27:55.130 14:32:09 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:55.130 [2024-12-16 14:32:02.939249] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:55.130 [2024-12-16 14:32:02.939298] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid521125 ] 00:27:55.130 EAL: No free 2048 kB hugepages reported on node 1 00:27:55.130 [2024-12-16 14:32:02.995388] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:27:55.130 [2024-12-16 14:32:03.062345] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:55.130 [2024-12-16 14:32:05.302986] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:27:55.130 [2024-12-16 14:32:05.303032] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:27:55.130 [2024-12-16 14:32:05.303043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:55.130 [2024-12-16 14:32:05.303051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:27:55.130 [2024-12-16 14:32:05.303058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:55.130 [2024-12-16 14:32:05.303065] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:27:55.130 [2024-12-16 14:32:05.303071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:55.130 [2024-12-16 14:32:05.303078] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:27:55.130 [2024-12-16 14:32:05.303084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:27:55.130 [2024-12-16 14:32:05.303091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:27:55.130 [2024-12-16 14:32:05.303114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:27:55.130 [2024-12-16 14:32:05.303127] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c2fa40 (9): Bad file descriptor 00:27:55.130 [2024-12-16 14:32:05.405017] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:27:55.130 Running I/O for 1 seconds... 00:27:55.130 00:27:55.130 Latency(us) 00:27:55.130 [2024-12-16T13:32:09.704Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:27:55.130 [2024-12-16T13:32:09.704Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:27:55.130 Verification LBA range: start 0x0 length 0x4000 00:27:55.130 NVMe0n1 : 1.00 17472.09 68.25 0.00 0.00 7297.59 752.88 7895.53 00:27:55.130 [2024-12-16T13:32:09.704Z] =================================================================================================================== 00:27:55.130 [2024-12-16T13:32:09.704Z] Total : 17472.09 68.25 0.00 0.00 7297.59 752.88 7895.53 00:27:55.130 14:32:09 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:55.130 14:32:09 -- host/failover.sh@95 -- # grep -q NVMe0 00:27:55.388 14:32:09 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:55.645 14:32:10 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:55.645 14:32:10 -- host/failover.sh@99 -- # grep -q NVMe0 00:27:55.903 14:32:10 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:27:55.903 14:32:10 -- host/failover.sh@101 -- # sleep 3 00:27:59.178 14:32:13 -- host/failover.sh@103 -- # grep -q NVMe0 00:27:59.178 14:32:13 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:27:59.179 14:32:13 -- host/failover.sh@108 -- # killprocess 521125 00:27:59.179 14:32:13 -- common/autotest_common.sh@936 -- # '[' -z 521125 ']' 00:27:59.179 14:32:13 -- common/autotest_common.sh@940 -- # kill -0 521125 00:27:59.179 14:32:13 -- common/autotest_common.sh@941 -- # uname 00:27:59.179 14:32:13 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:59.179 14:32:13 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 521125 00:27:59.179 14:32:13 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:59.179 14:32:13 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:59.179 14:32:13 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 521125' 00:27:59.179 killing process with pid 521125 00:27:59.179 14:32:13 -- common/autotest_common.sh@955 -- # kill 521125 00:27:59.179 14:32:13 -- common/autotest_common.sh@960 -- # wait 521125 00:27:59.436 14:32:13 -- host/failover.sh@110 -- # sync 00:27:59.436 14:32:13 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:59.694 14:32:14 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:27:59.694 14:32:14 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:27:59.694 14:32:14 -- host/failover.sh@116 -- # nvmftestfini 00:27:59.694 14:32:14 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:59.694 14:32:14 -- nvmf/common.sh@116 -- # sync 00:27:59.694 14:32:14 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:59.694 14:32:14 -- nvmf/common.sh@119 -- # set +e 00:27:59.694 14:32:14 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:59.695 14:32:14 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:59.695 rmmod nvme_tcp 00:27:59.695 rmmod nvme_fabrics 00:27:59.695 rmmod nvme_keyring 00:27:59.695 14:32:14 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:59.695 14:32:14 -- nvmf/common.sh@123 -- # set -e 00:27:59.695 14:32:14 -- nvmf/common.sh@124 -- # return 0 00:27:59.695 14:32:14 -- nvmf/common.sh@477 -- # '[' -n 518001 ']' 00:27:59.695 14:32:14 -- nvmf/common.sh@478 -- # killprocess 518001 00:27:59.695 14:32:14 -- common/autotest_common.sh@936 -- # '[' -z 518001 ']' 00:27:59.695 14:32:14 -- common/autotest_common.sh@940 -- # kill -0 518001 00:27:59.695 14:32:14 -- common/autotest_common.sh@941 -- # uname 00:27:59.695 14:32:14 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:59.695 14:32:14 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 518001 00:27:59.695 14:32:14 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:27:59.695 14:32:14 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:27:59.695 14:32:14 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 518001' 00:27:59.695 killing process with pid 518001 00:27:59.695 14:32:14 -- common/autotest_common.sh@955 -- # kill 518001 00:27:59.695 14:32:14 -- common/autotest_common.sh@960 -- # wait 518001 00:27:59.954 14:32:14 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:59.954 14:32:14 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:59.954 14:32:14 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:59.954 14:32:14 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:59.954 14:32:14 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:59.954 14:32:14 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:59.954 14:32:14 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:59.954 14:32:14 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:02.484 14:32:16 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:02.484 00:28:02.484 real 0m38.536s 00:28:02.484 user 2m3.945s 00:28:02.484 sys 0m7.782s 00:28:02.484 14:32:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:02.484 14:32:16 -- common/autotest_common.sh@10 -- # set +x 00:28:02.484 ************************************ 00:28:02.484 END TEST nvmf_failover 00:28:02.484 ************************************ 00:28:02.484 14:32:16 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:02.484 14:32:16 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:02.484 14:32:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:02.484 14:32:16 -- common/autotest_common.sh@10 -- # set +x 00:28:02.484 ************************************ 00:28:02.484 START TEST nvmf_discovery 00:28:02.484 ************************************ 00:28:02.484 14:32:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:02.484 * Looking for test storage... 00:28:02.484 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:02.484 14:32:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:02.484 14:32:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:02.484 14:32:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:02.484 14:32:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:02.484 14:32:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:02.484 14:32:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:02.484 14:32:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:02.484 14:32:16 -- scripts/common.sh@335 -- # IFS=.-: 00:28:02.484 14:32:16 -- scripts/common.sh@335 -- # read -ra ver1 00:28:02.484 14:32:16 -- scripts/common.sh@336 -- # IFS=.-: 00:28:02.484 14:32:16 -- scripts/common.sh@336 -- # read -ra ver2 00:28:02.484 14:32:16 -- scripts/common.sh@337 -- # local 'op=<' 00:28:02.484 14:32:16 -- scripts/common.sh@339 -- # ver1_l=2 00:28:02.484 14:32:16 -- scripts/common.sh@340 -- # ver2_l=1 00:28:02.484 14:32:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:02.484 14:32:16 -- scripts/common.sh@343 -- # case "$op" in 00:28:02.484 14:32:16 -- scripts/common.sh@344 -- # : 1 00:28:02.484 14:32:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:02.484 14:32:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:02.484 14:32:16 -- scripts/common.sh@364 -- # decimal 1 00:28:02.484 14:32:16 -- scripts/common.sh@352 -- # local d=1 00:28:02.484 14:32:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:02.484 14:32:16 -- scripts/common.sh@354 -- # echo 1 00:28:02.484 14:32:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:02.484 14:32:16 -- scripts/common.sh@365 -- # decimal 2 00:28:02.484 14:32:16 -- scripts/common.sh@352 -- # local d=2 00:28:02.484 14:32:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:02.484 14:32:16 -- scripts/common.sh@354 -- # echo 2 00:28:02.484 14:32:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:02.484 14:32:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:02.484 14:32:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:02.484 14:32:16 -- scripts/common.sh@367 -- # return 0 00:28:02.484 14:32:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:02.485 14:32:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:02.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.485 --rc genhtml_branch_coverage=1 00:28:02.485 --rc genhtml_function_coverage=1 00:28:02.485 --rc genhtml_legend=1 00:28:02.485 --rc geninfo_all_blocks=1 00:28:02.485 --rc geninfo_unexecuted_blocks=1 00:28:02.485 00:28:02.485 ' 00:28:02.485 14:32:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:02.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.485 --rc genhtml_branch_coverage=1 00:28:02.485 --rc genhtml_function_coverage=1 00:28:02.485 --rc genhtml_legend=1 00:28:02.485 --rc geninfo_all_blocks=1 00:28:02.485 --rc geninfo_unexecuted_blocks=1 00:28:02.485 00:28:02.485 ' 00:28:02.485 14:32:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:02.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.485 --rc genhtml_branch_coverage=1 00:28:02.485 --rc genhtml_function_coverage=1 00:28:02.485 --rc genhtml_legend=1 00:28:02.485 --rc geninfo_all_blocks=1 00:28:02.485 --rc geninfo_unexecuted_blocks=1 00:28:02.485 00:28:02.485 ' 00:28:02.485 14:32:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:02.485 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:02.485 --rc genhtml_branch_coverage=1 00:28:02.485 --rc genhtml_function_coverage=1 00:28:02.485 --rc genhtml_legend=1 00:28:02.485 --rc geninfo_all_blocks=1 00:28:02.485 --rc geninfo_unexecuted_blocks=1 00:28:02.485 00:28:02.485 ' 00:28:02.485 14:32:16 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:02.485 14:32:16 -- nvmf/common.sh@7 -- # uname -s 00:28:02.485 14:32:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:02.485 14:32:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:02.485 14:32:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:02.485 14:32:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:02.485 14:32:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:02.485 14:32:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:02.485 14:32:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:02.485 14:32:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:02.485 14:32:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:02.485 14:32:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:02.485 14:32:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:28:02.485 14:32:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:28:02.485 14:32:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:02.485 14:32:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:02.485 14:32:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:02.485 14:32:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:02.485 14:32:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:02.485 14:32:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:02.485 14:32:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:02.485 14:32:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.485 14:32:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.485 14:32:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.485 14:32:16 -- paths/export.sh@5 -- # export PATH 00:28:02.485 14:32:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:02.485 14:32:16 -- nvmf/common.sh@46 -- # : 0 00:28:02.485 14:32:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:02.485 14:32:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:02.485 14:32:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:02.485 14:32:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:02.485 14:32:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:02.485 14:32:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:02.485 14:32:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:02.485 14:32:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:02.485 14:32:16 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:02.485 14:32:16 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:02.485 14:32:16 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:02.485 14:32:16 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:02.485 14:32:16 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:02.485 14:32:16 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:02.485 14:32:16 -- host/discovery.sh@25 -- # nvmftestinit 00:28:02.485 14:32:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:02.485 14:32:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:02.485 14:32:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:02.485 14:32:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:02.485 14:32:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:02.485 14:32:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:02.485 14:32:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:02.485 14:32:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:02.485 14:32:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:02.485 14:32:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:02.485 14:32:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:02.485 14:32:16 -- common/autotest_common.sh@10 -- # set +x 00:28:07.757 14:32:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:07.757 14:32:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:07.757 14:32:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:07.757 14:32:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:07.757 14:32:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:07.757 14:32:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:07.757 14:32:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:07.757 14:32:21 -- nvmf/common.sh@294 -- # net_devs=() 00:28:07.757 14:32:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:07.757 14:32:21 -- nvmf/common.sh@295 -- # e810=() 00:28:07.757 14:32:21 -- nvmf/common.sh@295 -- # local -ga e810 00:28:07.757 14:32:21 -- nvmf/common.sh@296 -- # x722=() 00:28:07.757 14:32:21 -- nvmf/common.sh@296 -- # local -ga x722 00:28:07.757 14:32:21 -- nvmf/common.sh@297 -- # mlx=() 00:28:07.757 14:32:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:07.757 14:32:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:07.757 14:32:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:07.757 14:32:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:07.757 14:32:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:07.757 14:32:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:07.757 14:32:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:28:07.757 Found 0000:af:00.0 (0x8086 - 0x159b) 00:28:07.757 14:32:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:07.757 14:32:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:28:07.757 Found 0000:af:00.1 (0x8086 - 0x159b) 00:28:07.757 14:32:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:07.757 14:32:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:07.757 14:32:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:07.757 14:32:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:07.757 14:32:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:07.757 14:32:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:28:07.757 Found net devices under 0000:af:00.0: cvl_0_0 00:28:07.757 14:32:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:07.757 14:32:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:07.757 14:32:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:07.757 14:32:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:07.757 14:32:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:07.757 14:32:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:28:07.757 Found net devices under 0000:af:00.1: cvl_0_1 00:28:07.757 14:32:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:07.757 14:32:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:07.757 14:32:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:07.757 14:32:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:07.757 14:32:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:07.758 14:32:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:07.758 14:32:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:07.758 14:32:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:07.758 14:32:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:07.758 14:32:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:07.758 14:32:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:07.758 14:32:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:07.758 14:32:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:07.758 14:32:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:07.758 14:32:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:07.758 14:32:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:07.758 14:32:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:07.758 14:32:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:07.758 14:32:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:07.758 14:32:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:07.758 14:32:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:07.758 14:32:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:07.758 14:32:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:07.758 14:32:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:07.758 14:32:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:07.758 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:07.758 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.355 ms 00:28:07.758 00:28:07.758 --- 10.0.0.2 ping statistics --- 00:28:07.758 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:07.758 rtt min/avg/max/mdev = 0.355/0.355/0.355/0.000 ms 00:28:07.758 14:32:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:07.758 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:07.758 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.220 ms 00:28:07.758 00:28:07.758 --- 10.0.0.1 ping statistics --- 00:28:07.758 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:07.758 rtt min/avg/max/mdev = 0.220/0.220/0.220/0.000 ms 00:28:07.758 14:32:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:07.758 14:32:21 -- nvmf/common.sh@410 -- # return 0 00:28:07.758 14:32:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:07.758 14:32:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:07.758 14:32:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:07.758 14:32:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:07.758 14:32:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:07.758 14:32:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:07.758 14:32:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:07.758 14:32:21 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:07.758 14:32:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:07.758 14:32:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:07.758 14:32:21 -- common/autotest_common.sh@10 -- # set +x 00:28:07.758 14:32:21 -- nvmf/common.sh@469 -- # nvmfpid=526312 00:28:07.758 14:32:21 -- nvmf/common.sh@470 -- # waitforlisten 526312 00:28:07.758 14:32:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:07.758 14:32:21 -- common/autotest_common.sh@829 -- # '[' -z 526312 ']' 00:28:07.758 14:32:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:07.758 14:32:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:07.758 14:32:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:07.758 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:07.758 14:32:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:07.758 14:32:21 -- common/autotest_common.sh@10 -- # set +x 00:28:07.758 [2024-12-16 14:32:21.908287] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:07.758 [2024-12-16 14:32:21.908334] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:07.758 EAL: No free 2048 kB hugepages reported on node 1 00:28:07.758 [2024-12-16 14:32:21.966419] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:07.758 [2024-12-16 14:32:22.034138] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:07.758 [2024-12-16 14:32:22.034262] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:07.758 [2024-12-16 14:32:22.034270] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:07.758 [2024-12-16 14:32:22.034276] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:07.758 [2024-12-16 14:32:22.034296] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:08.325 14:32:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:08.326 14:32:22 -- common/autotest_common.sh@862 -- # return 0 00:28:08.326 14:32:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:08.326 14:32:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:08.326 14:32:22 -- common/autotest_common.sh@10 -- # set +x 00:28:08.326 14:32:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:08.326 14:32:22 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:08.326 14:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.326 14:32:22 -- common/autotest_common.sh@10 -- # set +x 00:28:08.326 [2024-12-16 14:32:22.767669] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:08.326 14:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.326 14:32:22 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:08.326 14:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.326 14:32:22 -- common/autotest_common.sh@10 -- # set +x 00:28:08.326 [2024-12-16 14:32:22.779851] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:08.326 14:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.326 14:32:22 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:08.326 14:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.326 14:32:22 -- common/autotest_common.sh@10 -- # set +x 00:28:08.326 null0 00:28:08.326 14:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.326 14:32:22 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:08.326 14:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.326 14:32:22 -- common/autotest_common.sh@10 -- # set +x 00:28:08.326 null1 00:28:08.326 14:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.326 14:32:22 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:08.326 14:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:08.326 14:32:22 -- common/autotest_common.sh@10 -- # set +x 00:28:08.326 14:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:08.326 14:32:22 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:08.326 14:32:22 -- host/discovery.sh@45 -- # hostpid=526556 00:28:08.326 14:32:22 -- host/discovery.sh@46 -- # waitforlisten 526556 /tmp/host.sock 00:28:08.326 14:32:22 -- common/autotest_common.sh@829 -- # '[' -z 526556 ']' 00:28:08.326 14:32:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:08.326 14:32:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:08.326 14:32:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:08.326 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:08.326 14:32:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:08.326 14:32:22 -- common/autotest_common.sh@10 -- # set +x 00:28:08.326 [2024-12-16 14:32:22.840265] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:08.326 [2024-12-16 14:32:22.840305] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid526556 ] 00:28:08.326 EAL: No free 2048 kB hugepages reported on node 1 00:28:08.326 [2024-12-16 14:32:22.889522] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:08.585 [2024-12-16 14:32:22.964776] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:08.585 [2024-12-16 14:32:22.964897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:09.152 14:32:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:09.152 14:32:23 -- common/autotest_common.sh@862 -- # return 0 00:28:09.152 14:32:23 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:09.152 14:32:23 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:09.152 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.152 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.152 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.152 14:32:23 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:09.152 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.152 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.152 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.152 14:32:23 -- host/discovery.sh@72 -- # notify_id=0 00:28:09.152 14:32:23 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:09.153 14:32:23 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:09.153 14:32:23 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:09.153 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.153 14:32:23 -- host/discovery.sh@59 -- # sort 00:28:09.153 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.153 14:32:23 -- host/discovery.sh@59 -- # xargs 00:28:09.153 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.153 14:32:23 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:09.411 14:32:23 -- host/discovery.sh@79 -- # get_bdev_list 00:28:09.411 14:32:23 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:09.412 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # sort 00:28:09.412 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # xargs 00:28:09.412 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.412 14:32:23 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:09.412 14:32:23 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:09.412 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.412 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.412 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.412 14:32:23 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:09.412 14:32:23 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:09.412 14:32:23 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:09.412 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.412 14:32:23 -- host/discovery.sh@59 -- # sort 00:28:09.412 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.412 14:32:23 -- host/discovery.sh@59 -- # xargs 00:28:09.412 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.412 14:32:23 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:09.412 14:32:23 -- host/discovery.sh@83 -- # get_bdev_list 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:09.412 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # sort 00:28:09.412 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # xargs 00:28:09.412 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.412 14:32:23 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:09.412 14:32:23 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:09.412 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.412 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.412 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.412 14:32:23 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:09.412 14:32:23 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:09.412 14:32:23 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:09.412 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.412 14:32:23 -- host/discovery.sh@59 -- # sort 00:28:09.412 14:32:23 -- host/discovery.sh@59 -- # xargs 00:28:09.412 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.412 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.412 14:32:23 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:09.412 14:32:23 -- host/discovery.sh@87 -- # get_bdev_list 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # xargs 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:09.412 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.412 14:32:23 -- host/discovery.sh@55 -- # sort 00:28:09.412 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.412 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.412 14:32:23 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:09.412 14:32:23 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:09.412 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.412 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.412 [2024-12-16 14:32:23.978984] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:09.412 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.671 14:32:23 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:09.671 14:32:23 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:09.671 14:32:23 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:09.671 14:32:23 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.671 14:32:23 -- common/autotest_common.sh@10 -- # set +x 00:28:09.671 14:32:23 -- host/discovery.sh@59 -- # sort 00:28:09.671 14:32:23 -- host/discovery.sh@59 -- # xargs 00:28:09.671 14:32:23 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.671 14:32:24 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:09.671 14:32:24 -- host/discovery.sh@93 -- # get_bdev_list 00:28:09.671 14:32:24 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:09.671 14:32:24 -- host/discovery.sh@55 -- # xargs 00:28:09.671 14:32:24 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:09.671 14:32:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.671 14:32:24 -- host/discovery.sh@55 -- # sort 00:28:09.671 14:32:24 -- common/autotest_common.sh@10 -- # set +x 00:28:09.671 14:32:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.671 14:32:24 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:09.671 14:32:24 -- host/discovery.sh@94 -- # get_notification_count 00:28:09.671 14:32:24 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:09.671 14:32:24 -- host/discovery.sh@74 -- # jq '. | length' 00:28:09.671 14:32:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.671 14:32:24 -- common/autotest_common.sh@10 -- # set +x 00:28:09.671 14:32:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.671 14:32:24 -- host/discovery.sh@74 -- # notification_count=0 00:28:09.671 14:32:24 -- host/discovery.sh@75 -- # notify_id=0 00:28:09.671 14:32:24 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:09.671 14:32:24 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:09.671 14:32:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:09.671 14:32:24 -- common/autotest_common.sh@10 -- # set +x 00:28:09.671 14:32:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:09.671 14:32:24 -- host/discovery.sh@100 -- # sleep 1 00:28:10.238 [2024-12-16 14:32:24.727004] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:10.238 [2024-12-16 14:32:24.727027] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:10.238 [2024-12-16 14:32:24.727039] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:10.497 [2024-12-16 14:32:24.813286] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:10.497 [2024-12-16 14:32:25.030463] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:10.497 [2024-12-16 14:32:25.030480] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:10.755 14:32:25 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:10.755 14:32:25 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:10.755 14:32:25 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:10.755 14:32:25 -- host/discovery.sh@59 -- # sort 00:28:10.755 14:32:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:10.755 14:32:25 -- host/discovery.sh@59 -- # xargs 00:28:10.755 14:32:25 -- common/autotest_common.sh@10 -- # set +x 00:28:10.755 14:32:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@102 -- # get_bdev_list 00:28:10.755 14:32:25 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:10.755 14:32:25 -- host/discovery.sh@55 -- # xargs 00:28:10.755 14:32:25 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:10.755 14:32:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:10.755 14:32:25 -- host/discovery.sh@55 -- # sort 00:28:10.755 14:32:25 -- common/autotest_common.sh@10 -- # set +x 00:28:10.755 14:32:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:10.755 14:32:25 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:10.755 14:32:25 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:10.755 14:32:25 -- host/discovery.sh@63 -- # sort -n 00:28:10.755 14:32:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:10.755 14:32:25 -- host/discovery.sh@63 -- # xargs 00:28:10.755 14:32:25 -- common/autotest_common.sh@10 -- # set +x 00:28:10.755 14:32:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@104 -- # get_notification_count 00:28:10.755 14:32:25 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:10.755 14:32:25 -- host/discovery.sh@74 -- # jq '. | length' 00:28:10.755 14:32:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:10.755 14:32:25 -- common/autotest_common.sh@10 -- # set +x 00:28:10.755 14:32:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@74 -- # notification_count=1 00:28:10.755 14:32:25 -- host/discovery.sh@75 -- # notify_id=1 00:28:10.755 14:32:25 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:10.755 14:32:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:10.755 14:32:25 -- common/autotest_common.sh@10 -- # set +x 00:28:10.755 14:32:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:10.755 14:32:25 -- host/discovery.sh@109 -- # sleep 1 00:28:12.132 14:32:26 -- host/discovery.sh@110 -- # get_bdev_list 00:28:12.132 14:32:26 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:12.132 14:32:26 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:12.132 14:32:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.132 14:32:26 -- host/discovery.sh@55 -- # sort 00:28:12.132 14:32:26 -- common/autotest_common.sh@10 -- # set +x 00:28:12.132 14:32:26 -- host/discovery.sh@55 -- # xargs 00:28:12.132 14:32:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.132 14:32:26 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:12.132 14:32:26 -- host/discovery.sh@111 -- # get_notification_count 00:28:12.132 14:32:26 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:12.132 14:32:26 -- host/discovery.sh@74 -- # jq '. | length' 00:28:12.132 14:32:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.132 14:32:26 -- common/autotest_common.sh@10 -- # set +x 00:28:12.132 14:32:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.132 14:32:26 -- host/discovery.sh@74 -- # notification_count=1 00:28:12.132 14:32:26 -- host/discovery.sh@75 -- # notify_id=2 00:28:12.132 14:32:26 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:12.132 14:32:26 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:12.132 14:32:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.132 14:32:26 -- common/autotest_common.sh@10 -- # set +x 00:28:12.132 [2024-12-16 14:32:26.425673] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:12.132 [2024-12-16 14:32:26.426097] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:12.132 [2024-12-16 14:32:26.426134] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:12.132 14:32:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.132 14:32:26 -- host/discovery.sh@117 -- # sleep 1 00:28:12.132 [2024-12-16 14:32:26.553498] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:12.391 [2024-12-16 14:32:26.855711] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:12.391 [2024-12-16 14:32:26.855728] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:12.391 [2024-12-16 14:32:26.855732] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:12.958 14:32:27 -- host/discovery.sh@118 -- # get_subsystem_names 00:28:12.958 14:32:27 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:12.958 14:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.958 14:32:27 -- common/autotest_common.sh@10 -- # set +x 00:28:12.958 14:32:27 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:12.958 14:32:27 -- host/discovery.sh@59 -- # sort 00:28:12.958 14:32:27 -- host/discovery.sh@59 -- # xargs 00:28:12.958 14:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.958 14:32:27 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:12.958 14:32:27 -- host/discovery.sh@119 -- # get_bdev_list 00:28:12.958 14:32:27 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:12.958 14:32:27 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:12.958 14:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.958 14:32:27 -- host/discovery.sh@55 -- # sort 00:28:12.958 14:32:27 -- common/autotest_common.sh@10 -- # set +x 00:28:12.958 14:32:27 -- host/discovery.sh@55 -- # xargs 00:28:12.958 14:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:12.958 14:32:27 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:12.958 14:32:27 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:28:12.958 14:32:27 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:12.958 14:32:27 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:12.958 14:32:27 -- host/discovery.sh@63 -- # sort -n 00:28:12.958 14:32:27 -- host/discovery.sh@63 -- # xargs 00:28:12.958 14:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:12.958 14:32:27 -- common/autotest_common.sh@10 -- # set +x 00:28:13.218 14:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:13.218 14:32:27 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:28:13.218 14:32:27 -- host/discovery.sh@121 -- # get_notification_count 00:28:13.218 14:32:27 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:13.218 14:32:27 -- host/discovery.sh@74 -- # jq '. | length' 00:28:13.218 14:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:13.218 14:32:27 -- common/autotest_common.sh@10 -- # set +x 00:28:13.218 14:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:13.218 14:32:27 -- host/discovery.sh@74 -- # notification_count=0 00:28:13.218 14:32:27 -- host/discovery.sh@75 -- # notify_id=2 00:28:13.218 14:32:27 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:28:13.218 14:32:27 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:13.218 14:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:13.218 14:32:27 -- common/autotest_common.sh@10 -- # set +x 00:28:13.218 [2024-12-16 14:32:27.621404] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:13.218 [2024-12-16 14:32:27.621425] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:13.218 [2024-12-16 14:32:27.624758] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.218 [2024-12-16 14:32:27.624773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.218 [2024-12-16 14:32:27.624781] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.218 [2024-12-16 14:32:27.624791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.218 [2024-12-16 14:32:27.624799] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.218 [2024-12-16 14:32:27.624806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.218 [2024-12-16 14:32:27.624812] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:13.218 [2024-12-16 14:32:27.624819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:13.218 [2024-12-16 14:32:27.624825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe670 is same with the state(5) to be set 00:28:13.218 14:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:13.218 14:32:27 -- host/discovery.sh@127 -- # sleep 1 00:28:13.218 [2024-12-16 14:32:27.634773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe670 (9): Bad file descriptor 00:28:13.218 [2024-12-16 14:32:27.644810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:13.218 [2024-12-16 14:32:27.645067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.645301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.645312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbe670 with addr=10.0.0.2, port=4420 00:28:13.218 [2024-12-16 14:32:27.645319] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe670 is same with the state(5) to be set 00:28:13.218 [2024-12-16 14:32:27.645330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe670 (9): Bad file descriptor 00:28:13.218 [2024-12-16 14:32:27.645340] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:13.218 [2024-12-16 14:32:27.645347] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:13.218 [2024-12-16 14:32:27.645354] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:13.218 [2024-12-16 14:32:27.645364] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:13.218 [2024-12-16 14:32:27.654863] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:13.218 [2024-12-16 14:32:27.655102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.655251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.655262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbe670 with addr=10.0.0.2, port=4420 00:28:13.218 [2024-12-16 14:32:27.655268] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe670 is same with the state(5) to be set 00:28:13.218 [2024-12-16 14:32:27.655279] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe670 (9): Bad file descriptor 00:28:13.218 [2024-12-16 14:32:27.655288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:13.218 [2024-12-16 14:32:27.655293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:13.218 [2024-12-16 14:32:27.655300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:13.218 [2024-12-16 14:32:27.655308] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:13.218 [2024-12-16 14:32:27.664910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:13.218 [2024-12-16 14:32:27.665129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.665282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.665292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbe670 with addr=10.0.0.2, port=4420 00:28:13.218 [2024-12-16 14:32:27.665300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe670 is same with the state(5) to be set 00:28:13.218 [2024-12-16 14:32:27.665310] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe670 (9): Bad file descriptor 00:28:13.218 [2024-12-16 14:32:27.665319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:13.218 [2024-12-16 14:32:27.665325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:13.218 [2024-12-16 14:32:27.665331] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:13.218 [2024-12-16 14:32:27.665340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:13.218 [2024-12-16 14:32:27.674961] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:13.218 [2024-12-16 14:32:27.675229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.675336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.675346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbe670 with addr=10.0.0.2, port=4420 00:28:13.218 [2024-12-16 14:32:27.675353] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe670 is same with the state(5) to be set 00:28:13.218 [2024-12-16 14:32:27.675363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe670 (9): Bad file descriptor 00:28:13.218 [2024-12-16 14:32:27.675372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:13.218 [2024-12-16 14:32:27.675378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:13.218 [2024-12-16 14:32:27.675384] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:13.218 [2024-12-16 14:32:27.675393] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:13.218 [2024-12-16 14:32:27.685012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:13.218 [2024-12-16 14:32:27.685272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.685423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.685433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbe670 with addr=10.0.0.2, port=4420 00:28:13.218 [2024-12-16 14:32:27.685440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe670 is same with the state(5) to be set 00:28:13.218 [2024-12-16 14:32:27.685450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe670 (9): Bad file descriptor 00:28:13.218 [2024-12-16 14:32:27.685459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:13.218 [2024-12-16 14:32:27.685465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:13.218 [2024-12-16 14:32:27.685471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:13.218 [2024-12-16 14:32:27.685480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:13.218 [2024-12-16 14:32:27.695059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:13.218 [2024-12-16 14:32:27.695308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.695532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.695543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbe670 with addr=10.0.0.2, port=4420 00:28:13.218 [2024-12-16 14:32:27.695553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe670 is same with the state(5) to be set 00:28:13.218 [2024-12-16 14:32:27.695563] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe670 (9): Bad file descriptor 00:28:13.218 [2024-12-16 14:32:27.695572] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:13.218 [2024-12-16 14:32:27.695578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:13.218 [2024-12-16 14:32:27.695584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:13.218 [2024-12-16 14:32:27.695592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:13.218 [2024-12-16 14:32:27.705107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:13.218 [2024-12-16 14:32:27.705362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.218 [2024-12-16 14:32:27.705510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:13.219 [2024-12-16 14:32:27.705520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbe670 with addr=10.0.0.2, port=4420 00:28:13.219 [2024-12-16 14:32:27.705527] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1cbe670 is same with the state(5) to be set 00:28:13.219 [2024-12-16 14:32:27.705536] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1cbe670 (9): Bad file descriptor 00:28:13.219 [2024-12-16 14:32:27.705545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:13.219 [2024-12-16 14:32:27.705551] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:13.219 [2024-12-16 14:32:27.705557] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:13.219 [2024-12-16 14:32:27.705565] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:13.219 [2024-12-16 14:32:27.708670] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:28:13.219 [2024-12-16 14:32:27.708684] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:14.237 14:32:28 -- host/discovery.sh@128 -- # get_subsystem_names 00:28:14.237 14:32:28 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:14.237 14:32:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.237 14:32:28 -- common/autotest_common.sh@10 -- # set +x 00:28:14.237 14:32:28 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:14.237 14:32:28 -- host/discovery.sh@59 -- # sort 00:28:14.237 14:32:28 -- host/discovery.sh@59 -- # xargs 00:28:14.237 14:32:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.237 14:32:28 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:14.237 14:32:28 -- host/discovery.sh@129 -- # get_bdev_list 00:28:14.237 14:32:28 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:14.237 14:32:28 -- host/discovery.sh@55 -- # xargs 00:28:14.237 14:32:28 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:14.237 14:32:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.237 14:32:28 -- host/discovery.sh@55 -- # sort 00:28:14.237 14:32:28 -- common/autotest_common.sh@10 -- # set +x 00:28:14.237 14:32:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.237 14:32:28 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:14.237 14:32:28 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:28:14.237 14:32:28 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:14.237 14:32:28 -- host/discovery.sh@63 -- # sort -n 00:28:14.237 14:32:28 -- host/discovery.sh@63 -- # xargs 00:28:14.237 14:32:28 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:14.237 14:32:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.237 14:32:28 -- common/autotest_common.sh@10 -- # set +x 00:28:14.237 14:32:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.237 14:32:28 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:28:14.237 14:32:28 -- host/discovery.sh@131 -- # get_notification_count 00:28:14.237 14:32:28 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:14.237 14:32:28 -- host/discovery.sh@74 -- # jq '. | length' 00:28:14.237 14:32:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.237 14:32:28 -- common/autotest_common.sh@10 -- # set +x 00:28:14.237 14:32:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.517 14:32:28 -- host/discovery.sh@74 -- # notification_count=0 00:28:14.517 14:32:28 -- host/discovery.sh@75 -- # notify_id=2 00:28:14.517 14:32:28 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:28:14.517 14:32:28 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:28:14.517 14:32:28 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:14.517 14:32:28 -- common/autotest_common.sh@10 -- # set +x 00:28:14.517 14:32:28 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:14.517 14:32:28 -- host/discovery.sh@135 -- # sleep 1 00:28:15.475 14:32:29 -- host/discovery.sh@136 -- # get_subsystem_names 00:28:15.475 14:32:29 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:15.475 14:32:29 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:15.475 14:32:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.475 14:32:29 -- host/discovery.sh@59 -- # sort 00:28:15.475 14:32:29 -- common/autotest_common.sh@10 -- # set +x 00:28:15.475 14:32:29 -- host/discovery.sh@59 -- # xargs 00:28:15.475 14:32:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:15.475 14:32:29 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:28:15.475 14:32:29 -- host/discovery.sh@137 -- # get_bdev_list 00:28:15.475 14:32:29 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:15.475 14:32:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.475 14:32:29 -- common/autotest_common.sh@10 -- # set +x 00:28:15.475 14:32:29 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:15.475 14:32:29 -- host/discovery.sh@55 -- # sort 00:28:15.475 14:32:29 -- host/discovery.sh@55 -- # xargs 00:28:15.475 14:32:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:15.475 14:32:29 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:28:15.475 14:32:29 -- host/discovery.sh@138 -- # get_notification_count 00:28:15.475 14:32:29 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:28:15.475 14:32:29 -- host/discovery.sh@74 -- # jq '. | length' 00:28:15.475 14:32:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.475 14:32:29 -- common/autotest_common.sh@10 -- # set +x 00:28:15.475 14:32:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:15.475 14:32:29 -- host/discovery.sh@74 -- # notification_count=2 00:28:15.475 14:32:29 -- host/discovery.sh@75 -- # notify_id=4 00:28:15.475 14:32:29 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:28:15.475 14:32:29 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:15.475 14:32:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:15.475 14:32:29 -- common/autotest_common.sh@10 -- # set +x 00:28:16.842 [2024-12-16 14:32:30.992866] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:16.842 [2024-12-16 14:32:30.992888] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:16.842 [2024-12-16 14:32:30.992900] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:16.842 [2024-12-16 14:32:31.079146] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:28:16.842 [2024-12-16 14:32:31.178637] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:16.842 [2024-12-16 14:32:31.178668] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:28:16.842 14:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:16.842 14:32:31 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:16.842 14:32:31 -- common/autotest_common.sh@650 -- # local es=0 00:28:16.842 14:32:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:16.842 14:32:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:16.842 14:32:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:16.842 14:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:16.842 14:32:31 -- common/autotest_common.sh@10 -- # set +x 00:28:16.842 request: 00:28:16.842 { 00:28:16.842 "name": "nvme", 00:28:16.842 "trtype": "tcp", 00:28:16.842 "traddr": "10.0.0.2", 00:28:16.842 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:16.842 "adrfam": "ipv4", 00:28:16.842 "trsvcid": "8009", 00:28:16.842 "wait_for_attach": true, 00:28:16.842 "method": "bdev_nvme_start_discovery", 00:28:16.842 "req_id": 1 00:28:16.842 } 00:28:16.842 Got JSON-RPC error response 00:28:16.842 response: 00:28:16.842 { 00:28:16.842 "code": -17, 00:28:16.842 "message": "File exists" 00:28:16.842 } 00:28:16.842 14:32:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:16.842 14:32:31 -- common/autotest_common.sh@653 -- # es=1 00:28:16.842 14:32:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:16.842 14:32:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:16.842 14:32:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:16.842 14:32:31 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:28:16.842 14:32:31 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:16.842 14:32:31 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:16.842 14:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:16.842 14:32:31 -- host/discovery.sh@67 -- # sort 00:28:16.842 14:32:31 -- common/autotest_common.sh@10 -- # set +x 00:28:16.842 14:32:31 -- host/discovery.sh@67 -- # xargs 00:28:16.842 14:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:16.842 14:32:31 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:28:16.842 14:32:31 -- host/discovery.sh@147 -- # get_bdev_list 00:28:16.842 14:32:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:16.842 14:32:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:16.842 14:32:31 -- host/discovery.sh@55 -- # xargs 00:28:16.842 14:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:16.842 14:32:31 -- host/discovery.sh@55 -- # sort 00:28:16.842 14:32:31 -- common/autotest_common.sh@10 -- # set +x 00:28:16.842 14:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:16.842 14:32:31 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:16.842 14:32:31 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:16.842 14:32:31 -- common/autotest_common.sh@650 -- # local es=0 00:28:16.842 14:32:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:16.842 14:32:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:16.842 14:32:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:28:16.842 14:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:16.842 14:32:31 -- common/autotest_common.sh@10 -- # set +x 00:28:16.842 request: 00:28:16.842 { 00:28:16.842 "name": "nvme_second", 00:28:16.842 "trtype": "tcp", 00:28:16.842 "traddr": "10.0.0.2", 00:28:16.842 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:16.842 "adrfam": "ipv4", 00:28:16.842 "trsvcid": "8009", 00:28:16.842 "wait_for_attach": true, 00:28:16.842 "method": "bdev_nvme_start_discovery", 00:28:16.842 "req_id": 1 00:28:16.842 } 00:28:16.842 Got JSON-RPC error response 00:28:16.842 response: 00:28:16.842 { 00:28:16.842 "code": -17, 00:28:16.842 "message": "File exists" 00:28:16.842 } 00:28:16.842 14:32:31 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:16.842 14:32:31 -- common/autotest_common.sh@653 -- # es=1 00:28:16.842 14:32:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:16.842 14:32:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:16.842 14:32:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:16.842 14:32:31 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:28:16.842 14:32:31 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:16.842 14:32:31 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:16.842 14:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:16.842 14:32:31 -- host/discovery.sh@67 -- # sort 00:28:16.842 14:32:31 -- common/autotest_common.sh@10 -- # set +x 00:28:16.842 14:32:31 -- host/discovery.sh@67 -- # xargs 00:28:16.842 14:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:16.842 14:32:31 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:28:16.842 14:32:31 -- host/discovery.sh@153 -- # get_bdev_list 00:28:16.842 14:32:31 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:16.842 14:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:16.842 14:32:31 -- common/autotest_common.sh@10 -- # set +x 00:28:16.842 14:32:31 -- host/discovery.sh@55 -- # xargs 00:28:16.842 14:32:31 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:16.842 14:32:31 -- host/discovery.sh@55 -- # sort 00:28:16.842 14:32:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:16.842 14:32:31 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:16.842 14:32:31 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:16.842 14:32:31 -- common/autotest_common.sh@650 -- # local es=0 00:28:16.842 14:32:31 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:16.842 14:32:31 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:28:16.842 14:32:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:28:16.842 14:32:31 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:28:16.842 14:32:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:16.842 14:32:31 -- common/autotest_common.sh@10 -- # set +x 00:28:18.212 [2024-12-16 14:32:32.395798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:18.212 [2024-12-16 14:32:32.396000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:18.212 [2024-12-16 14:32:32.396012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbcbf0 with addr=10.0.0.2, port=8010 00:28:18.213 [2024-12-16 14:32:32.396027] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:18.213 [2024-12-16 14:32:32.396033] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:18.213 [2024-12-16 14:32:32.396040] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:19.145 [2024-12-16 14:32:33.398258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:19.145 [2024-12-16 14:32:33.398513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:28:19.145 [2024-12-16 14:32:33.398524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1cbcbf0 with addr=10.0.0.2, port=8010 00:28:19.145 [2024-12-16 14:32:33.398535] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:28:19.145 [2024-12-16 14:32:33.398541] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:28:19.145 [2024-12-16 14:32:33.398547] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:28:20.078 [2024-12-16 14:32:34.400405] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:28:20.078 request: 00:28:20.078 { 00:28:20.078 "name": "nvme_second", 00:28:20.078 "trtype": "tcp", 00:28:20.078 "traddr": "10.0.0.2", 00:28:20.078 "hostnqn": "nqn.2021-12.io.spdk:test", 00:28:20.078 "adrfam": "ipv4", 00:28:20.078 "trsvcid": "8010", 00:28:20.078 "attach_timeout_ms": 3000, 00:28:20.078 "method": "bdev_nvme_start_discovery", 00:28:20.078 "req_id": 1 00:28:20.078 } 00:28:20.078 Got JSON-RPC error response 00:28:20.078 response: 00:28:20.078 { 00:28:20.078 "code": -110, 00:28:20.078 "message": "Connection timed out" 00:28:20.078 } 00:28:20.078 14:32:34 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:28:20.078 14:32:34 -- common/autotest_common.sh@653 -- # es=1 00:28:20.079 14:32:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:28:20.079 14:32:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:28:20.079 14:32:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:28:20.079 14:32:34 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:28:20.079 14:32:34 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:28:20.079 14:32:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:20.079 14:32:34 -- common/autotest_common.sh@10 -- # set +x 00:28:20.079 14:32:34 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:28:20.079 14:32:34 -- host/discovery.sh@67 -- # sort 00:28:20.079 14:32:34 -- host/discovery.sh@67 -- # xargs 00:28:20.079 14:32:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:20.079 14:32:34 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:28:20.079 14:32:34 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:28:20.079 14:32:34 -- host/discovery.sh@162 -- # kill 526556 00:28:20.079 14:32:34 -- host/discovery.sh@163 -- # nvmftestfini 00:28:20.079 14:32:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:20.079 14:32:34 -- nvmf/common.sh@116 -- # sync 00:28:20.079 14:32:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:20.079 14:32:34 -- nvmf/common.sh@119 -- # set +e 00:28:20.079 14:32:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:20.079 14:32:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:20.079 rmmod nvme_tcp 00:28:20.079 rmmod nvme_fabrics 00:28:20.079 rmmod nvme_keyring 00:28:20.079 14:32:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:20.079 14:32:34 -- nvmf/common.sh@123 -- # set -e 00:28:20.079 14:32:34 -- nvmf/common.sh@124 -- # return 0 00:28:20.079 14:32:34 -- nvmf/common.sh@477 -- # '[' -n 526312 ']' 00:28:20.079 14:32:34 -- nvmf/common.sh@478 -- # killprocess 526312 00:28:20.079 14:32:34 -- common/autotest_common.sh@936 -- # '[' -z 526312 ']' 00:28:20.079 14:32:34 -- common/autotest_common.sh@940 -- # kill -0 526312 00:28:20.079 14:32:34 -- common/autotest_common.sh@941 -- # uname 00:28:20.079 14:32:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:20.079 14:32:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 526312 00:28:20.079 14:32:34 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:20.079 14:32:34 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:20.079 14:32:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 526312' 00:28:20.079 killing process with pid 526312 00:28:20.079 14:32:34 -- common/autotest_common.sh@955 -- # kill 526312 00:28:20.079 14:32:34 -- common/autotest_common.sh@960 -- # wait 526312 00:28:20.337 14:32:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:20.337 14:32:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:20.338 14:32:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:20.338 14:32:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:20.338 14:32:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:20.338 14:32:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:20.338 14:32:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:20.338 14:32:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:22.869 14:32:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:22.869 00:28:22.869 real 0m20.309s 00:28:22.869 user 0m27.537s 00:28:22.869 sys 0m5.139s 00:28:22.869 14:32:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:22.869 14:32:36 -- common/autotest_common.sh@10 -- # set +x 00:28:22.869 ************************************ 00:28:22.869 END TEST nvmf_discovery 00:28:22.869 ************************************ 00:28:22.869 14:32:36 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:22.869 14:32:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:22.869 14:32:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:22.869 14:32:36 -- common/autotest_common.sh@10 -- # set +x 00:28:22.869 ************************************ 00:28:22.869 START TEST nvmf_discovery_remove_ifc 00:28:22.869 ************************************ 00:28:22.869 14:32:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:28:22.869 * Looking for test storage... 00:28:22.869 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:22.869 14:32:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:22.869 14:32:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:22.869 14:32:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:22.869 14:32:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:22.869 14:32:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:22.869 14:32:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:22.869 14:32:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:22.869 14:32:37 -- scripts/common.sh@335 -- # IFS=.-: 00:28:22.869 14:32:37 -- scripts/common.sh@335 -- # read -ra ver1 00:28:22.869 14:32:37 -- scripts/common.sh@336 -- # IFS=.-: 00:28:22.869 14:32:37 -- scripts/common.sh@336 -- # read -ra ver2 00:28:22.869 14:32:37 -- scripts/common.sh@337 -- # local 'op=<' 00:28:22.869 14:32:37 -- scripts/common.sh@339 -- # ver1_l=2 00:28:22.869 14:32:37 -- scripts/common.sh@340 -- # ver2_l=1 00:28:22.869 14:32:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:22.869 14:32:37 -- scripts/common.sh@343 -- # case "$op" in 00:28:22.869 14:32:37 -- scripts/common.sh@344 -- # : 1 00:28:22.869 14:32:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:22.869 14:32:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:22.869 14:32:37 -- scripts/common.sh@364 -- # decimal 1 00:28:22.869 14:32:37 -- scripts/common.sh@352 -- # local d=1 00:28:22.869 14:32:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:22.869 14:32:37 -- scripts/common.sh@354 -- # echo 1 00:28:22.869 14:32:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:22.869 14:32:37 -- scripts/common.sh@365 -- # decimal 2 00:28:22.869 14:32:37 -- scripts/common.sh@352 -- # local d=2 00:28:22.869 14:32:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:22.869 14:32:37 -- scripts/common.sh@354 -- # echo 2 00:28:22.869 14:32:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:22.869 14:32:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:22.869 14:32:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:22.869 14:32:37 -- scripts/common.sh@367 -- # return 0 00:28:22.869 14:32:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:22.869 14:32:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:22.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:22.869 --rc genhtml_branch_coverage=1 00:28:22.869 --rc genhtml_function_coverage=1 00:28:22.869 --rc genhtml_legend=1 00:28:22.869 --rc geninfo_all_blocks=1 00:28:22.869 --rc geninfo_unexecuted_blocks=1 00:28:22.869 00:28:22.869 ' 00:28:22.869 14:32:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:22.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:22.869 --rc genhtml_branch_coverage=1 00:28:22.869 --rc genhtml_function_coverage=1 00:28:22.869 --rc genhtml_legend=1 00:28:22.869 --rc geninfo_all_blocks=1 00:28:22.869 --rc geninfo_unexecuted_blocks=1 00:28:22.869 00:28:22.869 ' 00:28:22.869 14:32:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:22.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:22.869 --rc genhtml_branch_coverage=1 00:28:22.869 --rc genhtml_function_coverage=1 00:28:22.869 --rc genhtml_legend=1 00:28:22.869 --rc geninfo_all_blocks=1 00:28:22.869 --rc geninfo_unexecuted_blocks=1 00:28:22.869 00:28:22.869 ' 00:28:22.869 14:32:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:22.869 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:22.869 --rc genhtml_branch_coverage=1 00:28:22.869 --rc genhtml_function_coverage=1 00:28:22.869 --rc genhtml_legend=1 00:28:22.869 --rc geninfo_all_blocks=1 00:28:22.869 --rc geninfo_unexecuted_blocks=1 00:28:22.869 00:28:22.869 ' 00:28:22.869 14:32:37 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:22.869 14:32:37 -- nvmf/common.sh@7 -- # uname -s 00:28:22.869 14:32:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:22.869 14:32:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:22.869 14:32:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:22.869 14:32:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:22.870 14:32:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:22.870 14:32:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:22.870 14:32:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:22.870 14:32:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:22.870 14:32:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:22.870 14:32:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:22.870 14:32:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:28:22.870 14:32:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:28:22.870 14:32:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:22.870 14:32:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:22.870 14:32:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:22.870 14:32:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:22.870 14:32:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:22.870 14:32:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:22.870 14:32:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:22.870 14:32:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.870 14:32:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.870 14:32:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.870 14:32:37 -- paths/export.sh@5 -- # export PATH 00:28:22.870 14:32:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:22.870 14:32:37 -- nvmf/common.sh@46 -- # : 0 00:28:22.870 14:32:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:22.870 14:32:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:22.870 14:32:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:22.870 14:32:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:22.870 14:32:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:22.870 14:32:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:22.870 14:32:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:22.870 14:32:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:22.870 14:32:37 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:28:22.870 14:32:37 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:28:22.870 14:32:37 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:28:22.870 14:32:37 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:28:22.870 14:32:37 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:28:22.870 14:32:37 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:28:22.870 14:32:37 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:28:22.870 14:32:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:22.870 14:32:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:22.870 14:32:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:22.870 14:32:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:22.870 14:32:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:22.870 14:32:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:22.870 14:32:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:22.870 14:32:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:22.870 14:32:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:22.870 14:32:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:22.870 14:32:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:22.870 14:32:37 -- common/autotest_common.sh@10 -- # set +x 00:28:28.138 14:32:42 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:28.138 14:32:42 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:28.138 14:32:42 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:28.138 14:32:42 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:28.138 14:32:42 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:28.138 14:32:42 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:28.138 14:32:42 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:28.138 14:32:42 -- nvmf/common.sh@294 -- # net_devs=() 00:28:28.138 14:32:42 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:28.138 14:32:42 -- nvmf/common.sh@295 -- # e810=() 00:28:28.138 14:32:42 -- nvmf/common.sh@295 -- # local -ga e810 00:28:28.138 14:32:42 -- nvmf/common.sh@296 -- # x722=() 00:28:28.138 14:32:42 -- nvmf/common.sh@296 -- # local -ga x722 00:28:28.138 14:32:42 -- nvmf/common.sh@297 -- # mlx=() 00:28:28.138 14:32:42 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:28.138 14:32:42 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:28.138 14:32:42 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:28.138 14:32:42 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:28.138 14:32:42 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:28.138 14:32:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:28.138 14:32:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:28:28.138 Found 0000:af:00.0 (0x8086 - 0x159b) 00:28:28.138 14:32:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:28.138 14:32:42 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:28:28.138 Found 0000:af:00.1 (0x8086 - 0x159b) 00:28:28.138 14:32:42 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:28.138 14:32:42 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:28.138 14:32:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:28.138 14:32:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:28.138 14:32:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:28.138 14:32:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:28:28.138 Found net devices under 0000:af:00.0: cvl_0_0 00:28:28.138 14:32:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:28.138 14:32:42 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:28.138 14:32:42 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:28.138 14:32:42 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:28.138 14:32:42 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:28.138 14:32:42 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:28:28.138 Found net devices under 0000:af:00.1: cvl_0_1 00:28:28.138 14:32:42 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:28.138 14:32:42 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:28.138 14:32:42 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:28.138 14:32:42 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:28.138 14:32:42 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:28.138 14:32:42 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:28.138 14:32:42 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:28.138 14:32:42 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:28.138 14:32:42 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:28.138 14:32:42 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:28.138 14:32:42 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:28.138 14:32:42 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:28.138 14:32:42 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:28.138 14:32:42 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:28.138 14:32:42 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:28.138 14:32:42 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:28.138 14:32:42 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:28.138 14:32:42 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:28.138 14:32:42 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:28.138 14:32:42 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:28.138 14:32:42 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:28.138 14:32:42 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:28.138 14:32:42 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:28.397 14:32:42 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:28.397 14:32:42 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:28.397 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:28.397 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.230 ms 00:28:28.397 00:28:28.397 --- 10.0.0.2 ping statistics --- 00:28:28.397 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:28.397 rtt min/avg/max/mdev = 0.230/0.230/0.230/0.000 ms 00:28:28.397 14:32:42 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:28.397 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:28.397 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.124 ms 00:28:28.397 00:28:28.397 --- 10.0.0.1 ping statistics --- 00:28:28.397 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:28.397 rtt min/avg/max/mdev = 0.124/0.124/0.124/0.000 ms 00:28:28.397 14:32:42 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:28.397 14:32:42 -- nvmf/common.sh@410 -- # return 0 00:28:28.397 14:32:42 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:28.397 14:32:42 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:28.397 14:32:42 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:28.397 14:32:42 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:28.397 14:32:42 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:28.397 14:32:42 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:28.397 14:32:42 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:28.397 14:32:42 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:28:28.397 14:32:42 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:28.397 14:32:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:28.397 14:32:42 -- common/autotest_common.sh@10 -- # set +x 00:28:28.397 14:32:42 -- nvmf/common.sh@469 -- # nvmfpid=532031 00:28:28.397 14:32:42 -- nvmf/common.sh@470 -- # waitforlisten 532031 00:28:28.397 14:32:42 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:28.397 14:32:42 -- common/autotest_common.sh@829 -- # '[' -z 532031 ']' 00:28:28.397 14:32:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:28.397 14:32:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:28.397 14:32:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:28.397 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:28.397 14:32:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:28.397 14:32:42 -- common/autotest_common.sh@10 -- # set +x 00:28:28.397 [2024-12-16 14:32:42.821066] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:28.397 [2024-12-16 14:32:42.821113] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:28.397 EAL: No free 2048 kB hugepages reported on node 1 00:28:28.397 [2024-12-16 14:32:42.880585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:28.397 [2024-12-16 14:32:42.947461] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:28.397 [2024-12-16 14:32:42.947567] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:28.397 [2024-12-16 14:32:42.947574] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:28.397 [2024-12-16 14:32:42.947580] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:28.397 [2024-12-16 14:32:42.947599] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:29.332 14:32:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:29.332 14:32:43 -- common/autotest_common.sh@862 -- # return 0 00:28:29.332 14:32:43 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:29.332 14:32:43 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:29.332 14:32:43 -- common/autotest_common.sh@10 -- # set +x 00:28:29.332 14:32:43 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:29.332 14:32:43 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:28:29.332 14:32:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:29.332 14:32:43 -- common/autotest_common.sh@10 -- # set +x 00:28:29.332 [2024-12-16 14:32:43.685098] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:29.332 [2024-12-16 14:32:43.693283] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:29.332 null0 00:28:29.332 [2024-12-16 14:32:43.725266] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:29.332 14:32:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:29.332 14:32:43 -- host/discovery_remove_ifc.sh@59 -- # hostpid=532212 00:28:29.332 14:32:43 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:28:29.332 14:32:43 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 532212 /tmp/host.sock 00:28:29.332 14:32:43 -- common/autotest_common.sh@829 -- # '[' -z 532212 ']' 00:28:29.332 14:32:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:29.332 14:32:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:29.332 14:32:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:29.332 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:29.332 14:32:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:29.332 14:32:43 -- common/autotest_common.sh@10 -- # set +x 00:28:29.332 [2024-12-16 14:32:43.789419] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:29.332 [2024-12-16 14:32:43.789461] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid532212 ] 00:28:29.332 EAL: No free 2048 kB hugepages reported on node 1 00:28:29.332 [2024-12-16 14:32:43.843961] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:29.590 [2024-12-16 14:32:43.920279] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:29.590 [2024-12-16 14:32:43.920386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:30.155 14:32:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:30.156 14:32:44 -- common/autotest_common.sh@862 -- # return 0 00:28:30.156 14:32:44 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:30.156 14:32:44 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:28:30.156 14:32:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.156 14:32:44 -- common/autotest_common.sh@10 -- # set +x 00:28:30.156 14:32:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.156 14:32:44 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:28:30.156 14:32:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.156 14:32:44 -- common/autotest_common.sh@10 -- # set +x 00:28:30.156 14:32:44 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:30.156 14:32:44 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:28:30.156 14:32:44 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:30.156 14:32:44 -- common/autotest_common.sh@10 -- # set +x 00:28:31.528 [2024-12-16 14:32:45.744359] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:31.528 [2024-12-16 14:32:45.744381] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:31.528 [2024-12-16 14:32:45.744392] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:31.528 [2024-12-16 14:32:45.870779] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:31.528 [2024-12-16 14:32:45.973486] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:31.528 [2024-12-16 14:32:45.973519] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:31.528 [2024-12-16 14:32:45.973538] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:31.528 [2024-12-16 14:32:45.973549] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:31.528 [2024-12-16 14:32:45.973565] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:31.528 14:32:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:31.528 14:32:45 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:28:31.528 14:32:45 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:31.528 14:32:45 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:31.528 14:32:45 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:31.528 14:32:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:31.528 14:32:45 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:31.528 14:32:45 -- common/autotest_common.sh@10 -- # set +x 00:28:31.528 14:32:45 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:31.528 [2024-12-16 14:32:45.982263] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x8b9590 was disconnected and freed. delete nvme_qpair. 00:28:31.528 14:32:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:31.528 14:32:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:28:31.528 14:32:46 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:28:31.528 14:32:46 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:28:31.786 14:32:46 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:28:31.786 14:32:46 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:31.786 14:32:46 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:31.786 14:32:46 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:31.786 14:32:46 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:31.786 14:32:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:31.786 14:32:46 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:31.786 14:32:46 -- common/autotest_common.sh@10 -- # set +x 00:28:31.786 14:32:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:31.786 14:32:46 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:31.786 14:32:46 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:32.719 14:32:47 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:32.719 14:32:47 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:32.719 14:32:47 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:32.719 14:32:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:32.719 14:32:47 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:32.719 14:32:47 -- common/autotest_common.sh@10 -- # set +x 00:28:32.719 14:32:47 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:32.719 14:32:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:32.719 14:32:47 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:32.719 14:32:47 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:33.650 14:32:48 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:33.650 14:32:48 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:33.650 14:32:48 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:33.650 14:32:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:33.650 14:32:48 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:33.650 14:32:48 -- common/autotest_common.sh@10 -- # set +x 00:28:33.650 14:32:48 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:33.908 14:32:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:33.908 14:32:48 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:33.908 14:32:48 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:34.840 14:32:49 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:34.840 14:32:49 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:34.840 14:32:49 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:34.840 14:32:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:34.840 14:32:49 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:34.840 14:32:49 -- common/autotest_common.sh@10 -- # set +x 00:28:34.840 14:32:49 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:34.840 14:32:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:34.840 14:32:49 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:34.840 14:32:49 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:35.773 14:32:50 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:35.773 14:32:50 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:35.773 14:32:50 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:35.773 14:32:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:35.773 14:32:50 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:35.773 14:32:50 -- common/autotest_common.sh@10 -- # set +x 00:28:35.773 14:32:50 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:35.773 14:32:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.030 14:32:50 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:36.030 14:32:50 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:36.963 14:32:51 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:36.963 14:32:51 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:36.963 14:32:51 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:36.963 14:32:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:36.963 14:32:51 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:36.963 14:32:51 -- common/autotest_common.sh@10 -- # set +x 00:28:36.963 14:32:51 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:36.963 14:32:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:36.964 14:32:51 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:36.964 14:32:51 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:36.964 [2024-12-16 14:32:51.415045] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:28:36.964 [2024-12-16 14:32:51.415083] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.964 [2024-12-16 14:32:51.415093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.964 [2024-12-16 14:32:51.415102] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.964 [2024-12-16 14:32:51.415109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.964 [2024-12-16 14:32:51.415116] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.964 [2024-12-16 14:32:51.415130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.964 [2024-12-16 14:32:51.415137] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.964 [2024-12-16 14:32:51.415144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.964 [2024-12-16 14:32:51.415151] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:36.964 [2024-12-16 14:32:51.415157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:36.964 [2024-12-16 14:32:51.415164] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x880900 is same with the state(5) to be set 00:28:36.964 [2024-12-16 14:32:51.425066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x880900 (9): Bad file descriptor 00:28:36.964 [2024-12-16 14:32:51.435106] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:28:37.897 14:32:52 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:37.897 14:32:52 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:37.897 14:32:52 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:37.897 14:32:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:37.897 14:32:52 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:37.898 14:32:52 -- common/autotest_common.sh@10 -- # set +x 00:28:37.898 14:32:52 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:38.155 [2024-12-16 14:32:52.497910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:28:39.089 [2024-12-16 14:32:53.521880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:28:39.089 [2024-12-16 14:32:53.521938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x880900 with addr=10.0.0.2, port=4420 00:28:39.089 [2024-12-16 14:32:53.521958] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x880900 is same with the state(5) to be set 00:28:39.089 [2024-12-16 14:32:53.521987] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:28:39.089 [2024-12-16 14:32:53.521998] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:28:39.089 [2024-12-16 14:32:53.522009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:28:39.089 [2024-12-16 14:32:53.522019] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:28:39.089 [2024-12-16 14:32:53.522447] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x880900 (9): Bad file descriptor 00:28:39.089 [2024-12-16 14:32:53.522477] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:28:39.089 [2024-12-16 14:32:53.522502] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:28:39.089 [2024-12-16 14:32:53.522530] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:39.089 [2024-12-16 14:32:53.522545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:39.089 [2024-12-16 14:32:53.522558] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:39.089 [2024-12-16 14:32:53.522569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:39.089 [2024-12-16 14:32:53.522581] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:39.089 [2024-12-16 14:32:53.522592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:39.089 [2024-12-16 14:32:53.522608] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:39.089 [2024-12-16 14:32:53.522618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:39.089 [2024-12-16 14:32:53.522630] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:28:39.089 [2024-12-16 14:32:53.522641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:39.089 [2024-12-16 14:32:53.522652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:28:39.089 [2024-12-16 14:32:53.522989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x87fdf0 (9): Bad file descriptor 00:28:39.089 [2024-12-16 14:32:53.524002] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:28:39.089 [2024-12-16 14:32:53.524020] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:28:39.089 14:32:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:39.089 14:32:53 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:28:39.089 14:32:53 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:40.022 14:32:54 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:40.022 14:32:54 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:40.022 14:32:54 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:40.022 14:32:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.022 14:32:54 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:40.022 14:32:54 -- common/autotest_common.sh@10 -- # set +x 00:28:40.022 14:32:54 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:40.022 14:32:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.022 14:32:54 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:28:40.022 14:32:54 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:40.279 14:32:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:40.279 14:32:54 -- common/autotest_common.sh@10 -- # set +x 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:40.279 14:32:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:28:40.279 14:32:54 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:28:41.211 [2024-12-16 14:32:55.580008] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:41.211 [2024-12-16 14:32:55.580024] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:41.211 [2024-12-16 14:32:55.580038] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:41.211 [2024-12-16 14:32:55.666294] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:28:41.211 14:32:55 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:28:41.211 14:32:55 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:41.211 14:32:55 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:28:41.211 14:32:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:41.212 14:32:55 -- host/discovery_remove_ifc.sh@29 -- # sort 00:28:41.212 14:32:55 -- common/autotest_common.sh@10 -- # set +x 00:28:41.212 14:32:55 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:28:41.212 [2024-12-16 14:32:55.728329] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:28:41.212 [2024-12-16 14:32:55.728363] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:28:41.212 [2024-12-16 14:32:55.728382] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:28:41.212 [2024-12-16 14:32:55.728394] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:28:41.212 [2024-12-16 14:32:55.728400] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:41.212 [2024-12-16 14:32:55.737305] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x88eab0 was disconnected and freed. delete nvme_qpair. 00:28:41.212 14:32:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:41.212 14:32:55 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:28:41.212 14:32:55 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:28:41.212 14:32:55 -- host/discovery_remove_ifc.sh@90 -- # killprocess 532212 00:28:41.212 14:32:55 -- common/autotest_common.sh@936 -- # '[' -z 532212 ']' 00:28:41.212 14:32:55 -- common/autotest_common.sh@940 -- # kill -0 532212 00:28:41.212 14:32:55 -- common/autotest_common.sh@941 -- # uname 00:28:41.212 14:32:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:41.212 14:32:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 532212 00:28:41.470 14:32:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:41.470 14:32:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:41.470 14:32:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 532212' 00:28:41.470 killing process with pid 532212 00:28:41.470 14:32:55 -- common/autotest_common.sh@955 -- # kill 532212 00:28:41.470 14:32:55 -- common/autotest_common.sh@960 -- # wait 532212 00:28:41.470 14:32:56 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:28:41.470 14:32:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:41.470 14:32:56 -- nvmf/common.sh@116 -- # sync 00:28:41.470 14:32:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:41.470 14:32:56 -- nvmf/common.sh@119 -- # set +e 00:28:41.470 14:32:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:41.470 14:32:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:41.470 rmmod nvme_tcp 00:28:41.470 rmmod nvme_fabrics 00:28:41.728 rmmod nvme_keyring 00:28:41.728 14:32:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:41.728 14:32:56 -- nvmf/common.sh@123 -- # set -e 00:28:41.728 14:32:56 -- nvmf/common.sh@124 -- # return 0 00:28:41.728 14:32:56 -- nvmf/common.sh@477 -- # '[' -n 532031 ']' 00:28:41.728 14:32:56 -- nvmf/common.sh@478 -- # killprocess 532031 00:28:41.728 14:32:56 -- common/autotest_common.sh@936 -- # '[' -z 532031 ']' 00:28:41.728 14:32:56 -- common/autotest_common.sh@940 -- # kill -0 532031 00:28:41.728 14:32:56 -- common/autotest_common.sh@941 -- # uname 00:28:41.728 14:32:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:41.728 14:32:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 532031 00:28:41.728 14:32:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:41.728 14:32:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:41.728 14:32:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 532031' 00:28:41.728 killing process with pid 532031 00:28:41.728 14:32:56 -- common/autotest_common.sh@955 -- # kill 532031 00:28:41.728 14:32:56 -- common/autotest_common.sh@960 -- # wait 532031 00:28:41.986 14:32:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:41.986 14:32:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:41.986 14:32:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:41.986 14:32:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:41.986 14:32:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:41.986 14:32:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:41.986 14:32:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:41.986 14:32:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:43.890 14:32:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:43.890 00:28:43.890 real 0m21.528s 00:28:43.890 user 0m25.753s 00:28:43.890 sys 0m5.613s 00:28:43.890 14:32:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:43.890 14:32:58 -- common/autotest_common.sh@10 -- # set +x 00:28:43.890 ************************************ 00:28:43.890 END TEST nvmf_discovery_remove_ifc 00:28:43.890 ************************************ 00:28:43.890 14:32:58 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:28:43.890 14:32:58 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:28:43.890 14:32:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:43.890 14:32:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:43.890 14:32:58 -- common/autotest_common.sh@10 -- # set +x 00:28:43.890 ************************************ 00:28:43.890 START TEST nvmf_digest 00:28:43.890 ************************************ 00:28:43.890 14:32:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:28:44.148 * Looking for test storage... 00:28:44.148 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:44.148 14:32:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:44.148 14:32:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:44.148 14:32:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:44.148 14:32:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:44.148 14:32:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:44.148 14:32:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:44.148 14:32:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:44.148 14:32:58 -- scripts/common.sh@335 -- # IFS=.-: 00:28:44.148 14:32:58 -- scripts/common.sh@335 -- # read -ra ver1 00:28:44.148 14:32:58 -- scripts/common.sh@336 -- # IFS=.-: 00:28:44.148 14:32:58 -- scripts/common.sh@336 -- # read -ra ver2 00:28:44.148 14:32:58 -- scripts/common.sh@337 -- # local 'op=<' 00:28:44.148 14:32:58 -- scripts/common.sh@339 -- # ver1_l=2 00:28:44.148 14:32:58 -- scripts/common.sh@340 -- # ver2_l=1 00:28:44.148 14:32:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:44.148 14:32:58 -- scripts/common.sh@343 -- # case "$op" in 00:28:44.148 14:32:58 -- scripts/common.sh@344 -- # : 1 00:28:44.148 14:32:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:44.148 14:32:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:44.148 14:32:58 -- scripts/common.sh@364 -- # decimal 1 00:28:44.148 14:32:58 -- scripts/common.sh@352 -- # local d=1 00:28:44.148 14:32:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:44.148 14:32:58 -- scripts/common.sh@354 -- # echo 1 00:28:44.148 14:32:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:44.148 14:32:58 -- scripts/common.sh@365 -- # decimal 2 00:28:44.148 14:32:58 -- scripts/common.sh@352 -- # local d=2 00:28:44.148 14:32:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:44.148 14:32:58 -- scripts/common.sh@354 -- # echo 2 00:28:44.148 14:32:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:44.148 14:32:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:44.148 14:32:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:44.148 14:32:58 -- scripts/common.sh@367 -- # return 0 00:28:44.148 14:32:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:44.148 14:32:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:44.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:44.148 --rc genhtml_branch_coverage=1 00:28:44.148 --rc genhtml_function_coverage=1 00:28:44.148 --rc genhtml_legend=1 00:28:44.148 --rc geninfo_all_blocks=1 00:28:44.148 --rc geninfo_unexecuted_blocks=1 00:28:44.148 00:28:44.148 ' 00:28:44.148 14:32:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:44.148 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:44.149 --rc genhtml_branch_coverage=1 00:28:44.149 --rc genhtml_function_coverage=1 00:28:44.149 --rc genhtml_legend=1 00:28:44.149 --rc geninfo_all_blocks=1 00:28:44.149 --rc geninfo_unexecuted_blocks=1 00:28:44.149 00:28:44.149 ' 00:28:44.149 14:32:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:44.149 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:44.149 --rc genhtml_branch_coverage=1 00:28:44.149 --rc genhtml_function_coverage=1 00:28:44.149 --rc genhtml_legend=1 00:28:44.149 --rc geninfo_all_blocks=1 00:28:44.149 --rc geninfo_unexecuted_blocks=1 00:28:44.149 00:28:44.149 ' 00:28:44.149 14:32:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:44.149 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:44.149 --rc genhtml_branch_coverage=1 00:28:44.149 --rc genhtml_function_coverage=1 00:28:44.149 --rc genhtml_legend=1 00:28:44.149 --rc geninfo_all_blocks=1 00:28:44.149 --rc geninfo_unexecuted_blocks=1 00:28:44.149 00:28:44.149 ' 00:28:44.149 14:32:58 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:44.149 14:32:58 -- nvmf/common.sh@7 -- # uname -s 00:28:44.149 14:32:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:44.149 14:32:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:44.149 14:32:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:44.149 14:32:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:44.149 14:32:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:44.149 14:32:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:44.149 14:32:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:44.149 14:32:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:44.149 14:32:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:44.149 14:32:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:44.149 14:32:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:28:44.149 14:32:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:28:44.149 14:32:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:44.149 14:32:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:44.149 14:32:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:44.149 14:32:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:44.149 14:32:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:44.149 14:32:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:44.149 14:32:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:44.149 14:32:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:44.149 14:32:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:44.149 14:32:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:44.149 14:32:58 -- paths/export.sh@5 -- # export PATH 00:28:44.149 14:32:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:44.149 14:32:58 -- nvmf/common.sh@46 -- # : 0 00:28:44.149 14:32:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:44.149 14:32:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:44.149 14:32:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:44.149 14:32:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:44.149 14:32:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:44.149 14:32:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:44.149 14:32:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:44.149 14:32:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:44.149 14:32:58 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:28:44.149 14:32:58 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:28:44.149 14:32:58 -- host/digest.sh@16 -- # runtime=2 00:28:44.149 14:32:58 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:28:44.149 14:32:58 -- host/digest.sh@132 -- # nvmftestinit 00:28:44.149 14:32:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:44.149 14:32:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:44.149 14:32:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:44.149 14:32:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:44.149 14:32:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:44.149 14:32:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:44.149 14:32:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:44.149 14:32:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:44.149 14:32:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:44.149 14:32:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:44.149 14:32:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:44.149 14:32:58 -- common/autotest_common.sh@10 -- # set +x 00:28:49.413 14:33:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:49.413 14:33:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:49.413 14:33:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:49.413 14:33:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:49.413 14:33:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:49.413 14:33:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:49.413 14:33:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:49.413 14:33:03 -- nvmf/common.sh@294 -- # net_devs=() 00:28:49.413 14:33:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:49.413 14:33:03 -- nvmf/common.sh@295 -- # e810=() 00:28:49.413 14:33:03 -- nvmf/common.sh@295 -- # local -ga e810 00:28:49.413 14:33:03 -- nvmf/common.sh@296 -- # x722=() 00:28:49.413 14:33:03 -- nvmf/common.sh@296 -- # local -ga x722 00:28:49.413 14:33:03 -- nvmf/common.sh@297 -- # mlx=() 00:28:49.413 14:33:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:49.413 14:33:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:49.413 14:33:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:49.413 14:33:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:49.413 14:33:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:49.413 14:33:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:49.413 14:33:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:28:49.413 Found 0000:af:00.0 (0x8086 - 0x159b) 00:28:49.413 14:33:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:49.413 14:33:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:28:49.413 Found 0000:af:00.1 (0x8086 - 0x159b) 00:28:49.413 14:33:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:49.413 14:33:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:49.413 14:33:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:49.413 14:33:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:49.413 14:33:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:49.413 14:33:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:28:49.413 Found net devices under 0000:af:00.0: cvl_0_0 00:28:49.413 14:33:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:49.413 14:33:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:49.413 14:33:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:49.413 14:33:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:49.413 14:33:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:49.413 14:33:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:28:49.413 Found net devices under 0000:af:00.1: cvl_0_1 00:28:49.413 14:33:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:49.413 14:33:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:49.413 14:33:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:49.413 14:33:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:49.413 14:33:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:49.413 14:33:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:49.413 14:33:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:49.413 14:33:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:49.413 14:33:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:49.413 14:33:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:49.413 14:33:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:49.413 14:33:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:49.413 14:33:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:49.413 14:33:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:49.413 14:33:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:49.413 14:33:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:49.413 14:33:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:49.413 14:33:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:49.413 14:33:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:49.413 14:33:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:49.413 14:33:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:49.413 14:33:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:49.413 14:33:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:49.413 14:33:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:49.413 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:49.413 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.380 ms 00:28:49.413 00:28:49.413 --- 10.0.0.2 ping statistics --- 00:28:49.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:49.413 rtt min/avg/max/mdev = 0.380/0.380/0.380/0.000 ms 00:28:49.413 14:33:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:49.413 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:49.413 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.195 ms 00:28:49.413 00:28:49.413 --- 10.0.0.1 ping statistics --- 00:28:49.413 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:49.413 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:28:49.413 14:33:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:49.413 14:33:03 -- nvmf/common.sh@410 -- # return 0 00:28:49.413 14:33:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:49.413 14:33:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:49.413 14:33:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:49.413 14:33:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:49.413 14:33:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:49.413 14:33:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:49.413 14:33:03 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:28:49.413 14:33:03 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:28:49.413 14:33:03 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:28:49.413 14:33:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:49.413 14:33:03 -- common/autotest_common.sh@10 -- # set +x 00:28:49.413 ************************************ 00:28:49.413 START TEST nvmf_digest_clean 00:28:49.413 ************************************ 00:28:49.413 14:33:03 -- common/autotest_common.sh@1114 -- # run_digest 00:28:49.413 14:33:03 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:28:49.413 14:33:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:49.413 14:33:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:49.413 14:33:03 -- common/autotest_common.sh@10 -- # set +x 00:28:49.413 14:33:03 -- nvmf/common.sh@469 -- # nvmfpid=537776 00:28:49.413 14:33:03 -- nvmf/common.sh@470 -- # waitforlisten 537776 00:28:49.413 14:33:03 -- common/autotest_common.sh@829 -- # '[' -z 537776 ']' 00:28:49.413 14:33:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:49.413 14:33:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:49.413 14:33:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:49.414 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:49.414 14:33:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:49.414 14:33:03 -- common/autotest_common.sh@10 -- # set +x 00:28:49.414 14:33:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:28:49.414 [2024-12-16 14:33:03.790075] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:49.414 [2024-12-16 14:33:03.790118] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:49.414 EAL: No free 2048 kB hugepages reported on node 1 00:28:49.414 [2024-12-16 14:33:03.848058] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:49.414 [2024-12-16 14:33:03.923003] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:49.414 [2024-12-16 14:33:03.923107] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:49.414 [2024-12-16 14:33:03.923115] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:49.414 [2024-12-16 14:33:03.923121] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:49.414 [2024-12-16 14:33:03.923137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:50.348 14:33:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:50.348 14:33:04 -- common/autotest_common.sh@862 -- # return 0 00:28:50.348 14:33:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:50.348 14:33:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:50.348 14:33:04 -- common/autotest_common.sh@10 -- # set +x 00:28:50.348 14:33:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:50.348 14:33:04 -- host/digest.sh@120 -- # common_target_config 00:28:50.348 14:33:04 -- host/digest.sh@43 -- # rpc_cmd 00:28:50.348 14:33:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:50.348 14:33:04 -- common/autotest_common.sh@10 -- # set +x 00:28:50.348 null0 00:28:50.348 [2024-12-16 14:33:04.706200] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:50.348 [2024-12-16 14:33:04.730395] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:50.348 14:33:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:50.348 14:33:04 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:28:50.348 14:33:04 -- host/digest.sh@77 -- # local rw bs qd 00:28:50.348 14:33:04 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:28:50.348 14:33:04 -- host/digest.sh@80 -- # rw=randread 00:28:50.348 14:33:04 -- host/digest.sh@80 -- # bs=4096 00:28:50.348 14:33:04 -- host/digest.sh@80 -- # qd=128 00:28:50.348 14:33:04 -- host/digest.sh@82 -- # bperfpid=537950 00:28:50.348 14:33:04 -- host/digest.sh@83 -- # waitforlisten 537950 /var/tmp/bperf.sock 00:28:50.348 14:33:04 -- common/autotest_common.sh@829 -- # '[' -z 537950 ']' 00:28:50.348 14:33:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:50.348 14:33:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:50.348 14:33:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:50.348 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:50.348 14:33:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:50.348 14:33:04 -- common/autotest_common.sh@10 -- # set +x 00:28:50.348 14:33:04 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:28:50.348 [2024-12-16 14:33:04.777088] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:50.348 [2024-12-16 14:33:04.777130] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid537950 ] 00:28:50.348 EAL: No free 2048 kB hugepages reported on node 1 00:28:50.348 [2024-12-16 14:33:04.831652] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:50.348 [2024-12-16 14:33:04.903423] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:51.280 14:33:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:51.280 14:33:05 -- common/autotest_common.sh@862 -- # return 0 00:28:51.280 14:33:05 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:28:51.280 14:33:05 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:28:51.280 14:33:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:28:51.280 14:33:05 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:51.280 14:33:05 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:51.538 nvme0n1 00:28:51.538 14:33:06 -- host/digest.sh@91 -- # bperf_py perform_tests 00:28:51.538 14:33:06 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:51.795 Running I/O for 2 seconds... 00:28:53.693 00:28:53.693 Latency(us) 00:28:53.693 [2024-12-16T13:33:08.267Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:53.693 [2024-12-16T13:33:08.267Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:28:53.693 nvme0n1 : 2.01 21450.87 83.79 0.00 0.00 5963.13 1903.66 12795.12 00:28:53.693 [2024-12-16T13:33:08.267Z] =================================================================================================================== 00:28:53.693 [2024-12-16T13:33:08.267Z] Total : 21450.87 83.79 0.00 0.00 5963.13 1903.66 12795.12 00:28:53.693 0 00:28:53.693 14:33:08 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:28:53.693 14:33:08 -- host/digest.sh@92 -- # get_accel_stats 00:28:53.693 14:33:08 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:28:53.693 14:33:08 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:28:53.693 | select(.opcode=="crc32c") 00:28:53.693 | "\(.module_name) \(.executed)"' 00:28:53.693 14:33:08 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:28:53.951 14:33:08 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:28:53.951 14:33:08 -- host/digest.sh@93 -- # exp_module=software 00:28:53.951 14:33:08 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:28:53.951 14:33:08 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:28:53.951 14:33:08 -- host/digest.sh@97 -- # killprocess 537950 00:28:53.951 14:33:08 -- common/autotest_common.sh@936 -- # '[' -z 537950 ']' 00:28:53.951 14:33:08 -- common/autotest_common.sh@940 -- # kill -0 537950 00:28:53.951 14:33:08 -- common/autotest_common.sh@941 -- # uname 00:28:53.951 14:33:08 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:53.951 14:33:08 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 537950 00:28:53.951 14:33:08 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:53.951 14:33:08 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:53.951 14:33:08 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 537950' 00:28:53.951 killing process with pid 537950 00:28:53.951 14:33:08 -- common/autotest_common.sh@955 -- # kill 537950 00:28:53.951 Received shutdown signal, test time was about 2.000000 seconds 00:28:53.951 00:28:53.951 Latency(us) 00:28:53.951 [2024-12-16T13:33:08.525Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:53.951 [2024-12-16T13:33:08.525Z] =================================================================================================================== 00:28:53.951 [2024-12-16T13:33:08.525Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:53.951 14:33:08 -- common/autotest_common.sh@960 -- # wait 537950 00:28:54.209 14:33:08 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:28:54.209 14:33:08 -- host/digest.sh@77 -- # local rw bs qd 00:28:54.209 14:33:08 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:28:54.209 14:33:08 -- host/digest.sh@80 -- # rw=randread 00:28:54.209 14:33:08 -- host/digest.sh@80 -- # bs=131072 00:28:54.209 14:33:08 -- host/digest.sh@80 -- # qd=16 00:28:54.209 14:33:08 -- host/digest.sh@82 -- # bperfpid=538890 00:28:54.209 14:33:08 -- host/digest.sh@83 -- # waitforlisten 538890 /var/tmp/bperf.sock 00:28:54.209 14:33:08 -- common/autotest_common.sh@829 -- # '[' -z 538890 ']' 00:28:54.209 14:33:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:54.209 14:33:08 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:28:54.209 14:33:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:54.210 14:33:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:54.210 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:54.210 14:33:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:54.210 14:33:08 -- common/autotest_common.sh@10 -- # set +x 00:28:54.210 [2024-12-16 14:33:08.644474] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:54.210 [2024-12-16 14:33:08.644523] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid538890 ] 00:28:54.210 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:54.210 Zero copy mechanism will not be used. 00:28:54.210 EAL: No free 2048 kB hugepages reported on node 1 00:28:54.210 [2024-12-16 14:33:08.699213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:54.210 [2024-12-16 14:33:08.773344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:55.143 14:33:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:55.143 14:33:09 -- common/autotest_common.sh@862 -- # return 0 00:28:55.143 14:33:09 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:28:55.143 14:33:09 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:28:55.143 14:33:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:28:55.143 14:33:09 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:55.143 14:33:09 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:55.708 nvme0n1 00:28:55.708 14:33:10 -- host/digest.sh@91 -- # bperf_py perform_tests 00:28:55.708 14:33:10 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:55.708 I/O size of 131072 is greater than zero copy threshold (65536). 00:28:55.708 Zero copy mechanism will not be used. 00:28:55.708 Running I/O for 2 seconds... 00:28:57.605 00:28:57.605 Latency(us) 00:28:57.605 [2024-12-16T13:33:12.179Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:57.605 [2024-12-16T13:33:12.179Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:28:57.605 nvme0n1 : 2.00 5772.75 721.59 0.00 0.00 2769.14 550.03 11858.90 00:28:57.605 [2024-12-16T13:33:12.179Z] =================================================================================================================== 00:28:57.605 [2024-12-16T13:33:12.179Z] Total : 5772.75 721.59 0.00 0.00 2769.14 550.03 11858.90 00:28:57.863 0 00:28:57.863 14:33:12 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:28:57.863 14:33:12 -- host/digest.sh@92 -- # get_accel_stats 00:28:57.863 14:33:12 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:28:57.863 14:33:12 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:28:57.863 | select(.opcode=="crc32c") 00:28:57.863 | "\(.module_name) \(.executed)"' 00:28:57.863 14:33:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:28:57.863 14:33:12 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:28:57.863 14:33:12 -- host/digest.sh@93 -- # exp_module=software 00:28:57.863 14:33:12 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:28:57.863 14:33:12 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:28:57.863 14:33:12 -- host/digest.sh@97 -- # killprocess 538890 00:28:57.863 14:33:12 -- common/autotest_common.sh@936 -- # '[' -z 538890 ']' 00:28:57.863 14:33:12 -- common/autotest_common.sh@940 -- # kill -0 538890 00:28:57.863 14:33:12 -- common/autotest_common.sh@941 -- # uname 00:28:57.863 14:33:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:57.863 14:33:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 538890 00:28:57.863 14:33:12 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:57.863 14:33:12 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:57.863 14:33:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 538890' 00:28:57.863 killing process with pid 538890 00:28:57.863 14:33:12 -- common/autotest_common.sh@955 -- # kill 538890 00:28:57.863 Received shutdown signal, test time was about 2.000000 seconds 00:28:57.863 00:28:57.863 Latency(us) 00:28:57.863 [2024-12-16T13:33:12.437Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:57.863 [2024-12-16T13:33:12.437Z] =================================================================================================================== 00:28:57.863 [2024-12-16T13:33:12.437Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:57.863 14:33:12 -- common/autotest_common.sh@960 -- # wait 538890 00:28:58.121 14:33:12 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:28:58.121 14:33:12 -- host/digest.sh@77 -- # local rw bs qd 00:28:58.121 14:33:12 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:28:58.121 14:33:12 -- host/digest.sh@80 -- # rw=randwrite 00:28:58.121 14:33:12 -- host/digest.sh@80 -- # bs=4096 00:28:58.121 14:33:12 -- host/digest.sh@80 -- # qd=128 00:28:58.121 14:33:12 -- host/digest.sh@82 -- # bperfpid=539580 00:28:58.121 14:33:12 -- host/digest.sh@83 -- # waitforlisten 539580 /var/tmp/bperf.sock 00:28:58.121 14:33:12 -- common/autotest_common.sh@829 -- # '[' -z 539580 ']' 00:28:58.121 14:33:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:28:58.121 14:33:12 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:28:58.121 14:33:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:58.121 14:33:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:28:58.121 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:28:58.121 14:33:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:58.121 14:33:12 -- common/autotest_common.sh@10 -- # set +x 00:28:58.121 [2024-12-16 14:33:12.650779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:58.121 [2024-12-16 14:33:12.650825] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid539580 ] 00:28:58.121 EAL: No free 2048 kB hugepages reported on node 1 00:28:58.379 [2024-12-16 14:33:12.704434] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:58.379 [2024-12-16 14:33:12.776678] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:58.379 14:33:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:58.379 14:33:12 -- common/autotest_common.sh@862 -- # return 0 00:28:58.379 14:33:12 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:28:58.379 14:33:12 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:28:58.379 14:33:12 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:28:58.636 14:33:13 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:58.636 14:33:13 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:28:59.202 nvme0n1 00:28:59.202 14:33:13 -- host/digest.sh@91 -- # bperf_py perform_tests 00:28:59.202 14:33:13 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:28:59.202 Running I/O for 2 seconds... 00:29:01.099 00:29:01.099 Latency(us) 00:29:01.099 [2024-12-16T13:33:15.673Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:01.099 [2024-12-16T13:33:15.673Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:01.099 nvme0n1 : 2.00 28769.72 112.38 0.00 0.00 4441.97 3479.65 7864.32 00:29:01.099 [2024-12-16T13:33:15.673Z] =================================================================================================================== 00:29:01.099 [2024-12-16T13:33:15.673Z] Total : 28769.72 112.38 0.00 0.00 4441.97 3479.65 7864.32 00:29:01.099 0 00:29:01.099 14:33:15 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:01.099 14:33:15 -- host/digest.sh@92 -- # get_accel_stats 00:29:01.099 14:33:15 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:01.099 14:33:15 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:01.099 | select(.opcode=="crc32c") 00:29:01.099 | "\(.module_name) \(.executed)"' 00:29:01.099 14:33:15 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:01.357 14:33:15 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:01.357 14:33:15 -- host/digest.sh@93 -- # exp_module=software 00:29:01.357 14:33:15 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:01.357 14:33:15 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:01.357 14:33:15 -- host/digest.sh@97 -- # killprocess 539580 00:29:01.357 14:33:15 -- common/autotest_common.sh@936 -- # '[' -z 539580 ']' 00:29:01.357 14:33:15 -- common/autotest_common.sh@940 -- # kill -0 539580 00:29:01.357 14:33:15 -- common/autotest_common.sh@941 -- # uname 00:29:01.357 14:33:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:01.357 14:33:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 539580 00:29:01.357 14:33:15 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:01.357 14:33:15 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:01.357 14:33:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 539580' 00:29:01.357 killing process with pid 539580 00:29:01.357 14:33:15 -- common/autotest_common.sh@955 -- # kill 539580 00:29:01.357 Received shutdown signal, test time was about 2.000000 seconds 00:29:01.357 00:29:01.357 Latency(us) 00:29:01.357 [2024-12-16T13:33:15.931Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:01.357 [2024-12-16T13:33:15.931Z] =================================================================================================================== 00:29:01.357 [2024-12-16T13:33:15.931Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:01.357 14:33:15 -- common/autotest_common.sh@960 -- # wait 539580 00:29:01.614 14:33:16 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:01.615 14:33:16 -- host/digest.sh@77 -- # local rw bs qd 00:29:01.615 14:33:16 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:01.615 14:33:16 -- host/digest.sh@80 -- # rw=randwrite 00:29:01.615 14:33:16 -- host/digest.sh@80 -- # bs=131072 00:29:01.615 14:33:16 -- host/digest.sh@80 -- # qd=16 00:29:01.615 14:33:16 -- host/digest.sh@82 -- # bperfpid=540187 00:29:01.615 14:33:16 -- host/digest.sh@83 -- # waitforlisten 540187 /var/tmp/bperf.sock 00:29:01.615 14:33:16 -- common/autotest_common.sh@829 -- # '[' -z 540187 ']' 00:29:01.615 14:33:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:01.615 14:33:16 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:01.615 14:33:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:01.615 14:33:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:01.615 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:01.615 14:33:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:01.615 14:33:16 -- common/autotest_common.sh@10 -- # set +x 00:29:01.615 [2024-12-16 14:33:16.046137] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:01.615 [2024-12-16 14:33:16.046184] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid540187 ] 00:29:01.615 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:01.615 Zero copy mechanism will not be used. 00:29:01.615 EAL: No free 2048 kB hugepages reported on node 1 00:29:01.615 [2024-12-16 14:33:16.099798] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:01.615 [2024-12-16 14:33:16.171636] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:01.873 14:33:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:01.873 14:33:16 -- common/autotest_common.sh@862 -- # return 0 00:29:01.873 14:33:16 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:01.873 14:33:16 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:01.873 14:33:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:01.873 14:33:16 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:01.873 14:33:16 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:02.438 nvme0n1 00:29:02.438 14:33:16 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:02.438 14:33:16 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:02.438 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:02.438 Zero copy mechanism will not be used. 00:29:02.438 Running I/O for 2 seconds... 00:29:04.967 00:29:04.967 Latency(us) 00:29:04.967 [2024-12-16T13:33:19.541Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:04.967 [2024-12-16T13:33:19.541Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:04.967 nvme0n1 : 2.00 7050.07 881.26 0.00 0.00 2265.90 1669.61 11609.23 00:29:04.967 [2024-12-16T13:33:19.541Z] =================================================================================================================== 00:29:04.967 [2024-12-16T13:33:19.541Z] Total : 7050.07 881.26 0.00 0.00 2265.90 1669.61 11609.23 00:29:04.967 0 00:29:04.967 14:33:18 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:04.967 14:33:18 -- host/digest.sh@92 -- # get_accel_stats 00:29:04.967 14:33:18 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:04.967 14:33:18 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:04.967 | select(.opcode=="crc32c") 00:29:04.967 | "\(.module_name) \(.executed)"' 00:29:04.967 14:33:18 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:04.967 14:33:19 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:04.967 14:33:19 -- host/digest.sh@93 -- # exp_module=software 00:29:04.967 14:33:19 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:04.967 14:33:19 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:04.967 14:33:19 -- host/digest.sh@97 -- # killprocess 540187 00:29:04.967 14:33:19 -- common/autotest_common.sh@936 -- # '[' -z 540187 ']' 00:29:04.968 14:33:19 -- common/autotest_common.sh@940 -- # kill -0 540187 00:29:04.968 14:33:19 -- common/autotest_common.sh@941 -- # uname 00:29:04.968 14:33:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:04.968 14:33:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 540187 00:29:04.968 14:33:19 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:04.968 14:33:19 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:04.968 14:33:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 540187' 00:29:04.968 killing process with pid 540187 00:29:04.968 14:33:19 -- common/autotest_common.sh@955 -- # kill 540187 00:29:04.968 Received shutdown signal, test time was about 2.000000 seconds 00:29:04.968 00:29:04.968 Latency(us) 00:29:04.968 [2024-12-16T13:33:19.542Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:04.968 [2024-12-16T13:33:19.542Z] =================================================================================================================== 00:29:04.968 [2024-12-16T13:33:19.542Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:04.968 14:33:19 -- common/autotest_common.sh@960 -- # wait 540187 00:29:04.968 14:33:19 -- host/digest.sh@126 -- # killprocess 537776 00:29:04.968 14:33:19 -- common/autotest_common.sh@936 -- # '[' -z 537776 ']' 00:29:04.968 14:33:19 -- common/autotest_common.sh@940 -- # kill -0 537776 00:29:04.968 14:33:19 -- common/autotest_common.sh@941 -- # uname 00:29:04.968 14:33:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:04.968 14:33:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 537776 00:29:04.968 14:33:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:04.968 14:33:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:04.968 14:33:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 537776' 00:29:04.968 killing process with pid 537776 00:29:04.968 14:33:19 -- common/autotest_common.sh@955 -- # kill 537776 00:29:04.968 14:33:19 -- common/autotest_common.sh@960 -- # wait 537776 00:29:05.232 00:29:05.232 real 0m15.875s 00:29:05.232 user 0m29.641s 00:29:05.232 sys 0m4.837s 00:29:05.232 14:33:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:05.232 14:33:19 -- common/autotest_common.sh@10 -- # set +x 00:29:05.232 ************************************ 00:29:05.232 END TEST nvmf_digest_clean 00:29:05.232 ************************************ 00:29:05.232 14:33:19 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:05.232 14:33:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:05.232 14:33:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:05.232 14:33:19 -- common/autotest_common.sh@10 -- # set +x 00:29:05.232 ************************************ 00:29:05.232 START TEST nvmf_digest_error 00:29:05.232 ************************************ 00:29:05.232 14:33:19 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:05.232 14:33:19 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:05.232 14:33:19 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:05.232 14:33:19 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:05.232 14:33:19 -- common/autotest_common.sh@10 -- # set +x 00:29:05.232 14:33:19 -- nvmf/common.sh@469 -- # nvmfpid=540760 00:29:05.232 14:33:19 -- nvmf/common.sh@470 -- # waitforlisten 540760 00:29:05.232 14:33:19 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:05.232 14:33:19 -- common/autotest_common.sh@829 -- # '[' -z 540760 ']' 00:29:05.232 14:33:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:05.232 14:33:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:05.232 14:33:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:05.232 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:05.232 14:33:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:05.232 14:33:19 -- common/autotest_common.sh@10 -- # set +x 00:29:05.232 [2024-12-16 14:33:19.701391] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:05.232 [2024-12-16 14:33:19.701442] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:05.232 EAL: No free 2048 kB hugepages reported on node 1 00:29:05.232 [2024-12-16 14:33:19.756389] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:05.551 [2024-12-16 14:33:19.826757] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:05.551 [2024-12-16 14:33:19.826862] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:05.551 [2024-12-16 14:33:19.826869] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:05.551 [2024-12-16 14:33:19.826875] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:05.551 [2024-12-16 14:33:19.826894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:06.138 14:33:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:06.138 14:33:20 -- common/autotest_common.sh@862 -- # return 0 00:29:06.138 14:33:20 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:06.138 14:33:20 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:06.138 14:33:20 -- common/autotest_common.sh@10 -- # set +x 00:29:06.138 14:33:20 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:06.138 14:33:20 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:06.138 14:33:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.138 14:33:20 -- common/autotest_common.sh@10 -- # set +x 00:29:06.138 [2024-12-16 14:33:20.556985] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:06.138 14:33:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.138 14:33:20 -- host/digest.sh@104 -- # common_target_config 00:29:06.138 14:33:20 -- host/digest.sh@43 -- # rpc_cmd 00:29:06.138 14:33:20 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:06.138 14:33:20 -- common/autotest_common.sh@10 -- # set +x 00:29:06.138 null0 00:29:06.138 [2024-12-16 14:33:20.644851] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:06.138 [2024-12-16 14:33:20.669051] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:06.138 14:33:20 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:06.138 14:33:20 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:06.138 14:33:20 -- host/digest.sh@54 -- # local rw bs qd 00:29:06.138 14:33:20 -- host/digest.sh@56 -- # rw=randread 00:29:06.138 14:33:20 -- host/digest.sh@56 -- # bs=4096 00:29:06.138 14:33:20 -- host/digest.sh@56 -- # qd=128 00:29:06.138 14:33:20 -- host/digest.sh@58 -- # bperfpid=541007 00:29:06.138 14:33:20 -- host/digest.sh@60 -- # waitforlisten 541007 /var/tmp/bperf.sock 00:29:06.138 14:33:20 -- common/autotest_common.sh@829 -- # '[' -z 541007 ']' 00:29:06.138 14:33:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:06.138 14:33:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:06.138 14:33:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:06.138 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:06.138 14:33:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:06.138 14:33:20 -- common/autotest_common.sh@10 -- # set +x 00:29:06.138 14:33:20 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:06.396 [2024-12-16 14:33:20.715607] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:06.396 [2024-12-16 14:33:20.715650] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid541007 ] 00:29:06.396 EAL: No free 2048 kB hugepages reported on node 1 00:29:06.396 [2024-12-16 14:33:20.769610] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:06.396 [2024-12-16 14:33:20.842010] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:06.961 14:33:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:06.961 14:33:21 -- common/autotest_common.sh@862 -- # return 0 00:29:06.961 14:33:21 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:06.961 14:33:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:07.218 14:33:21 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:07.218 14:33:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.218 14:33:21 -- common/autotest_common.sh@10 -- # set +x 00:29:07.218 14:33:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.219 14:33:21 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:07.219 14:33:21 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:07.476 nvme0n1 00:29:07.476 14:33:22 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:07.476 14:33:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.476 14:33:22 -- common/autotest_common.sh@10 -- # set +x 00:29:07.476 14:33:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.476 14:33:22 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:07.476 14:33:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:07.734 Running I/O for 2 seconds... 00:29:07.734 [2024-12-16 14:33:22.156527] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.734 [2024-12-16 14:33:22.156558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:1800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.734 [2024-12-16 14:33:22.156568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.734 [2024-12-16 14:33:22.168745] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.734 [2024-12-16 14:33:22.168768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17693 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.734 [2024-12-16 14:33:22.168777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.734 [2024-12-16 14:33:22.180904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.734 [2024-12-16 14:33:22.180925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:23330 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.734 [2024-12-16 14:33:22.180934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.734 [2024-12-16 14:33:22.192803] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.734 [2024-12-16 14:33:22.192824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16212 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.734 [2024-12-16 14:33:22.192832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.734 [2024-12-16 14:33:22.204887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.734 [2024-12-16 14:33:22.204909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5822 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.734 [2024-12-16 14:33:22.204917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.734 [2024-12-16 14:33:22.216931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.734 [2024-12-16 14:33:22.216952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:13679 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.734 [2024-12-16 14:33:22.216960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.735 [2024-12-16 14:33:22.229000] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.735 [2024-12-16 14:33:22.229021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:8825 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.735 [2024-12-16 14:33:22.229034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.735 [2024-12-16 14:33:22.240840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.735 [2024-12-16 14:33:22.240865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:12413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.735 [2024-12-16 14:33:22.240873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.735 [2024-12-16 14:33:22.253066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.735 [2024-12-16 14:33:22.253087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:25279 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.735 [2024-12-16 14:33:22.253095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.735 [2024-12-16 14:33:22.265103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.735 [2024-12-16 14:33:22.265124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:5523 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.735 [2024-12-16 14:33:22.265132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:48 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.735 [2024-12-16 14:33:22.277042] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.735 [2024-12-16 14:33:22.277063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:24572 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.735 [2024-12-16 14:33:22.277071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:50 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.735 [2024-12-16 14:33:22.289240] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.735 [2024-12-16 14:33:22.289261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:1915 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.735 [2024-12-16 14:33:22.289269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.735 [2024-12-16 14:33:22.301320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.735 [2024-12-16 14:33:22.301339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:12744 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.735 [2024-12-16 14:33:22.301347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.313545] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.313566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:20332 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.313574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:44 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.325299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.325320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:24860 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.325328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.337460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.337485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:10413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.337493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.349476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.349497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:4479 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.349505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.361584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.361605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:23376 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.361613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.373785] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.373805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:18746 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.373813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.385881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.385902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:15838 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.385910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.398059] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.398078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:6272 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.398086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.410183] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.410203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:22021 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.410211] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.422631] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.422651] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:25512 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.422659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.434905] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.434925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:10317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.434934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.446947] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.446968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:12372 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.446976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.459165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.459185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:9922 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.459194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.471294] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.471314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:15784 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.471322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.483407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.483428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:21159 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.483436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.993 [2024-12-16 14:33:22.495546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.993 [2024-12-16 14:33:22.495566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22388 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.993 [2024-12-16 14:33:22.495574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.994 [2024-12-16 14:33:22.507716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.994 [2024-12-16 14:33:22.507736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1322 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.994 [2024-12-16 14:33:22.507744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.994 [2024-12-16 14:33:22.519831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.994 [2024-12-16 14:33:22.519852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:14441 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.994 [2024-12-16 14:33:22.519871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.994 [2024-12-16 14:33:22.531937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.994 [2024-12-16 14:33:22.531957] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2827 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.994 [2024-12-16 14:33:22.531965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.994 [2024-12-16 14:33:22.544101] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.994 [2024-12-16 14:33:22.544121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10057 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.994 [2024-12-16 14:33:22.544132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:07.994 [2024-12-16 14:33:22.556246] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:07.994 [2024-12-16 14:33:22.556267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:17236 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:07.994 [2024-12-16 14:33:22.556275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.568466] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.568487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:6928 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.568496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.580687] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.580707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8452 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.580714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.592708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.592731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.592739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.604832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.604860] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:5060 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.604868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.617013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.617034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:6317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.617043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.629060] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.629080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:13201 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.629089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.641181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.641201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:22890 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.641209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.653408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.653429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:18289 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.653437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.665407] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.665427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:14913 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.665435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.677919] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.677939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:20256 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.677948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:18 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.689981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.690003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:10041 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.690011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.702106] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.702126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:10176 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.702134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.714201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.714225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:16573 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.714234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.726418] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.726439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:5005 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.726448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.738423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.738443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:23748 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.738451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.750412] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.750433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:134 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.252 [2024-12-16 14:33:22.750445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.252 [2024-12-16 14:33:22.761041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.252 [2024-12-16 14:33:22.761062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7940 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.253 [2024-12-16 14:33:22.761070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.253 [2024-12-16 14:33:22.769386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.253 [2024-12-16 14:33:22.769405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:1574 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.253 [2024-12-16 14:33:22.769414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.253 [2024-12-16 14:33:22.780490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.253 [2024-12-16 14:33:22.780510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:22564 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.253 [2024-12-16 14:33:22.780518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.253 [2024-12-16 14:33:22.791416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.253 [2024-12-16 14:33:22.791436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:11785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.253 [2024-12-16 14:33:22.791444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.253 [2024-12-16 14:33:22.803923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.253 [2024-12-16 14:33:22.803943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:10216 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.253 [2024-12-16 14:33:22.803951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.253 [2024-12-16 14:33:22.815969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.253 [2024-12-16 14:33:22.815990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:21416 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.253 [2024-12-16 14:33:22.815998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.828379] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.828401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:610 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.828409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.840573] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.840594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:8960 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.840602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.852553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.852578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:21544 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.852586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.860050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.860071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:17987 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.860079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:25 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.871110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.871130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:4473 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.871138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:19 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.881773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.881794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:19086 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.881802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.893564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.893586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:2167 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.893593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.906217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.906238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:15250 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.906246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.918357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.918378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:8785 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.918386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:79 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.930699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.930720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:14921 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.930728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:77 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.941798] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.941818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:7030 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.941826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.954674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.954695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:12963 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.954704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:121 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.962325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.962346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:6853 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.962354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.973121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.973142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:6200 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.973150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.984923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.984944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:952 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.984951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:57 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:22.997003] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:22.997023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:17908 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.511 [2024-12-16 14:33:22.997031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.511 [2024-12-16 14:33:23.008954] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.511 [2024-12-16 14:33:23.008974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17308 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.512 [2024-12-16 14:33:23.008982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.512 [2024-12-16 14:33:23.021056] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.512 [2024-12-16 14:33:23.021078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:19662 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.512 [2024-12-16 14:33:23.021086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.512 [2024-12-16 14:33:23.033052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.512 [2024-12-16 14:33:23.033072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:1469 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.512 [2024-12-16 14:33:23.033081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.512 [2024-12-16 14:33:23.044860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.512 [2024-12-16 14:33:23.044880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:20851 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.512 [2024-12-16 14:33:23.044891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.512 [2024-12-16 14:33:23.056723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.512 [2024-12-16 14:33:23.056744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:24210 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.512 [2024-12-16 14:33:23.056751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.512 [2024-12-16 14:33:23.068346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.512 [2024-12-16 14:33:23.068367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:4339 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.512 [2024-12-16 14:33:23.068374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.512 [2024-12-16 14:33:23.080046] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.512 [2024-12-16 14:33:23.080067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:25078 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.512 [2024-12-16 14:33:23.080075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:114 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.087730] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.087750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:10363 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.087759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.098679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.098700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:19536 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.098708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.110437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.110458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:25596 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.110466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.122658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.122678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:21190 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.122686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.135057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.135077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:4060 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.135085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.146562] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.146582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:8814 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.146590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.157291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.157311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:7597 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.157319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.168928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.168948] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6782 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.168956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.181231] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.181252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:24531 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.181260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.193463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.193484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:9592 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.193492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:26 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.205739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.205759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23613 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.205767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.217486] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.217506] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17759 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.217514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.228782] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.228803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.228811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.241327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.241347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:25317 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.241359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.253244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.253265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:7760 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.770 [2024-12-16 14:33:23.253273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.770 [2024-12-16 14:33:23.269574] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.770 [2024-12-16 14:33:23.269596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11163 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.771 [2024-12-16 14:33:23.269604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.771 [2024-12-16 14:33:23.279929] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.771 [2024-12-16 14:33:23.279949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:2984 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.771 [2024-12-16 14:33:23.279957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:28 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.771 [2024-12-16 14:33:23.288120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.771 [2024-12-16 14:33:23.288141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6944 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.771 [2024-12-16 14:33:23.288149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.771 [2024-12-16 14:33:23.300128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.771 [2024-12-16 14:33:23.300147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:9470 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.771 [2024-12-16 14:33:23.300156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:30 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.771 [2024-12-16 14:33:23.311524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.771 [2024-12-16 14:33:23.311543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:24403 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.771 [2024-12-16 14:33:23.311551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.771 [2024-12-16 14:33:23.322570] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.771 [2024-12-16 14:33:23.322590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:16177 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.771 [2024-12-16 14:33:23.322598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:08.771 [2024-12-16 14:33:23.334689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:08.771 [2024-12-16 14:33:23.334709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:6019 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:08.771 [2024-12-16 14:33:23.334717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.347642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.347666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:16842 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.347675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.359485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.359505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:666 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.359513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.371146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.371165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:16038 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.371174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:16 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.383080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.383099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:3158 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.383107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.399201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.399222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:9386 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.399230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.411322] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.411343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:15728 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.411351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.423431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.423452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:18804 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.423460] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.435600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.435620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:16082 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.435628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.447525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.447546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:25093 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.447553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.459457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.459477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:9158 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.459486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.471566] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.471585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:17017 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.471593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.483314] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.483335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:17186 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.483343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.494937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.494958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:5295 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.494966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.506506] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.506526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:21374 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.506534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.518342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.518362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:514 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.518370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:74 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.530430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.530450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:8800 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.530458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.542267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.542288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:12271 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.542295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.553996] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.029 [2024-12-16 14:33:23.554016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3692 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.029 [2024-12-16 14:33:23.554027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.029 [2024-12-16 14:33:23.565961] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.030 [2024-12-16 14:33:23.565981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:15308 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.030 [2024-12-16 14:33:23.565990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.030 [2024-12-16 14:33:23.577627] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.030 [2024-12-16 14:33:23.577648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:19605 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.030 [2024-12-16 14:33:23.577656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.030 [2024-12-16 14:33:23.589491] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.030 [2024-12-16 14:33:23.589510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8569 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.030 [2024-12-16 14:33:23.589518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.030 [2024-12-16 14:33:23.601223] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.030 [2024-12-16 14:33:23.601243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:5197 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.030 [2024-12-16 14:33:23.601251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.613408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.613430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:24839 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.613438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.625152] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.625175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:11961 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.625185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.637015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.637036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:7027 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.637044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.648906] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.648926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:21719 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.648934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.660909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.660933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:21069 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.660941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.672864] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.672885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:13494 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.672893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.684449] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.684469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:23153 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.684477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:22 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.696769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.696790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:14759 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.696798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.708321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.708341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:21934 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.708349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:90 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.720315] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.720334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:20327 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.720343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.732029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.732049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:15228 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.732057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.743762] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.743782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:82 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.743790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:38 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.755408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.288 [2024-12-16 14:33:23.755428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:21671 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.288 [2024-12-16 14:33:23.755439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.288 [2024-12-16 14:33:23.767136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.289 [2024-12-16 14:33:23.767156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:21141 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.289 [2024-12-16 14:33:23.767165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:107 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.289 [2024-12-16 14:33:23.778775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.289 [2024-12-16 14:33:23.778795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:3590 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.289 [2024-12-16 14:33:23.778803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:37 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.289 [2024-12-16 14:33:23.790697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.289 [2024-12-16 14:33:23.790718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:7258 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.289 [2024-12-16 14:33:23.790726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:124 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.289 [2024-12-16 14:33:23.802638] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.289 [2024-12-16 14:33:23.802658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:25125 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.289 [2024-12-16 14:33:23.802666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.289 [2024-12-16 14:33:23.814381] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.289 [2024-12-16 14:33:23.814401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:22265 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.289 [2024-12-16 14:33:23.814409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:71 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.289 [2024-12-16 14:33:23.825935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.289 [2024-12-16 14:33:23.825955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:11767 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.289 [2024-12-16 14:33:23.825963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.289 [2024-12-16 14:33:23.837618] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.289 [2024-12-16 14:33:23.837638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:24877 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.289 [2024-12-16 14:33:23.837647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.289 [2024-12-16 14:33:23.849217] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.289 [2024-12-16 14:33:23.849237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:9350 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.289 [2024-12-16 14:33:23.849245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:60 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.289 [2024-12-16 14:33:23.861205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.861230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:12348 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.861238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:62 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.873248] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.873268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:4515 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.873276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:63 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.884982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.885002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:19502 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.885009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:75 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.896757] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.896779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:19350 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.896787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.908461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.908481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21240 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.908489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.920668] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.920689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:8144 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.920697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.931601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.931622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:16048 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.931630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.943324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.943345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:4757 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.943353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.955732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.955753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:21175 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.955762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.967723] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.967743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:2483 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.967752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.979799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.979819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:22515 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.979827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:23.991799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:23.991820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9775 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:23.991827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:24.003735] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:24.003756] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:3059 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:24.003764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:24.015721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:24.015742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:21747 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:24.015750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:24.027838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:24.027862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:2856 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:24.027870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:24.039773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:24.039794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:2689 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:24.039801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:24.051699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.547 [2024-12-16 14:33:24.051720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:12820 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.547 [2024-12-16 14:33:24.051728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:108 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.547 [2024-12-16 14:33:24.063542] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.548 [2024-12-16 14:33:24.063562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:4516 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.548 [2024-12-16 14:33:24.063574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.548 [2024-12-16 14:33:24.075744] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.548 [2024-12-16 14:33:24.075765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:9587 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.548 [2024-12-16 14:33:24.075773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.548 [2024-12-16 14:33:24.088215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.548 [2024-12-16 14:33:24.088236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:283 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.548 [2024-12-16 14:33:24.088244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.548 [2024-12-16 14:33:24.099230] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.548 [2024-12-16 14:33:24.099250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:21875 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.548 [2024-12-16 14:33:24.099258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.548 [2024-12-16 14:33:24.111237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.548 [2024-12-16 14:33:24.111256] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:14412 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.548 [2024-12-16 14:33:24.111264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.805 [2024-12-16 14:33:24.123646] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.806 [2024-12-16 14:33:24.123666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:8163 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.806 [2024-12-16 14:33:24.123674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.806 [2024-12-16 14:33:24.135354] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1a3cf90) 00:29:09.806 [2024-12-16 14:33:24.135374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:5879 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:09.806 [2024-12-16 14:33:24.135382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:42 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:09.806 00:29:09.806 Latency(us) 00:29:09.806 [2024-12-16T13:33:24.380Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:09.806 [2024-12-16T13:33:24.380Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:09.806 nvme0n1 : 2.01 21427.96 83.70 0.00 0.00 5968.50 2028.50 21096.35 00:29:09.806 [2024-12-16T13:33:24.380Z] =================================================================================================================== 00:29:09.806 [2024-12-16T13:33:24.380Z] Total : 21427.96 83.70 0.00 0.00 5968.50 2028.50 21096.35 00:29:09.806 0 00:29:09.806 14:33:24 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:09.806 14:33:24 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:09.806 14:33:24 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:09.806 | .driver_specific 00:29:09.806 | .nvme_error 00:29:09.806 | .status_code 00:29:09.806 | .command_transient_transport_error' 00:29:09.806 14:33:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:09.806 14:33:24 -- host/digest.sh@71 -- # (( 168 > 0 )) 00:29:09.806 14:33:24 -- host/digest.sh@73 -- # killprocess 541007 00:29:09.806 14:33:24 -- common/autotest_common.sh@936 -- # '[' -z 541007 ']' 00:29:09.806 14:33:24 -- common/autotest_common.sh@940 -- # kill -0 541007 00:29:09.806 14:33:24 -- common/autotest_common.sh@941 -- # uname 00:29:09.806 14:33:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:09.806 14:33:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 541007 00:29:10.064 14:33:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:10.064 14:33:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:10.064 14:33:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 541007' 00:29:10.064 killing process with pid 541007 00:29:10.064 14:33:24 -- common/autotest_common.sh@955 -- # kill 541007 00:29:10.064 Received shutdown signal, test time was about 2.000000 seconds 00:29:10.064 00:29:10.064 Latency(us) 00:29:10.064 [2024-12-16T13:33:24.638Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:10.064 [2024-12-16T13:33:24.638Z] =================================================================================================================== 00:29:10.064 [2024-12-16T13:33:24.638Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:10.064 14:33:24 -- common/autotest_common.sh@960 -- # wait 541007 00:29:10.064 14:33:24 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:10.064 14:33:24 -- host/digest.sh@54 -- # local rw bs qd 00:29:10.064 14:33:24 -- host/digest.sh@56 -- # rw=randread 00:29:10.064 14:33:24 -- host/digest.sh@56 -- # bs=131072 00:29:10.064 14:33:24 -- host/digest.sh@56 -- # qd=16 00:29:10.064 14:33:24 -- host/digest.sh@58 -- # bperfpid=541648 00:29:10.064 14:33:24 -- host/digest.sh@60 -- # waitforlisten 541648 /var/tmp/bperf.sock 00:29:10.064 14:33:24 -- common/autotest_common.sh@829 -- # '[' -z 541648 ']' 00:29:10.064 14:33:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:10.064 14:33:24 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:10.064 14:33:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:10.064 14:33:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:10.064 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:10.064 14:33:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:10.064 14:33:24 -- common/autotest_common.sh@10 -- # set +x 00:29:10.064 [2024-12-16 14:33:24.620486] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:10.064 [2024-12-16 14:33:24.620535] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid541648 ] 00:29:10.064 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:10.064 Zero copy mechanism will not be used. 00:29:10.322 EAL: No free 2048 kB hugepages reported on node 1 00:29:10.322 [2024-12-16 14:33:24.675954] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:10.322 [2024-12-16 14:33:24.749131] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:10.887 14:33:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:10.887 14:33:25 -- common/autotest_common.sh@862 -- # return 0 00:29:10.887 14:33:25 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:10.887 14:33:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:11.145 14:33:25 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:11.145 14:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.145 14:33:25 -- common/autotest_common.sh@10 -- # set +x 00:29:11.145 14:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.145 14:33:25 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:11.145 14:33:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:11.711 nvme0n1 00:29:11.711 14:33:25 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:11.711 14:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:11.711 14:33:25 -- common/autotest_common.sh@10 -- # set +x 00:29:11.711 14:33:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:11.711 14:33:26 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:11.711 14:33:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:11.711 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:11.711 Zero copy mechanism will not be used. 00:29:11.711 Running I/O for 2 seconds... 00:29:11.711 [2024-12-16 14:33:26.093579] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.093611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.093622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.098729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.098755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.098765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.104206] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.104230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.104239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.109203] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.109225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.109234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.114260] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.114281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.114290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.119901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.119934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.119943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.125518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.125540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.125548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.131047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.131070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.131078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.137064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.137086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.137095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.143139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.143161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.143169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.149182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.149204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.149213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.154878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.154899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.154907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.161137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.161158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.161167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.166963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.166983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.166992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.172536] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.172557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.172565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.178840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.178870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.178883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.185496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.185518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.185526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.191768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.191789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.191797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.198055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.198077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.198085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.204093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.204114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.204122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.209763] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.209783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.209792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.215563] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.215584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.711 [2024-12-16 14:33:26.215592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.711 [2024-12-16 14:33:26.221035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.711 [2024-12-16 14:33:26.221060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.221068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.225615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.225640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.225648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.230139] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.230161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.230170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.234239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.234261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.234269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.239180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.239201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.239210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.244435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.244457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.244466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.251084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.251108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.251117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.259069] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.259091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.259100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.266920] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.266942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.266950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.712 [2024-12-16 14:33:26.275410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.712 [2024-12-16 14:33:26.275432] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.712 [2024-12-16 14:33:26.275441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.283686] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.283709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.283722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.291708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.291730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.291739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.299634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.299656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.299665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.307634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.307656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.307664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.315385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.315408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.315416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.323275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.323295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.323304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.330612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.330634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.330643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.337395] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.337417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.337425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.344366] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.344388] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.344396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.351978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.352008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.352017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.360127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.360148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.360157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.367950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.367972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.367981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.374482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.374504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.374512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.381398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.381419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.381427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.387951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.387972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.387980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.394683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.394704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.394712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.401408] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.401430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:24032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.401439] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.407606] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.407627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.407636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.414200] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.414223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.414231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.421963] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.421985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.421993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.430068] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.430090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.430099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.437825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.437846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.437859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.446006] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.446028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.446036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.453950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.453973] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.453981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.461528] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.461550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.461558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.470026] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.971 [2024-12-16 14:33:26.470049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.971 [2024-12-16 14:33:26.470057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.971 [2024-12-16 14:33:26.477448] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.477470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.477482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.485332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.485353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.485362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.493704] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.493726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.493734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.501914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.501935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.501943] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.508995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.509017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.509025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.516519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.516540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.516549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.523424] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.523445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.523454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.529597] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.529619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.529627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.535736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.535758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.535766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:11.972 [2024-12-16 14:33:26.541653] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:11.972 [2024-12-16 14:33:26.541677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:11.972 [2024-12-16 14:33:26.541686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.547695] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.547716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.547725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.555131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.555153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.555161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.562207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.562229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.562237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.570247] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.570269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.570277] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.577711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.577732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.577740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.584525] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.584547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.584555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.590458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.590482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.590491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.595736] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.595758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.595767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.600363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.600386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.600396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.605075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.605098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.605106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.610661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.610683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.610691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.615979] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.616001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.616009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.621009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.621030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.621039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.625867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.625889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.625897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.630945] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.630967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.630976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.231 [2024-12-16 14:33:26.636031] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.231 [2024-12-16 14:33:26.636053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.231 [2024-12-16 14:33:26.636061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.641193] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.641213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.641225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.645969] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.645990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.645999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.650874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.650894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.650902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.655740] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.655760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.655768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.660634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.660654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.660662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.665121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.665141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.665150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.669444] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.669465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.669473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.673769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.673792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.673800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.679047] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.679068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.679077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.684276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.684297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.684305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.689210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.689231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.689239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.693931] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.693953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.693961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.698540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.698562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.698570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.703306] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.703328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.703337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.707937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.707958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.707966] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.712599] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.712620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.712629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.717225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.717247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.717254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.721817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.721838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.721851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.726435] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.726456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.726465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.731098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.731119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.731127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.735752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.735773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.735782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.740497] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.740517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.740525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.745218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.745238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.745246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.750064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.750086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.750094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.754951] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.754972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.754980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.759719] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.759739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.759748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.764526] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.232 [2024-12-16 14:33:26.764550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.232 [2024-12-16 14:33:26.764559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.232 [2024-12-16 14:33:26.769342] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.233 [2024-12-16 14:33:26.769363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.233 [2024-12-16 14:33:26.769371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.233 [2024-12-16 14:33:26.774175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.233 [2024-12-16 14:33:26.774196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.233 [2024-12-16 14:33:26.774203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.233 [2024-12-16 14:33:26.779018] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.233 [2024-12-16 14:33:26.779040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.233 [2024-12-16 14:33:26.779047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.233 [2024-12-16 14:33:26.783943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.233 [2024-12-16 14:33:26.783964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.233 [2024-12-16 14:33:26.783972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.233 [2024-12-16 14:33:26.788769] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.233 [2024-12-16 14:33:26.788789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.233 [2024-12-16 14:33:26.788797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.233 [2024-12-16 14:33:26.793682] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.233 [2024-12-16 14:33:26.793704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.233 [2024-12-16 14:33:26.793712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.233 [2024-12-16 14:33:26.798512] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.233 [2024-12-16 14:33:26.798533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.233 [2024-12-16 14:33:26.798541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.803456] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.803476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.803484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.807879] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.807901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.807910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.811962] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.811985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.811993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.815876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.815897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.815906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.820478] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.820499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.820506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.825743] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.825765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.825773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.830956] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.830977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.830986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.835926] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.835946] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.835955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.840697] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.840717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.840725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.845397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.845417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.845429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.849501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.849522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.849530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.852428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.852449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.852458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.857316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.857337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.857346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.862196] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.862217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.862225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.867025] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.867045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.867054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.871807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.492 [2024-12-16 14:33:26.871828] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:21248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.492 [2024-12-16 14:33:26.871836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.492 [2024-12-16 14:33:26.876927] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.876947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.876956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.882593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.882614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.882622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.888431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.888456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.888464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.895508] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.895529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.895537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.901513] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.901534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.901543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.907711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.907733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.907740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.913428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.913449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.913458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.919386] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.919408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.919416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.924815] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.924836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.924845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.930211] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.930232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.930241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.935755] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.935777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.935785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.941100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.941121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.941129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.946494] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.946516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.946524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.951824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.951846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.951860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.957160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.957181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.957188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.962330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.962352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.962360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.967037] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.967057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.967065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.971423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.971445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.971453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.975793] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.975815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.975823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.979983] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.980004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.980016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.984122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.984143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.984152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.988364] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.988386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.988394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.992967] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.992988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.992996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:26.998103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:26.998124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:26.998132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:27.003291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:27.003314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:27.003322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:27.008078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:27.008099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:27.008107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:27.012839] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:27.012866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:27.012875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.493 [2024-12-16 14:33:27.017739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.493 [2024-12-16 14:33:27.017759] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.493 [2024-12-16 14:33:27.017767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.022564] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.022585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.022593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.027339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.027360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.027368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.032237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.032257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.032265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.037075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.037095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.037103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.041903] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.041923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.041931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.046799] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.046820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.046828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.051731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.051752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.051760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.056648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.056669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.056677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.494 [2024-12-16 14:33:27.061556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.494 [2024-12-16 14:33:27.061577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.494 [2024-12-16 14:33:27.061591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.066555] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.066577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.066586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.071397] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.071418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.071425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.076237] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.076261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.076269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.081054] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.081075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.081083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.085998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.086018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.086026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.090869] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.090890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.090898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.095832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.095861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.095870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.100781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.100804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.100812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.105715] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.105741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.105750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.110596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.110617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.110626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.115496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.115517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.115526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.120368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.120390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.120398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.125286] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.125308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.125317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.130207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.130229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.130237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.135110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.135133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.135141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.140010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.140031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.140039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.144950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.144971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.144979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.149917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.149940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.149948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.154891] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.154913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.154921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.160096] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.160118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.753 [2024-12-16 14:33:27.160126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.753 [2024-12-16 14:33:27.166628] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.753 [2024-12-16 14:33:27.166650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.166659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.173708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.173731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.173740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.180619] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.180642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.180650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.188296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.188319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.188328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.195075] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.195096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.195104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.202532] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.202555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.202566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.210099] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.210121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.210130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.217080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.217101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.217109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.224841] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.224874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.224883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.232321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.232343] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.232351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.240201] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.240222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.240230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.247308] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.247331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.247339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.253778] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.253802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.253810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.259706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.259728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.259736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.265835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.265870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.265879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.272865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.272887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.272895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.280304] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.280327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.280335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.288089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.288112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.288120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.295458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.295480] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.295489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.302750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.302772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.302781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.309976] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.309998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.310007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.317642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.317665] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.317674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:12.754 [2024-12-16 14:33:27.324575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:12.754 [2024-12-16 14:33:27.324596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:12.754 [2024-12-16 14:33:27.324605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.330194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.330217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.330225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.336683] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.336705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.336714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.342960] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.342982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.342990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.349035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.349057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.349066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.355136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.355157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.355165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.361716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.361739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.361748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.368995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.369018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.369027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.376365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.376387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.376395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.383882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.383903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.383915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.391250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.391271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.391279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.397389] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.397412] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.397420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.403615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.403637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.403646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.409225] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.409246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.409254] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.414713] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.414733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.414743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.420044] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.420067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.420075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.425370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.425391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.425399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.430501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.430522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.430530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.435593] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.435615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.435624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.440767] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.440789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.440797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.445809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.445834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.445842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.450870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.450891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.450899] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.455904] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.455924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.455932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.461066] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.461087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.014 [2024-12-16 14:33:27.461095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.014 [2024-12-16 14:33:27.466111] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.014 [2024-12-16 14:33:27.466133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.466141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.471299] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.471320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.471328] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.476406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.476429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.476441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.481722] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.481745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.481753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.486984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.487005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.487014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.492637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.492658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.492666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.497972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.497994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.498002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.503281] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.503303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.503311] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.508481] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.508501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.508509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.513385] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.513406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.513414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.518399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.518420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.518428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.523365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.523389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.523397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.528368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.528389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:11520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.528396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.533262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.533283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.533293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.538194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.538216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.538224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.543087] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.543108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.543117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.548001] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.548023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.548031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.552696] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.552718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.552726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.556974] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.556995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.557003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.561039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.561059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.561067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.565617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.565638] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.565647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.570361] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.570382] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.570390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.574966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.574988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.574996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.579600] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.579621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.579629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.015 [2024-12-16 14:33:27.584388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.015 [2024-12-16 14:33:27.584408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.015 [2024-12-16 14:33:27.584416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.589180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.589200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.589209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.593980] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.594001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.594009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.598811] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.598833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.598841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.603561] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.603581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.603593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.608382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.608402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.608411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.613324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.613345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.613353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.618156] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.618178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.618186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.623014] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.623034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.623042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.627885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.627906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.627914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.632978] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.632999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.633008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.638007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.638027] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.638036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.643081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.643113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.643122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.648033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.648056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.648065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.652937] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.652958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.652967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.657368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.657389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.657398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.662332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.662353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.662361] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.667344] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.667365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.667373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.672284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.672306] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.672314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.677177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.677198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.677205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.682130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.682151] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.682159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.687098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.687119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.687127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.275 [2024-12-16 14:33:27.692013] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.275 [2024-12-16 14:33:27.692034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.275 [2024-12-16 14:33:27.692042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.696827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.696847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.696861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.701690] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.701711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.701719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.706524] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.706545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.706553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.711339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.711360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.711368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.716052] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.716073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.716082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.720834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.720862] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.720871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.725652] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.725674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.725682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.730434] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.730458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.730466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.735174] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.735195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:14720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.735203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.739882] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.739903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.739911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.744642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.744664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.744672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.749357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.749378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.749387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.754010] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.754031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.754039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.758708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.758728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.758736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.763601] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.763622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.763631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.768416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.768437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.768445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.773348] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.773369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:19392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.773377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.778151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.778171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.778179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.783041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.783061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.783070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.788020] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.788041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.788050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.793295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.793316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.793325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.798382] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.798403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.798411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.804218] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.804240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.804248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.810204] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.810225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.810233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.816024] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.816045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.816057] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.822073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.276 [2024-12-16 14:33:27.822094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.276 [2024-12-16 14:33:27.822102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.276 [2024-12-16 14:33:27.828027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.277 [2024-12-16 14:33:27.828048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.277 [2024-12-16 14:33:27.828056] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.277 [2024-12-16 14:33:27.833648] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.277 [2024-12-16 14:33:27.833668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.277 [2024-12-16 14:33:27.833677] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.277 [2024-12-16 14:33:27.839093] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.277 [2024-12-16 14:33:27.839114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.277 [2024-12-16 14:33:27.839122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.277 [2024-12-16 14:33:27.844731] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.277 [2024-12-16 14:33:27.844752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.277 [2024-12-16 14:33:27.844761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.850700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.850722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.850730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.855849] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.855876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:21760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.855884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.861747] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.861769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.861777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.867950] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.867975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.867984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.874205] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.874227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.874236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.880089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.880111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.880119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.886043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.886066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.886074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.892127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.892149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.892157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.897948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.897969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.897978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.903718] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.903740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.903748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.910085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.910108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.910115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.917647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.917670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.917678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.925873] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.925895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.925903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.933245] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.933268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.933276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.940598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.940620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.940628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.948541] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.948563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.948571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.956089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.956111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.956119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.964650] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.964671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.964680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.972310] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.972331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.972340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.979955] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.979978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.979986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.987749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.987770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.987782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.994239] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:27.994261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:27.994270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:27.999981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:28.000002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:28.000011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:28.005877] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:28.005899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.536 [2024-12-16 14:33:28.005907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.536 [2024-12-16 14:33:28.011952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.536 [2024-12-16 14:33:28.011974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.011982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.018114] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.018135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.018144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.024809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.024831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:13408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.024839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.031540] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.031562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.031570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.037729] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.037749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.037757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.044358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.044378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.044387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.050674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.050696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.050704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.056964] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.056986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.056994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.063119] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.063141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.063149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.069172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.069193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.069201] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.075120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.075140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.075148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.082136] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.082157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.082166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:13.537 [2024-12-16 14:33:28.089455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x182e5f0) 00:29:13.537 [2024-12-16 14:33:28.089476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:13.537 [2024-12-16 14:33:28.089485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:13.537 00:29:13.537 Latency(us) 00:29:13.537 [2024-12-16T13:33:28.111Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:13.537 [2024-12-16T13:33:28.111Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:13.537 nvme0n1 : 2.00 5447.63 680.95 0.00 0.00 2934.76 550.03 9424.70 00:29:13.537 [2024-12-16T13:33:28.111Z] =================================================================================================================== 00:29:13.537 [2024-12-16T13:33:28.111Z] Total : 5447.63 680.95 0.00 0.00 2934.76 550.03 9424.70 00:29:13.537 0 00:29:13.795 14:33:28 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:13.795 14:33:28 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:13.795 14:33:28 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:13.795 | .driver_specific 00:29:13.795 | .nvme_error 00:29:13.795 | .status_code 00:29:13.795 | .command_transient_transport_error' 00:29:13.795 14:33:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:13.795 14:33:28 -- host/digest.sh@71 -- # (( 351 > 0 )) 00:29:13.795 14:33:28 -- host/digest.sh@73 -- # killprocess 541648 00:29:13.795 14:33:28 -- common/autotest_common.sh@936 -- # '[' -z 541648 ']' 00:29:13.795 14:33:28 -- common/autotest_common.sh@940 -- # kill -0 541648 00:29:13.795 14:33:28 -- common/autotest_common.sh@941 -- # uname 00:29:13.795 14:33:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:13.795 14:33:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 541648 00:29:13.795 14:33:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:13.795 14:33:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:13.795 14:33:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 541648' 00:29:13.795 killing process with pid 541648 00:29:13.795 14:33:28 -- common/autotest_common.sh@955 -- # kill 541648 00:29:13.795 Received shutdown signal, test time was about 2.000000 seconds 00:29:13.795 00:29:13.795 Latency(us) 00:29:13.795 [2024-12-16T13:33:28.369Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:13.795 [2024-12-16T13:33:28.369Z] =================================================================================================================== 00:29:13.795 [2024-12-16T13:33:28.369Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:13.795 14:33:28 -- common/autotest_common.sh@960 -- # wait 541648 00:29:14.053 14:33:28 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:14.053 14:33:28 -- host/digest.sh@54 -- # local rw bs qd 00:29:14.053 14:33:28 -- host/digest.sh@56 -- # rw=randwrite 00:29:14.053 14:33:28 -- host/digest.sh@56 -- # bs=4096 00:29:14.053 14:33:28 -- host/digest.sh@56 -- # qd=128 00:29:14.053 14:33:28 -- host/digest.sh@58 -- # bperfpid=542189 00:29:14.053 14:33:28 -- host/digest.sh@60 -- # waitforlisten 542189 /var/tmp/bperf.sock 00:29:14.053 14:33:28 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:14.053 14:33:28 -- common/autotest_common.sh@829 -- # '[' -z 542189 ']' 00:29:14.053 14:33:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:14.053 14:33:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:14.053 14:33:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:14.053 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:14.053 14:33:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:14.053 14:33:28 -- common/autotest_common.sh@10 -- # set +x 00:29:14.053 [2024-12-16 14:33:28.590388] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:14.053 [2024-12-16 14:33:28.590436] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid542189 ] 00:29:14.053 EAL: No free 2048 kB hugepages reported on node 1 00:29:14.312 [2024-12-16 14:33:28.645984] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:14.312 [2024-12-16 14:33:28.712132] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:14.877 14:33:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:14.877 14:33:29 -- common/autotest_common.sh@862 -- # return 0 00:29:14.877 14:33:29 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:14.877 14:33:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:15.135 14:33:29 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:15.135 14:33:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.135 14:33:29 -- common/autotest_common.sh@10 -- # set +x 00:29:15.135 14:33:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.135 14:33:29 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:15.135 14:33:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:15.392 nvme0n1 00:29:15.392 14:33:29 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:15.392 14:33:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.392 14:33:29 -- common/autotest_common.sh@10 -- # set +x 00:29:15.392 14:33:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.392 14:33:29 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:15.393 14:33:29 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:15.393 Running I/O for 2 seconds... 00:29:15.650 [2024-12-16 14:33:29.976669] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.650 [2024-12-16 14:33:29.976853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:12129 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.650 [2024-12-16 14:33:29.976887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:29.985775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:29.985956] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:10464 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:29.985977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:29.994897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:29.995074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21214 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:29.995094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.004120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.004305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:8061 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.004333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.014406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.014584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:5142 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.014607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.023750] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.023930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:14290 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.023949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.033088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.033279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:20158 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.033299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.042993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.043170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:18337 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.043191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.052318] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.052493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:11778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.052512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.061613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.061787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:13502 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.061805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.070905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.071078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:15483 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.071097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.081008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.081180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:6272 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.081200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.090084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.090257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:21277 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.090276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.099280] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.099453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:9780 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.099471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.108562] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.108731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14117 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.108769] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.117677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.117843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:22663 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.117870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.126768] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.126938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:24333 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.126956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.135772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.135959] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:7674 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.135978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.144806] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.144982] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:13945 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.144999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.153906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.154074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:10320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.154093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.162891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.163061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:4394 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.163079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.171908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.172077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:4866 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.172095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.180928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.181106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:22761 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.181122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.189881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.190055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:6313 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.190073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.198956] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.199129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:24189 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.199146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.207964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.208134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:24432 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.208152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.651 [2024-12-16 14:33:30.217006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.651 [2024-12-16 14:33:30.217174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.651 [2024-12-16 14:33:30.217192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.909 [2024-12-16 14:33:30.226203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.909 [2024-12-16 14:33:30.226375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:11402 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.909 [2024-12-16 14:33:30.226393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.909 [2024-12-16 14:33:30.235342] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.909 [2024-12-16 14:33:30.235523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19387 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.909 [2024-12-16 14:33:30.235540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.909 [2024-12-16 14:33:30.244787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.244968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:23193 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.244987] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.253989] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.254165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:4680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.254183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.263085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.263262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:18209 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.263280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.272151] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.272320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:24398 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.272338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.281170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.281339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:8958 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.281357] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.290241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.290410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24967 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.290427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.299264] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.299434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:8650 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.299451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.308301] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.308469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:25419 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.308486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.317326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.317493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:12372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.317511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.326339] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.326510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20606 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.326529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.335319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.335486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:4623 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.335504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.344379] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.344548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:21372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.344571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.353457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.353623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:3454 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.353642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.362489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.362658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:16653 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.362676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.371552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.371722] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:8107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.371740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.380548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.380717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:6998 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.380735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.389623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.389791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:22160 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.389809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.398631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.398799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:19397 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.398818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.407648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.407817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:2699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.407834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.416649] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.416816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:14340 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.416834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.425702] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.425877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:20173 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.425894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.434733] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.434909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21989 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.434927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.443762] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.443935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:23754 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.443952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.452798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.452971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:21082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.452989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.461838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.462019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:3753 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.462037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.470834] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.471009] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:12123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.471025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:15.910 [2024-12-16 14:33:30.479849] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:15.910 [2024-12-16 14:33:30.480030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:11444 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:15.910 [2024-12-16 14:33:30.480047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.489062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.489249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:19680 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.489267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.498309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.498478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:17863 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.498496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.507496] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.507662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:3271 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.507680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.516631] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.516800] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:11971 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.516818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.525790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.525964] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:19918 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.525982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.534788] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.534955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:7418 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.534972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.543752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.543939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7547 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.543957] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.552801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.552979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:23460 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.552997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.561887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.562056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:11534 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.562074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.570871] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.169 [2024-12-16 14:33:30.571042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:19527 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.169 [2024-12-16 14:33:30.571059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.169 [2024-12-16 14:33:30.579918] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.580087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:4467 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.580107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.589019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.589188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:12849 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.589205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.598000] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.598167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:16948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.598184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.607021] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.607188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:2273 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.607205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.616014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.616187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:18273 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.616205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.625050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.625217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:20855 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.625234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.634079] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.634248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:6793 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.634266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.643081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.643249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:13098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.643266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.652148] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.652315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10915 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.652332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.661155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.661326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:23217 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.661343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.670129] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.670296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:6916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.670315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.679126] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.679293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:16568 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.679310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.688111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.688277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:4425 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.688294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.697067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.697232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:5962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.697251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.706067] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.706234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:16973 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.706251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.715065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.715233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:9804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.715251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.724039] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.724206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:11794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.724224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.170 [2024-12-16 14:33:30.733049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.170 [2024-12-16 14:33:30.733218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:7903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.170 [2024-12-16 14:33:30.733236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.742291] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.742461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:20155 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.742479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.751510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.751677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:475 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.751694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.760660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.760831] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.760850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.769780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.769951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:2362 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.769968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.778924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.779097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:4182 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.779115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.787950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.788122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:2185 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.788141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.796948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.797118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:9342 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.797137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.805966] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.806135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:20567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.806153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.814945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.429 [2024-12-16 14:33:30.815114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:14037 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.429 [2024-12-16 14:33:30.815134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.429 [2024-12-16 14:33:30.823923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.824090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:7336 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.824108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.833055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.833237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:24847 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.833255] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.842052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.842221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:22113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.842238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.851059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.851226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.851243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.860044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.860211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:7099 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.860228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.868999] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.869169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5539 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.869187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.878013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.878181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:10164 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.878199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.886998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.887168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:974 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.887185] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.895973] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.896148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:9336 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.896166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.904992] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.905161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:9831 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.905178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.914004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.914175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:11483 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.914192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.923008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.923179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:10792 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.923197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.932008] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.932176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:8385 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.932195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.940976] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.941144] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:4155 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.941161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.949982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.950149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:23699 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.950166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.958979] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.959148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:18723 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.959165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.967955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.968124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:2985 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.968141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.976952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.977122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12975 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.977139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.985938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.986106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:17861 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.986123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.430 [2024-12-16 14:33:30.994926] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.430 [2024-12-16 14:33:30.995119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:5353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.430 [2024-12-16 14:33:30.995138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.004194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.004361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:14198 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.004378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.013371] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.013541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:5635 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.013560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.022534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.022703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:13710 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.022720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.031591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.031758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:14672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.031775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.040548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.040715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:16280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.040731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.049642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.049810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:6439 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.049829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.058591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.058758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:315 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.058775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.067603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.067771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:14303 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.067788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.076600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.076768] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:6837 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.689 [2024-12-16 14:33:31.076785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.689 [2024-12-16 14:33:31.085554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.689 [2024-12-16 14:33:31.085725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19384 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.085741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.094626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.094794] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:7237 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.094811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.103604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.103772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:1487 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.103791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.112586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.112753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:5280 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.112770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.121622] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.121792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:7175 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.121809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.130604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.130771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:24152 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.130791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.139579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.139746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.139765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.148609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.148781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:91 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.148798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.157586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.157754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:16661 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.157771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.166596] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.166763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:14672 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.166780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.175570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.175737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:1821 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.175754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.184602] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.184769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:13851 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.184787] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.193661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.193830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6287 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.193847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.202636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.202804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:24377 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.202822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.211619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.211786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:19802 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.211803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.220542] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.220709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:5443 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.220728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.229521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.229688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:14550 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.229705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.238526] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.238696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:79 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.238713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.247693] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.247883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22710 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.247901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.690 [2024-12-16 14:33:31.256931] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.690 [2024-12-16 14:33:31.257105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:6759 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.690 [2024-12-16 14:33:31.257133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.266201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.266374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:21241 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.266391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.275411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.275581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:11515 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.275599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.284386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.284555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:23256 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.284572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.293438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.293608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:331 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.293625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.302411] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.302578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11447 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.302595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.311415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.311584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:986 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.311601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.320400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.320576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:4375 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.320594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.329350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.329519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:20192 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.329537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.338377] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.338546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:13953 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.338563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.347378] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.347546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:13240 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.347563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.356430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.356598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:23162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.949 [2024-12-16 14:33:31.356617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.949 [2024-12-16 14:33:31.365420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.949 [2024-12-16 14:33:31.365588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:3916 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.365610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.374457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.374633] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:3445 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.374651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.383732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.383924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:21903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.383942] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.392826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.393005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:22971 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.393023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.401785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.401958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:8162 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.401976] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.410793] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.410971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5474 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.410989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.419815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.419988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:17036 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.420005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.428819] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.428995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:25406 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.429012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.437828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.438005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:18725 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.438022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.446784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.446965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:7882 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.446985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.455907] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.456075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:10761 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.456092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.464894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.465063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:22302 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.465081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.473874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.474042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:5320 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.474060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.482899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.483069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:11483 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.483087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.491939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.492109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:12179 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.492126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.500940] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.501128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:16159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.501146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.510201] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.510368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:13232 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.510385] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:16.950 [2024-12-16 14:33:31.519389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:16.950 [2024-12-16 14:33:31.519560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2933 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:16.950 [2024-12-16 14:33:31.519578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.528667] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.528836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:8422 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.528859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.537741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.537915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:13500 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.537932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.546714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.546886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:19440 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.546903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.555760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.555932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:3366 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.555951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.564761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.564935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:23531 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.564953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.573760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.573935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:15130 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.573952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.582767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.582943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:22218 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.582960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.591845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.592046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:14638 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.592064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.601070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.601240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:13504 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.601261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.610082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.610249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:11538 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.610267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.619054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.619225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:2740 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.619242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.628145] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.628316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23934 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.628334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.637083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.637251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:10159 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.637271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.646064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.646232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:25386 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.646249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.655132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.655298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:6479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.655317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.664119] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.664288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:10420 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.664305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.673121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.673289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:13107 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.673306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.682135] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.682310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:14746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.682327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.691186] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.691354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:10608 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.691372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.700217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.700383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:1057 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.700401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.709214] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.709383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:10745 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.709401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.718193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.718360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:14922 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.718379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.727183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.727350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:20762 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.727368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.736179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.736347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:451 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.736364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.745265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.745436] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:16605 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.745454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.754297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.209 [2024-12-16 14:33:31.754481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:5841 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.209 [2024-12-16 14:33:31.754499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.209 [2024-12-16 14:33:31.763545] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.210 [2024-12-16 14:33:31.763711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:10113 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.210 [2024-12-16 14:33:31.763729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.210 [2024-12-16 14:33:31.772711] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.210 [2024-12-16 14:33:31.772883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:7754 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.210 [2024-12-16 14:33:31.772900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.468 [2024-12-16 14:33:31.781909] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.468 [2024-12-16 14:33:31.782081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:13545 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.468 [2024-12-16 14:33:31.782098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.468 [2024-12-16 14:33:31.791096] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.468 [2024-12-16 14:33:31.791264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:24184 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.468 [2024-12-16 14:33:31.791282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.468 [2024-12-16 14:33:31.800077] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.468 [2024-12-16 14:33:31.800246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:776 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.468 [2024-12-16 14:33:31.800264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.468 [2024-12-16 14:33:31.809085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.468 [2024-12-16 14:33:31.809252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:4885 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.468 [2024-12-16 14:33:31.809270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.468 [2024-12-16 14:33:31.818065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.818233] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:14679 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.818253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.827083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.827253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:17460 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.827271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.836060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.836230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:835 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.836250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.845081] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.845249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8245 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.845266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.854094] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.854261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:13719 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.854279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.863254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.863423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:11440 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.863440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.872229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.872399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:4853 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.872418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.881219] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.881387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:6760 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.881404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.890187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.890354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:3905 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.890372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:52 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.899195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.899362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:13375 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.899380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.908162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.908327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:1554 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.908344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.917155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.917328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:100 nsid:1 lba:4382 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.917345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:100 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.926139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.926307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:116 nsid:1 lba:13345 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.926324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:116 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.935114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.935284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:23788 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.935301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.944112] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.944278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:14268 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.944295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.953101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.953270] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3191 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.953288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.962083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.962250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:3123 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.962268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:126 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 [2024-12-16 14:33:31.971069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df1e0) with pdu=0x2000190fda78 00:29:17.469 [2024-12-16 14:33:31.971213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:8300 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:17.469 [2024-12-16 14:33:31.971230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:007f p:0 m:0 dnr:0 00:29:17.469 00:29:17.469 Latency(us) 00:29:17.469 [2024-12-16T13:33:32.043Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:17.469 [2024-12-16T13:33:32.043Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:17.469 nvme0n1 : 2.00 28156.02 109.98 0.00 0.00 4539.04 3136.37 10236.10 00:29:17.469 [2024-12-16T13:33:32.043Z] =================================================================================================================== 00:29:17.469 [2024-12-16T13:33:32.043Z] Total : 28156.02 109.98 0.00 0.00 4539.04 3136.37 10236.10 00:29:17.469 0 00:29:17.469 14:33:31 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:17.469 14:33:31 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:17.469 14:33:31 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:17.469 | .driver_specific 00:29:17.469 | .nvme_error 00:29:17.469 | .status_code 00:29:17.469 | .command_transient_transport_error' 00:29:17.469 14:33:31 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:17.728 14:33:32 -- host/digest.sh@71 -- # (( 221 > 0 )) 00:29:17.728 14:33:32 -- host/digest.sh@73 -- # killprocess 542189 00:29:17.728 14:33:32 -- common/autotest_common.sh@936 -- # '[' -z 542189 ']' 00:29:17.728 14:33:32 -- common/autotest_common.sh@940 -- # kill -0 542189 00:29:17.728 14:33:32 -- common/autotest_common.sh@941 -- # uname 00:29:17.728 14:33:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:17.728 14:33:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 542189 00:29:17.728 14:33:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:17.728 14:33:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:17.728 14:33:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 542189' 00:29:17.728 killing process with pid 542189 00:29:17.728 14:33:32 -- common/autotest_common.sh@955 -- # kill 542189 00:29:17.728 Received shutdown signal, test time was about 2.000000 seconds 00:29:17.728 00:29:17.728 Latency(us) 00:29:17.728 [2024-12-16T13:33:32.302Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:17.728 [2024-12-16T13:33:32.302Z] =================================================================================================================== 00:29:17.728 [2024-12-16T13:33:32.302Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:17.728 14:33:32 -- common/autotest_common.sh@960 -- # wait 542189 00:29:17.986 14:33:32 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:17.986 14:33:32 -- host/digest.sh@54 -- # local rw bs qd 00:29:17.986 14:33:32 -- host/digest.sh@56 -- # rw=randwrite 00:29:17.986 14:33:32 -- host/digest.sh@56 -- # bs=131072 00:29:17.986 14:33:32 -- host/digest.sh@56 -- # qd=16 00:29:17.986 14:33:32 -- host/digest.sh@58 -- # bperfpid=542862 00:29:17.986 14:33:32 -- host/digest.sh@60 -- # waitforlisten 542862 /var/tmp/bperf.sock 00:29:17.986 14:33:32 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:17.986 14:33:32 -- common/autotest_common.sh@829 -- # '[' -z 542862 ']' 00:29:17.986 14:33:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:17.986 14:33:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:17.986 14:33:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:17.986 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:17.986 14:33:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:17.986 14:33:32 -- common/autotest_common.sh@10 -- # set +x 00:29:17.986 [2024-12-16 14:33:32.476111] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:17.986 [2024-12-16 14:33:32.476158] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid542862 ] 00:29:17.986 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:17.986 Zero copy mechanism will not be used. 00:29:17.986 EAL: No free 2048 kB hugepages reported on node 1 00:29:17.986 [2024-12-16 14:33:32.530906] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:18.244 [2024-12-16 14:33:32.594632] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:18.808 14:33:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:18.808 14:33:33 -- common/autotest_common.sh@862 -- # return 0 00:29:18.808 14:33:33 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:18.808 14:33:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:19.066 14:33:33 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:19.066 14:33:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.066 14:33:33 -- common/autotest_common.sh@10 -- # set +x 00:29:19.066 14:33:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.066 14:33:33 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:19.066 14:33:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:19.324 nvme0n1 00:29:19.324 14:33:33 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:19.324 14:33:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.324 14:33:33 -- common/autotest_common.sh@10 -- # set +x 00:29:19.324 14:33:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.324 14:33:33 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:19.324 14:33:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:19.324 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:19.324 Zero copy mechanism will not be used. 00:29:19.324 Running I/O for 2 seconds... 00:29:19.325 [2024-12-16 14:33:33.806277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.806353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.806382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.810548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.810669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.810695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.814290] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.814383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.814406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.818005] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.818078] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.818100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.821683] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.821765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.821786] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.825325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.825384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.825403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.828964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.829138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.829160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.832675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.832928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.832948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.836226] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.836461] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.836482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.840195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.840323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.840341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.844090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.844216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.844234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.847637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.847712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.847730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.851363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.851485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.851503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.856141] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.856352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.856373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.861437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.861628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.861648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.866157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.866516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.866537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.871763] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.871951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.871969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.877309] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.877378] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.877396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.882143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.882263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.882281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.886163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.886243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.886261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.889963] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.890038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.890055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.893580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.893726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.893745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.325 [2024-12-16 14:33:33.897194] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.325 [2024-12-16 14:33:33.897374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.325 [2024-12-16 14:33:33.897392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.900874] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.901126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.901146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.905026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.905232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.905249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.908619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.908746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.908764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.912189] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.912280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.912298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.915731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.915815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.915834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.919630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.919754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.919772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.923898] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.924042] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.924060] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.927586] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.927750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.927768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.931268] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.931515] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.931535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.935457] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.935727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.935750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.939288] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.939478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.939496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.943721] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.585 [2024-12-16 14:33:33.943901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.585 [2024-12-16 14:33:33.943918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.585 [2024-12-16 14:33:33.949071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.949188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.949206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.953609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.953696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.953715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.958195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.958398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.958416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.962455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.962542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.962560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.967435] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.967660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.967680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.972438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.972662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.972682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.977891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.978090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.978108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.982535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.982647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.982665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.986790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.986848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.986873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.991367] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.991438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.991456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:33.996132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:33.996287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:33.996305] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.001150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.001253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.001270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.006068] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.006311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.006331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.010938] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.011169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.011188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.015769] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.015934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.015955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.020564] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.020674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.020692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.024780] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.024844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.024869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.028636] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.028711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.028729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.032253] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.032320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.032339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.035817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.035992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.036009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.039442] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.039690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.039710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.043458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.043706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.043725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.047335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.047532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.047550] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.050933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.051050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.051072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.054460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.054558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.054578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.057961] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.058062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.058080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.061817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.061981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.061999] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.586 [2024-12-16 14:33:34.065593] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.586 [2024-12-16 14:33:34.065760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.586 [2024-12-16 14:33:34.065778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.069242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.069495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.069516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.073026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.073226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.073244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.077448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.077574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.077592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.082640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.082739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.082758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.086691] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.086746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.086764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.090755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.090893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.090911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.094843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.094992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.095011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.099075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.099202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.099220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.103131] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.103364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.103384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.107277] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.107500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.107519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.111246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.111416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.111434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.115476] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.115578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.115596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.119557] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.119620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.119642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.123826] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.123904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.123922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.127839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.127990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.128008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.131782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.131877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.131895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.135941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.136175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.136194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.139964] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.140149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.140167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.144099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.144248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.144267] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.147993] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.148090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.148109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.152249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.152331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.152349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.587 [2024-12-16 14:33:34.156580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.587 [2024-12-16 14:33:34.156668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.587 [2024-12-16 14:33:34.156686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.160698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.160849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.160874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.164756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.164898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.164916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.168934] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.169159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.169179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.173134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.173335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.173352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.177092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.177217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.177237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.181136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.181223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.181242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.185187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.185246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.185264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.189190] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.189257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.189276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.193285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.193447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.193466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.197461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.197601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.197619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.202092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.202331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.202350] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.205897] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.206106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.206125] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.209699] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.209878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.209897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.213595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.213701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.213720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.217555] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.217670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.217689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.222138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.222252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.222270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.226790] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.226958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.226979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.230994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.231132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.231150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.235248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.235490] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.235510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.239409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.847 [2024-12-16 14:33:34.239579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.847 [2024-12-16 14:33:34.239597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.847 [2024-12-16 14:33:34.243638] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.243795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.243813] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.247922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.248048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.248066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.251914] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.251974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.251992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.256261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.256372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.256392] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.260443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.260605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.260623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.264665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.264787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.264805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.268915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.269149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.269168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.272960] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.273200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.273220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.276787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.276993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.277012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.280505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.280603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.280621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.284120] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.284220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.284238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.287716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.287784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.287803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.291674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.291817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.291835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.296227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.296299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.296317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.301136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.301225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.301243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.305705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.305836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.305858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.311410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.311557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.311575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.316957] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.317101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.317120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.322708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.322848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.322873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.328124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.328198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.328217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.333138] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.333284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.333301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.337601] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.337751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.337768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.341558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.341709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.341730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.345532] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.345607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.345625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.349359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.349460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.349478] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.354026] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.354202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.354220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.357994] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.358051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.358069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.361982] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.848 [2024-12-16 14:33:34.362100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.848 [2024-12-16 14:33:34.362117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.848 [2024-12-16 14:33:34.367196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.367363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.367381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.371925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.372112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.372130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.376072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.376216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.376234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.380175] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.380274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.380292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.383925] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.384067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.384086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.387570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.387647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.387665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.391247] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.391322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.391340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.395213] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.395316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.395334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.399030] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.399183] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.399200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.402772] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.402997] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.403016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.406595] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.406781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.406799] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.410899] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.410960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.410977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:19.849 [2024-12-16 14:33:34.416321] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:19.849 [2024-12-16 14:33:34.416440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:19.849 [2024-12-16 14:33:34.416458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.108 [2024-12-16 14:33:34.420980] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.108 [2024-12-16 14:33:34.421061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.108 [2024-12-16 14:33:34.421080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.108 [2024-12-16 14:33:34.425436] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.108 [2024-12-16 14:33:34.425498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.108 [2024-12-16 14:33:34.425516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.108 [2024-12-16 14:33:34.429810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.108 [2024-12-16 14:33:34.429905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.108 [2024-12-16 14:33:34.429923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.108 [2024-12-16 14:33:34.434323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.108 [2024-12-16 14:33:34.434523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.434543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.439796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.440020] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.440039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.444634] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.444803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.444821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.449260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.449391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.449409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.453787] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.453937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.453961] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.458071] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.458168] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.458187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.461810] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.461903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.461922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.466431] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.466615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.466633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.471796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.471983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.472000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.476278] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.476424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.476442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.480391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.480592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.480610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.484559] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.484692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.484710] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.488506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.488620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.488638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.492645] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.492741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.492760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.496891] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.496998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.497016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.501140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.501351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.501369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.505677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.505836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.505861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.510013] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.510241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.510261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.514255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.514411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.514428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.518558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.518691] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.518709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.522939] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.523084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.523102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.527243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.527379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.527397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.531574] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.531698] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.531716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.535801] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.536003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.536021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.540171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.540324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.540343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.544537] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.544779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.544800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.109 [2024-12-16 14:33:34.548942] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.109 [2024-12-16 14:33:34.549097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.109 [2024-12-16 14:33:34.549115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.553330] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.553469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.553486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.557690] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.557808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.557826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.562028] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.562141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.562160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.566271] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.566423] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.566445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.570811] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.570981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.571000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.574959] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.575099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.575118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.579420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.579648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.579666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.583798] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.583961] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.583981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.588127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.588279] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.588297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.592458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.592565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.592583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.596592] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.596695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.596713] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.600343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.600442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.600462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.604705] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.604941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.604960] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.610050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.610255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.610275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.615389] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.615592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.615611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.620915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.621161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.621182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.626621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.626785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.626803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.633710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.633806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.633824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.639237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.639312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.639332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.645089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.645179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.645198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.651161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.651274] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.651294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.657625] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.657733] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.657753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.662776] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.663017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.663037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.667260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.667500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.667521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.671913] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.671976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.671994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.110 [2024-12-16 14:33:34.676712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.110 [2024-12-16 14:33:34.676807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.110 [2024-12-16 14:33:34.676825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.681246] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.681369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.370 [2024-12-16 14:33:34.681387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.686445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.686507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.370 [2024-12-16 14:33:34.686526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.690996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.691137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.370 [2024-12-16 14:33:34.691155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.695458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.695574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.370 [2024-12-16 14:33:34.695597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.700197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.700434] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.370 [2024-12-16 14:33:34.700455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.705430] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.705613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.370 [2024-12-16 14:33:34.705631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.710388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.710536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.370 [2024-12-16 14:33:34.710554] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.714978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.715056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.370 [2024-12-16 14:33:34.715074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.370 [2024-12-16 14:33:34.719506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.370 [2024-12-16 14:33:34.719622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.719640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.725061] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.725139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.725158] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.730500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.730643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.730661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.735345] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.735484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.735501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.740076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.740320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.740340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.744741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.744864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.744882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.748739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.748903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.748921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.753708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.753791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.753811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.758491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.758554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.758573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.762633] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.762738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.762756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.766640] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.766781] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.766800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.770299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.770475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.770493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.774014] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.774258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.774278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.777680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.777895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.777913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.781292] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.781414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.781433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.785397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.785536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.785555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.789069] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.789149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.789168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.792639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.792714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.792733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.796329] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.796485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.796503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.800050] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.800224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.800244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.803785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.804022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.804042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.807998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.808238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.808259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.812958] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.813146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.813166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.817677] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.817743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.817762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.822106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.822187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.822207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.826161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.826268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.826286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.371 [2024-12-16 14:33:34.829930] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.371 [2024-12-16 14:33:34.830092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.371 [2024-12-16 14:33:34.830112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.833561] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.833713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.833731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.837297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.837545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.837565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.841012] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.841241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.841261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.845217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.845283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.845301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.849074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.849175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.849193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.852675] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.852748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.852767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.856397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.856475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.856493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.860060] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.860218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.860236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.863657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.863820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.863838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.867584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.867830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.867850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.871212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.871415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.871435] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.874767] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.874850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.874873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.878392] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.878521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.878542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.882003] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.882082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.882100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.885584] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.885655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.885674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.889252] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.889403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.889424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.892800] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.892960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.892980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.896508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.896751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.896770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.900084] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.900299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.900318] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.903736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.903889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.903908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.907344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.907446] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.907467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.910965] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.911049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.911067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.914531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.914618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.914636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.918157] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.918308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.918326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.921758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.921907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23904 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.921925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.925413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.925659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.925679] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.929042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.372 [2024-12-16 14:33:34.929286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.372 [2024-12-16 14:33:34.929306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.372 [2024-12-16 14:33:34.932582] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.373 [2024-12-16 14:33:34.932694] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.373 [2024-12-16 14:33:34.932712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.373 [2024-12-16 14:33:34.936211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.373 [2024-12-16 14:33:34.936362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.373 [2024-12-16 14:33:34.936380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.373 [2024-12-16 14:33:34.939803] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.373 [2024-12-16 14:33:34.939880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.373 [2024-12-16 14:33:34.939900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.943437] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.943524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.943542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.947083] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.947255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.947275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.950718] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.950889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.950907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.954784] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.955019] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.955039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.959570] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.959785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.959804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.964177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.964329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.964347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.968831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.968899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.968917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.973474] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.973555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.973576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.978558] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.978617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.978635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.983894] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.984045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.984063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.989072] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.989208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.989226] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:34.995616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:34.995914] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:34.995933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:35.002193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:35.002410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:35.002430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:35.009049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:35.009177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:35.009196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:35.016087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:35.016278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:35.016296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.637 [2024-12-16 14:33:35.023097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.637 [2024-12-16 14:33:35.023251] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.637 [2024-12-16 14:33:35.023270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.030276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.030524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.030545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.037102] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.037290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.037308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.044322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.044518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.044537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.052118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.052263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.052281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.059187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.059387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.059407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.066513] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.066637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.066656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.073192] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.073356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.073375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.080229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.080401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.080420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.086541] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.086611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.086629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.091085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.091148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.091166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.096261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.096375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.096393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.101707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.101809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.101828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.106388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.106541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.106561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.110179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.110307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.110324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.113889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.114007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.114025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.117609] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.117685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.117704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.121261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.121334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.121353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.124985] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.125142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.125166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.638 [2024-12-16 14:33:35.128676] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.638 [2024-12-16 14:33:35.128845] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.638 [2024-12-16 14:33:35.128872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.132448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.132656] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.132676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.136206] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.136347] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.136365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.140520] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.140620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.140638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.145838] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.146008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.146027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.150828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.150912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.150930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.155666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.155738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.155756] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.160672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.160829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.160846] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.166053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.166154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.166172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.171208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.171364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.171383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.176033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.176107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.176126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.180600] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.180713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.180731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.185706] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.185812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.185830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.190734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.190852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.190875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.195495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.195617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.195635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.200208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.200351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.200369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.639 [2024-12-16 14:33:35.205052] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.639 [2024-12-16 14:33:35.205180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.639 [2024-12-16 14:33:35.205198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.902 [2024-12-16 14:33:35.210031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.902 [2024-12-16 14:33:35.210204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.902 [2024-12-16 14:33:35.210223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.902 [2024-12-16 14:33:35.215064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.902 [2024-12-16 14:33:35.215145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.902 [2024-12-16 14:33:35.215164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.902 [2024-12-16 14:33:35.219707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.902 [2024-12-16 14:33:35.219797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.902 [2024-12-16 14:33:35.219815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.902 [2024-12-16 14:33:35.224548] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.902 [2024-12-16 14:33:35.224608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.902 [2024-12-16 14:33:35.224627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.902 [2024-12-16 14:33:35.229193] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.902 [2024-12-16 14:33:35.229294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.229313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.233434] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.233507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.233525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.238195] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.238337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.238355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.242047] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.242207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.242225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.246031] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.246211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.246232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.249892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.249963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.249982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.254116] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.254250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.254268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.258106] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.258181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.258200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.262058] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.262173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.262192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.265775] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.265848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.265872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.269510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.269663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.269680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.273218] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.273402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.273420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.276888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.277051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.277069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.280892] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.281002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.281020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.284597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.284726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.284744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.288249] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.288327] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.288346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.291881] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.291996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.292015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.295498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.295595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.295612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.299182] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.299338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.299356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.302837] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.303022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.303041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.306521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.306706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.306724] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.310133] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.310228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.310245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.313757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.313887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.313906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.317355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.317429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.317448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.321055] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.321164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.321182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.324695] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.324783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.324801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.328399] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.328556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.903 [2024-12-16 14:33:35.328574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.903 [2024-12-16 14:33:35.332152] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.903 [2024-12-16 14:33:35.332334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.332352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.335861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.336045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.336063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.339510] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.339605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.339623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.343124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.343271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.343289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.346734] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.346823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.346842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.350351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.350481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.350499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.353953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.354044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.354062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.357604] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.357760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.357779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.361238] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.361400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.361418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.364885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.365072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.365090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.368461] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.368608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.368626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.372088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.372219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.372237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.375662] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.375743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.375761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.379383] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.379508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.379527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.382986] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.383074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.383093] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.387024] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.387162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.387180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.390757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.390962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.390979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.394420] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.394605] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.394623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.398022] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.398106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.398123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.401648] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.401790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.401808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.405265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.405355] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.405376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.408888] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.409022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.409039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.412508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.412594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.412613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.416184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.416339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.416356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.419841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.420022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.420039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.423505] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.423696] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.423714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.427123] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.427227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.427246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.430748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.430868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.904 [2024-12-16 14:33:35.430886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.904 [2024-12-16 14:33:35.434380] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.904 [2024-12-16 14:33:35.434467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.434485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.905 [2024-12-16 14:33:35.438009] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.905 [2024-12-16 14:33:35.438142] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.438161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.905 [2024-12-16 14:33:35.441626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.905 [2024-12-16 14:33:35.441790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.441808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.905 [2024-12-16 14:33:35.445821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.905 [2024-12-16 14:33:35.446025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.446045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.905 [2024-12-16 14:33:35.451066] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.905 [2024-12-16 14:33:35.451338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.451358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:20.905 [2024-12-16 14:33:35.455860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.905 [2024-12-16 14:33:35.456029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.456048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:20.905 [2024-12-16 14:33:35.460560] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.905 [2024-12-16 14:33:35.460745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.460763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:20.905 [2024-12-16 14:33:35.465652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.905 [2024-12-16 14:33:35.465826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.465845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:20.905 [2024-12-16 14:33:35.471017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:20.905 [2024-12-16 14:33:35.471174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:20.905 [2024-12-16 14:33:35.471193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.476308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.476459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.476477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.482065] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.482221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.482239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.487607] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.487911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.487930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.492751] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.492962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.492980] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.496945] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.497198] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.497218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.501449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.501644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.501661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.505698] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.505814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.505832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.510101] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.510277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.510295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.514216] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.514354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.514373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.518479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.518554] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.518577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.522791] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.523006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.523024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.527001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.527173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.527191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.531580] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.531826] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.531844] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.536136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.536283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.536301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.164 [2024-12-16 14:33:35.540260] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.164 [2024-12-16 14:33:35.540411] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.164 [2024-12-16 14:33:35.540429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.544092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.544302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.544321] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.548307] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.548479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.548497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.553451] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.553626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.553644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.558413] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.558576] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.558595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.562498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.562611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.562628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.566616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.566790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.566808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.570831] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.570965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.570983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.574912] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.575070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.575089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.578950] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.579109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.579129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.583045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.583160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.583180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.586752] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.586936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.586956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.590357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.590503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.590521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.593921] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.594007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.594025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.597533] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.597725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.597743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.601124] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.601230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.601248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.604626] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.604719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.604738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.608217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.608398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.608417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.611758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.611900] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.611918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.615324] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.615492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.615510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.619033] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.619194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.619212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.623344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.623444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.623466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.628729] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.628876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.628894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.633820] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.633922] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.633941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.639425] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.639524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.639542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.645887] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.646074] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.646092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.652571] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.652797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.652818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.658603] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.658774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.165 [2024-12-16 14:33:35.658792] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.165 [2024-12-16 14:33:35.665006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.165 [2024-12-16 14:33:35.665135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.665154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.671179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.671283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.671302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.677906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.678064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.678082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.682941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.683047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.683065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.687388] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.687517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.687536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.692010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.692147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.692165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.696933] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.697071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.697089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.701948] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.702115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.702133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.707150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.707309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.707326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.711666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.711760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.711778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.715616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.715740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.715762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.719796] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.719881] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.719900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.723412] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.723526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.723544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.726932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.727058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.727077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.730464] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.730697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.730717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.166 [2024-12-16 14:33:35.735334] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.166 [2024-12-16 14:33:35.735553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.166 [2024-12-16 14:33:35.735574] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.741179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.741369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.741388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.747311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.747472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.747491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.753987] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.754176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.754195] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.761401] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.761600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.761619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.768075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.768194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.768214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.773054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.773140] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.773160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.778217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.778278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.778297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.783205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.783334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.783352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.788231] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.788430] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.788449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.793361] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.793533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:8448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.793552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:21.425 [2024-12-16 14:33:35.798118] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x18df4b0) with pdu=0x2000190fef90 00:29:21.425 [2024-12-16 14:33:35.798201] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:21.425 [2024-12-16 14:33:35.798219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:21.425 00:29:21.425 Latency(us) 00:29:21.425 [2024-12-16T13:33:35.999Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:21.425 [2024-12-16T13:33:35.999Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:21.425 nvme0n1 : 2.00 7045.56 880.69 0.00 0.00 2266.87 1497.97 11796.48 00:29:21.425 [2024-12-16T13:33:35.999Z] =================================================================================================================== 00:29:21.425 [2024-12-16T13:33:35.999Z] Total : 7045.56 880.69 0.00 0.00 2266.87 1497.97 11796.48 00:29:21.425 0 00:29:21.425 14:33:35 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:21.425 14:33:35 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:21.425 14:33:35 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:21.425 | .driver_specific 00:29:21.425 | .nvme_error 00:29:21.425 | .status_code 00:29:21.425 | .command_transient_transport_error' 00:29:21.425 14:33:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:21.683 14:33:35 -- host/digest.sh@71 -- # (( 455 > 0 )) 00:29:21.683 14:33:36 -- host/digest.sh@73 -- # killprocess 542862 00:29:21.683 14:33:36 -- common/autotest_common.sh@936 -- # '[' -z 542862 ']' 00:29:21.683 14:33:36 -- common/autotest_common.sh@940 -- # kill -0 542862 00:29:21.683 14:33:36 -- common/autotest_common.sh@941 -- # uname 00:29:21.683 14:33:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:21.683 14:33:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 542862 00:29:21.683 14:33:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:21.683 14:33:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:21.683 14:33:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 542862' 00:29:21.683 killing process with pid 542862 00:29:21.683 14:33:36 -- common/autotest_common.sh@955 -- # kill 542862 00:29:21.683 Received shutdown signal, test time was about 2.000000 seconds 00:29:21.683 00:29:21.683 Latency(us) 00:29:21.683 [2024-12-16T13:33:36.257Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:21.683 [2024-12-16T13:33:36.257Z] =================================================================================================================== 00:29:21.683 [2024-12-16T13:33:36.257Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:21.683 14:33:36 -- common/autotest_common.sh@960 -- # wait 542862 00:29:21.683 14:33:36 -- host/digest.sh@115 -- # killprocess 540760 00:29:21.683 14:33:36 -- common/autotest_common.sh@936 -- # '[' -z 540760 ']' 00:29:21.683 14:33:36 -- common/autotest_common.sh@940 -- # kill -0 540760 00:29:21.683 14:33:36 -- common/autotest_common.sh@941 -- # uname 00:29:21.941 14:33:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:21.941 14:33:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 540760 00:29:21.941 14:33:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:21.941 14:33:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:21.941 14:33:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 540760' 00:29:21.941 killing process with pid 540760 00:29:21.941 14:33:36 -- common/autotest_common.sh@955 -- # kill 540760 00:29:21.941 14:33:36 -- common/autotest_common.sh@960 -- # wait 540760 00:29:21.941 00:29:21.941 real 0m16.849s 00:29:21.941 user 0m31.888s 00:29:21.941 sys 0m4.930s 00:29:21.941 14:33:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:21.941 14:33:36 -- common/autotest_common.sh@10 -- # set +x 00:29:21.941 ************************************ 00:29:21.941 END TEST nvmf_digest_error 00:29:21.941 ************************************ 00:29:22.199 14:33:36 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:29:22.199 14:33:36 -- host/digest.sh@139 -- # nvmftestfini 00:29:22.199 14:33:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:22.199 14:33:36 -- nvmf/common.sh@116 -- # sync 00:29:22.199 14:33:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:22.199 14:33:36 -- nvmf/common.sh@119 -- # set +e 00:29:22.199 14:33:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:22.199 14:33:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:22.199 rmmod nvme_tcp 00:29:22.199 rmmod nvme_fabrics 00:29:22.199 rmmod nvme_keyring 00:29:22.199 14:33:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:22.199 14:33:36 -- nvmf/common.sh@123 -- # set -e 00:29:22.199 14:33:36 -- nvmf/common.sh@124 -- # return 0 00:29:22.199 14:33:36 -- nvmf/common.sh@477 -- # '[' -n 540760 ']' 00:29:22.199 14:33:36 -- nvmf/common.sh@478 -- # killprocess 540760 00:29:22.199 14:33:36 -- common/autotest_common.sh@936 -- # '[' -z 540760 ']' 00:29:22.199 14:33:36 -- common/autotest_common.sh@940 -- # kill -0 540760 00:29:22.199 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (540760) - No such process 00:29:22.199 14:33:36 -- common/autotest_common.sh@963 -- # echo 'Process with pid 540760 is not found' 00:29:22.199 Process with pid 540760 is not found 00:29:22.199 14:33:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:22.199 14:33:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:22.199 14:33:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:22.199 14:33:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:22.199 14:33:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:22.199 14:33:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:22.199 14:33:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:22.199 14:33:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:24.098 14:33:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:24.098 00:29:24.098 real 0m40.209s 00:29:24.098 user 1m2.979s 00:29:24.098 sys 0m13.682s 00:29:24.098 14:33:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:24.098 14:33:38 -- common/autotest_common.sh@10 -- # set +x 00:29:24.098 ************************************ 00:29:24.098 END TEST nvmf_digest 00:29:24.098 ************************************ 00:29:24.356 14:33:38 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:29:24.357 14:33:38 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:29:24.357 14:33:38 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:29:24.357 14:33:38 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:24.357 14:33:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:24.357 14:33:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:24.357 14:33:38 -- common/autotest_common.sh@10 -- # set +x 00:29:24.357 ************************************ 00:29:24.357 START TEST nvmf_bdevperf 00:29:24.357 ************************************ 00:29:24.357 14:33:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:29:24.357 * Looking for test storage... 00:29:24.357 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:24.357 14:33:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:24.357 14:33:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:24.357 14:33:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:24.357 14:33:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:24.357 14:33:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:24.357 14:33:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:24.357 14:33:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:24.357 14:33:38 -- scripts/common.sh@335 -- # IFS=.-: 00:29:24.357 14:33:38 -- scripts/common.sh@335 -- # read -ra ver1 00:29:24.357 14:33:38 -- scripts/common.sh@336 -- # IFS=.-: 00:29:24.357 14:33:38 -- scripts/common.sh@336 -- # read -ra ver2 00:29:24.357 14:33:38 -- scripts/common.sh@337 -- # local 'op=<' 00:29:24.357 14:33:38 -- scripts/common.sh@339 -- # ver1_l=2 00:29:24.357 14:33:38 -- scripts/common.sh@340 -- # ver2_l=1 00:29:24.357 14:33:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:24.357 14:33:38 -- scripts/common.sh@343 -- # case "$op" in 00:29:24.357 14:33:38 -- scripts/common.sh@344 -- # : 1 00:29:24.357 14:33:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:24.357 14:33:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:24.357 14:33:38 -- scripts/common.sh@364 -- # decimal 1 00:29:24.357 14:33:38 -- scripts/common.sh@352 -- # local d=1 00:29:24.357 14:33:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:24.357 14:33:38 -- scripts/common.sh@354 -- # echo 1 00:29:24.357 14:33:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:24.357 14:33:38 -- scripts/common.sh@365 -- # decimal 2 00:29:24.357 14:33:38 -- scripts/common.sh@352 -- # local d=2 00:29:24.357 14:33:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:24.357 14:33:38 -- scripts/common.sh@354 -- # echo 2 00:29:24.357 14:33:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:24.357 14:33:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:24.357 14:33:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:24.357 14:33:38 -- scripts/common.sh@367 -- # return 0 00:29:24.357 14:33:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:24.357 14:33:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:24.357 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:24.357 --rc genhtml_branch_coverage=1 00:29:24.357 --rc genhtml_function_coverage=1 00:29:24.357 --rc genhtml_legend=1 00:29:24.357 --rc geninfo_all_blocks=1 00:29:24.357 --rc geninfo_unexecuted_blocks=1 00:29:24.357 00:29:24.357 ' 00:29:24.357 14:33:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:24.357 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:24.357 --rc genhtml_branch_coverage=1 00:29:24.357 --rc genhtml_function_coverage=1 00:29:24.357 --rc genhtml_legend=1 00:29:24.357 --rc geninfo_all_blocks=1 00:29:24.357 --rc geninfo_unexecuted_blocks=1 00:29:24.357 00:29:24.357 ' 00:29:24.357 14:33:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:24.357 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:24.357 --rc genhtml_branch_coverage=1 00:29:24.357 --rc genhtml_function_coverage=1 00:29:24.357 --rc genhtml_legend=1 00:29:24.357 --rc geninfo_all_blocks=1 00:29:24.357 --rc geninfo_unexecuted_blocks=1 00:29:24.357 00:29:24.357 ' 00:29:24.357 14:33:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:24.357 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:24.357 --rc genhtml_branch_coverage=1 00:29:24.357 --rc genhtml_function_coverage=1 00:29:24.357 --rc genhtml_legend=1 00:29:24.357 --rc geninfo_all_blocks=1 00:29:24.357 --rc geninfo_unexecuted_blocks=1 00:29:24.357 00:29:24.357 ' 00:29:24.357 14:33:38 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:24.357 14:33:38 -- nvmf/common.sh@7 -- # uname -s 00:29:24.357 14:33:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:24.357 14:33:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:24.357 14:33:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:24.357 14:33:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:24.357 14:33:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:24.357 14:33:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:24.357 14:33:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:24.357 14:33:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:24.357 14:33:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:24.357 14:33:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:24.357 14:33:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:29:24.357 14:33:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:29:24.357 14:33:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:24.357 14:33:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:24.357 14:33:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:24.357 14:33:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:24.357 14:33:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:24.357 14:33:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:24.357 14:33:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:24.357 14:33:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.357 14:33:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.357 14:33:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.357 14:33:38 -- paths/export.sh@5 -- # export PATH 00:29:24.357 14:33:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:24.357 14:33:38 -- nvmf/common.sh@46 -- # : 0 00:29:24.357 14:33:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:24.357 14:33:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:24.357 14:33:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:24.357 14:33:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:24.357 14:33:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:24.357 14:33:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:24.357 14:33:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:24.357 14:33:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:24.357 14:33:38 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:29:24.357 14:33:38 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:29:24.357 14:33:38 -- host/bdevperf.sh@24 -- # nvmftestinit 00:29:24.357 14:33:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:24.357 14:33:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:24.357 14:33:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:24.357 14:33:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:24.357 14:33:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:24.357 14:33:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:24.357 14:33:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:24.357 14:33:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:24.357 14:33:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:24.357 14:33:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:24.357 14:33:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:24.357 14:33:38 -- common/autotest_common.sh@10 -- # set +x 00:29:29.625 14:33:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:29.625 14:33:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:29.625 14:33:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:29.625 14:33:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:29.625 14:33:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:29.625 14:33:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:29.625 14:33:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:29.625 14:33:44 -- nvmf/common.sh@294 -- # net_devs=() 00:29:29.625 14:33:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:29.625 14:33:44 -- nvmf/common.sh@295 -- # e810=() 00:29:29.625 14:33:44 -- nvmf/common.sh@295 -- # local -ga e810 00:29:29.625 14:33:44 -- nvmf/common.sh@296 -- # x722=() 00:29:29.625 14:33:44 -- nvmf/common.sh@296 -- # local -ga x722 00:29:29.625 14:33:44 -- nvmf/common.sh@297 -- # mlx=() 00:29:29.625 14:33:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:29.625 14:33:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:29.625 14:33:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:29.625 14:33:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:29.625 14:33:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:29.625 14:33:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:29.625 14:33:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:29:29.625 Found 0000:af:00.0 (0x8086 - 0x159b) 00:29:29.625 14:33:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:29.625 14:33:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:29:29.625 Found 0000:af:00.1 (0x8086 - 0x159b) 00:29:29.625 14:33:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:29.625 14:33:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:29.625 14:33:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:29.625 14:33:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:29.625 14:33:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:29.625 14:33:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:29:29.625 Found net devices under 0000:af:00.0: cvl_0_0 00:29:29.625 14:33:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:29.625 14:33:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:29.625 14:33:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:29.625 14:33:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:29.625 14:33:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:29.625 14:33:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:29:29.625 Found net devices under 0000:af:00.1: cvl_0_1 00:29:29.625 14:33:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:29.625 14:33:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:29.625 14:33:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:29.625 14:33:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:29.625 14:33:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:29.625 14:33:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:29.625 14:33:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:29.625 14:33:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:29.625 14:33:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:29.625 14:33:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:29.625 14:33:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:29.625 14:33:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:29.625 14:33:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:29.625 14:33:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:29.625 14:33:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:29.625 14:33:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:29.625 14:33:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:29.625 14:33:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:29.625 14:33:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:29.625 14:33:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:29.625 14:33:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:29.625 14:33:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:29.884 14:33:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:29.884 14:33:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:29.884 14:33:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:29.884 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:29.884 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.292 ms 00:29:29.884 00:29:29.884 --- 10.0.0.2 ping statistics --- 00:29:29.884 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:29.884 rtt min/avg/max/mdev = 0.292/0.292/0.292/0.000 ms 00:29:29.884 14:33:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:29.884 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:29.884 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:29:29.884 00:29:29.884 --- 10.0.0.1 ping statistics --- 00:29:29.884 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:29.884 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:29:29.884 14:33:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:29.884 14:33:44 -- nvmf/common.sh@410 -- # return 0 00:29:29.884 14:33:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:29.884 14:33:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:29.884 14:33:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:29.884 14:33:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:29.884 14:33:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:29.884 14:33:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:29.884 14:33:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:29.884 14:33:44 -- host/bdevperf.sh@25 -- # tgt_init 00:29:29.884 14:33:44 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:29.884 14:33:44 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:29.884 14:33:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:29.884 14:33:44 -- common/autotest_common.sh@10 -- # set +x 00:29:29.884 14:33:44 -- nvmf/common.sh@469 -- # nvmfpid=547029 00:29:29.884 14:33:44 -- nvmf/common.sh@470 -- # waitforlisten 547029 00:29:29.884 14:33:44 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:29.884 14:33:44 -- common/autotest_common.sh@829 -- # '[' -z 547029 ']' 00:29:29.884 14:33:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:29.884 14:33:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:29.884 14:33:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:29.884 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:29.884 14:33:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:29.884 14:33:44 -- common/autotest_common.sh@10 -- # set +x 00:29:29.884 [2024-12-16 14:33:44.379940] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:29.884 [2024-12-16 14:33:44.379986] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:29.884 EAL: No free 2048 kB hugepages reported on node 1 00:29:29.884 [2024-12-16 14:33:44.440888] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:30.143 [2024-12-16 14:33:44.515368] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:30.143 [2024-12-16 14:33:44.515480] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:30.143 [2024-12-16 14:33:44.515488] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:30.143 [2024-12-16 14:33:44.515495] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:30.143 [2024-12-16 14:33:44.515593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:30.143 [2024-12-16 14:33:44.515613] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:30.143 [2024-12-16 14:33:44.515618] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:30.711 14:33:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:30.711 14:33:45 -- common/autotest_common.sh@862 -- # return 0 00:29:30.711 14:33:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:30.711 14:33:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:30.711 14:33:45 -- common/autotest_common.sh@10 -- # set +x 00:29:30.711 14:33:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:30.711 14:33:45 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:30.711 14:33:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.711 14:33:45 -- common/autotest_common.sh@10 -- # set +x 00:29:30.711 [2024-12-16 14:33:45.230301] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:30.711 14:33:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.711 14:33:45 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:30.711 14:33:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.711 14:33:45 -- common/autotest_common.sh@10 -- # set +x 00:29:30.711 Malloc0 00:29:30.711 14:33:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.711 14:33:45 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:30.711 14:33:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.711 14:33:45 -- common/autotest_common.sh@10 -- # set +x 00:29:30.970 14:33:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.970 14:33:45 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:30.970 14:33:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.970 14:33:45 -- common/autotest_common.sh@10 -- # set +x 00:29:30.970 14:33:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.970 14:33:45 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:30.970 14:33:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:30.970 14:33:45 -- common/autotest_common.sh@10 -- # set +x 00:29:30.970 [2024-12-16 14:33:45.304887] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:30.970 14:33:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:30.970 14:33:45 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:29:30.970 14:33:45 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:29:30.970 14:33:45 -- nvmf/common.sh@520 -- # config=() 00:29:30.970 14:33:45 -- nvmf/common.sh@520 -- # local subsystem config 00:29:30.970 14:33:45 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:30.970 14:33:45 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:30.970 { 00:29:30.970 "params": { 00:29:30.970 "name": "Nvme$subsystem", 00:29:30.970 "trtype": "$TEST_TRANSPORT", 00:29:30.970 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:30.970 "adrfam": "ipv4", 00:29:30.970 "trsvcid": "$NVMF_PORT", 00:29:30.970 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:30.970 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:30.970 "hdgst": ${hdgst:-false}, 00:29:30.970 "ddgst": ${ddgst:-false} 00:29:30.970 }, 00:29:30.970 "method": "bdev_nvme_attach_controller" 00:29:30.970 } 00:29:30.970 EOF 00:29:30.970 )") 00:29:30.970 14:33:45 -- nvmf/common.sh@542 -- # cat 00:29:30.970 14:33:45 -- nvmf/common.sh@544 -- # jq . 00:29:30.970 14:33:45 -- nvmf/common.sh@545 -- # IFS=, 00:29:30.970 14:33:45 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:30.970 "params": { 00:29:30.970 "name": "Nvme1", 00:29:30.970 "trtype": "tcp", 00:29:30.970 "traddr": "10.0.0.2", 00:29:30.970 "adrfam": "ipv4", 00:29:30.970 "trsvcid": "4420", 00:29:30.970 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:30.970 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:30.970 "hdgst": false, 00:29:30.970 "ddgst": false 00:29:30.970 }, 00:29:30.970 "method": "bdev_nvme_attach_controller" 00:29:30.970 }' 00:29:30.970 [2024-12-16 14:33:45.350046] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:30.970 [2024-12-16 14:33:45.350086] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid547079 ] 00:29:30.970 EAL: No free 2048 kB hugepages reported on node 1 00:29:30.970 [2024-12-16 14:33:45.406584] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:30.970 [2024-12-16 14:33:45.476397] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:31.228 Running I/O for 1 seconds... 00:29:32.605 00:29:32.605 Latency(us) 00:29:32.605 [2024-12-16T13:33:47.179Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:32.605 [2024-12-16T13:33:47.179Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:32.605 Verification LBA range: start 0x0 length 0x4000 00:29:32.605 Nvme1n1 : 1.00 17584.00 68.69 0.00 0.00 7251.05 975.24 12919.95 00:29:32.605 [2024-12-16T13:33:47.179Z] =================================================================================================================== 00:29:32.605 [2024-12-16T13:33:47.179Z] Total : 17584.00 68.69 0.00 0.00 7251.05 975.24 12919.95 00:29:32.605 14:33:47 -- host/bdevperf.sh@30 -- # bdevperfpid=547423 00:29:32.605 14:33:47 -- host/bdevperf.sh@32 -- # sleep 3 00:29:32.605 14:33:47 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:29:32.605 14:33:47 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:29:32.605 14:33:47 -- nvmf/common.sh@520 -- # config=() 00:29:32.605 14:33:47 -- nvmf/common.sh@520 -- # local subsystem config 00:29:32.605 14:33:47 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:29:32.605 14:33:47 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:29:32.605 { 00:29:32.605 "params": { 00:29:32.605 "name": "Nvme$subsystem", 00:29:32.605 "trtype": "$TEST_TRANSPORT", 00:29:32.605 "traddr": "$NVMF_FIRST_TARGET_IP", 00:29:32.605 "adrfam": "ipv4", 00:29:32.605 "trsvcid": "$NVMF_PORT", 00:29:32.605 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:29:32.605 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:29:32.605 "hdgst": ${hdgst:-false}, 00:29:32.605 "ddgst": ${ddgst:-false} 00:29:32.605 }, 00:29:32.605 "method": "bdev_nvme_attach_controller" 00:29:32.605 } 00:29:32.605 EOF 00:29:32.605 )") 00:29:32.605 14:33:47 -- nvmf/common.sh@542 -- # cat 00:29:32.605 14:33:47 -- nvmf/common.sh@544 -- # jq . 00:29:32.605 14:33:47 -- nvmf/common.sh@545 -- # IFS=, 00:29:32.605 14:33:47 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:29:32.605 "params": { 00:29:32.605 "name": "Nvme1", 00:29:32.605 "trtype": "tcp", 00:29:32.605 "traddr": "10.0.0.2", 00:29:32.605 "adrfam": "ipv4", 00:29:32.605 "trsvcid": "4420", 00:29:32.605 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:29:32.605 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:29:32.605 "hdgst": false, 00:29:32.605 "ddgst": false 00:29:32.605 }, 00:29:32.605 "method": "bdev_nvme_attach_controller" 00:29:32.605 }' 00:29:32.605 [2024-12-16 14:33:47.044263] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:32.605 [2024-12-16 14:33:47.044313] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid547423 ] 00:29:32.605 EAL: No free 2048 kB hugepages reported on node 1 00:29:32.605 [2024-12-16 14:33:47.099072] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:32.605 [2024-12-16 14:33:47.168457] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:32.864 Running I/O for 15 seconds... 00:29:36.159 14:33:50 -- host/bdevperf.sh@33 -- # kill -9 547029 00:29:36.159 14:33:50 -- host/bdevperf.sh@35 -- # sleep 3 00:29:36.159 [2024-12-16 14:33:50.025150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:105280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025218] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:105288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:105296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:105304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025289] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:105368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:105376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:104832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:104840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:104912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025406] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:104920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:104928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:104944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:104952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:105016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:105392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:105400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025560] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:105416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:105424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:105440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:105448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:105480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:105488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.159 [2024-12-16 14:33:50.025678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.159 [2024-12-16 14:33:50.025690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:105496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.159 [2024-12-16 14:33:50.025699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:105504 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.025722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:105512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:105520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025766] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:105528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025774] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025783] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:105536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.025793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:105544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:95 nsid:1 lba:105552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.025828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:105560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:105568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:105576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025897] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:105584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.025908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:105592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.025929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:105024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025958] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:105048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.025982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.025993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:105056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:105064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026035] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:105088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:105104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:105120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:105128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:105600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.026126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:105608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:105616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026177] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:105624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.026206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:105632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.026231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:105640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.026261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026275] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:105648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:105656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:105664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:105672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:105 nsid:1 lba:105680 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.026393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026407] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:105688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:105696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:105704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.026457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:105712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:105720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:105728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:105736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.160 [2024-12-16 14:33:50.026530] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:105744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:105752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.160 [2024-12-16 14:33:50.026565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.160 [2024-12-16 14:33:50.026574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:105760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:105768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.026600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:105776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:75 nsid:1 lba:105784 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.026636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026646] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:105136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:105160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:105168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:105184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:105208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:105216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:105232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:105248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026788] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:105792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.026797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:105800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:105808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.026832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:105816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.026849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:105824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.026873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:105832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:105840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026918] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:105848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.026931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:105856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026960] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:105864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:105872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.026984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.026994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:105880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027012] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:105888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:105896 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.027036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:105904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:105912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.027071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:105920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.027088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:105928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:105936 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.027124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:105944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027154] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:105952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027172] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:105960 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.161 [2024-12-16 14:33:50.027179] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:105256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027197] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:105264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027225] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:105272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:105312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.161 [2024-12-16 14:33:50.027260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:105320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.161 [2024-12-16 14:33:50.027268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:105328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:105336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027302] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:105344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:105968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:105976 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.162 [2024-12-16 14:33:50.027353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:105984 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.162 [2024-12-16 14:33:50.027373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:105992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027391] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:106000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.162 [2024-12-16 14:33:50.027407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:106008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.162 [2024-12-16 14:33:50.027425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:106016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:106024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:106032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.162 [2024-12-16 14:33:50.027482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:106040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027500] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027509] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:106048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:106056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:106064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:106072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:106080 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:36.162 [2024-12-16 14:33:50.027588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027602] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:105352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:105360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:105384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:105408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027665] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:105432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027693] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:105456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:105464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:36.162 [2024-12-16 14:33:50.027717] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x12b97c0 is same with the state(5) to be set 00:29:36.162 [2024-12-16 14:33:50.027737] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:29:36.162 [2024-12-16 14:33:50.027744] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:29:36.162 [2024-12-16 14:33:50.027753] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:105472 len:8 PRP1 0x0 PRP2 0x0 00:29:36.162 [2024-12-16 14:33:50.027760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:36.162 [2024-12-16 14:33:50.027806] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x12b97c0 was disconnected and freed. reset controller. 00:29:36.162 [2024-12-16 14:33:50.029980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.162 [2024-12-16 14:33:50.030041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.162 [2024-12-16 14:33:50.030456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.162 [2024-12-16 14:33:50.030689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.162 [2024-12-16 14:33:50.030699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.162 [2024-12-16 14:33:50.030708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.162 [2024-12-16 14:33:50.030837] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.162 [2024-12-16 14:33:50.030959] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.162 [2024-12-16 14:33:50.030972] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.162 [2024-12-16 14:33:50.030980] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.162 [2024-12-16 14:33:50.032696] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.162 [2024-12-16 14:33:50.042005] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.162 [2024-12-16 14:33:50.042386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.162 [2024-12-16 14:33:50.042578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.162 [2024-12-16 14:33:50.042590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.162 [2024-12-16 14:33:50.042598] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.162 [2024-12-16 14:33:50.042730] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.162 [2024-12-16 14:33:50.042893] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.162 [2024-12-16 14:33:50.042903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.162 [2024-12-16 14:33:50.042910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.162 [2024-12-16 14:33:50.044641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.162 [2024-12-16 14:33:50.053994] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.162 [2024-12-16 14:33:50.054284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.162 [2024-12-16 14:33:50.054444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.162 [2024-12-16 14:33:50.054456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.162 [2024-12-16 14:33:50.054464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.162 [2024-12-16 14:33:50.054579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.163 [2024-12-16 14:33:50.054708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.163 [2024-12-16 14:33:50.054718] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.163 [2024-12-16 14:33:50.054725] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.163 [2024-12-16 14:33:50.056380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.163 [2024-12-16 14:33:50.066077] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.163 [2024-12-16 14:33:50.066455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.066698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.066710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.163 [2024-12-16 14:33:50.066718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.163 [2024-12-16 14:33:50.066819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.163 [2024-12-16 14:33:50.066956] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.163 [2024-12-16 14:33:50.066968] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.163 [2024-12-16 14:33:50.066979] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.163 [2024-12-16 14:33:50.068742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.163 [2024-12-16 14:33:50.078051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.163 [2024-12-16 14:33:50.078418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.078616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.078628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.163 [2024-12-16 14:33:50.078636] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.163 [2024-12-16 14:33:50.078748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.163 [2024-12-16 14:33:50.078895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.163 [2024-12-16 14:33:50.078906] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.163 [2024-12-16 14:33:50.078913] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.163 [2024-12-16 14:33:50.080681] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.163 [2024-12-16 14:33:50.089934] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.163 [2024-12-16 14:33:50.090289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.090481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.090494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.163 [2024-12-16 14:33:50.090502] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.163 [2024-12-16 14:33:50.090628] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.163 [2024-12-16 14:33:50.090767] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.163 [2024-12-16 14:33:50.090776] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.163 [2024-12-16 14:33:50.090783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.163 [2024-12-16 14:33:50.092445] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.163 [2024-12-16 14:33:50.101919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.163 [2024-12-16 14:33:50.102278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.102508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.102521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.163 [2024-12-16 14:33:50.102529] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.163 [2024-12-16 14:33:50.102644] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.163 [2024-12-16 14:33:50.102758] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.163 [2024-12-16 14:33:50.102768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.163 [2024-12-16 14:33:50.102775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.163 [2024-12-16 14:33:50.104628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.163 [2024-12-16 14:33:50.113621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.163 [2024-12-16 14:33:50.114014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.114155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.114167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.163 [2024-12-16 14:33:50.114174] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.163 [2024-12-16 14:33:50.114291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.163 [2024-12-16 14:33:50.114405] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.163 [2024-12-16 14:33:50.114415] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.163 [2024-12-16 14:33:50.114422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.163 [2024-12-16 14:33:50.116267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.163 [2024-12-16 14:33:50.125515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.163 [2024-12-16 14:33:50.125861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.126092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.126103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.163 [2024-12-16 14:33:50.126110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.163 [2024-12-16 14:33:50.126203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.163 [2024-12-16 14:33:50.126313] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.163 [2024-12-16 14:33:50.126321] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.163 [2024-12-16 14:33:50.126327] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.163 [2024-12-16 14:33:50.128052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.163 [2024-12-16 14:33:50.137418] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.163 [2024-12-16 14:33:50.137729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.138004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.163 [2024-12-16 14:33:50.138039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.163 [2024-12-16 14:33:50.138062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.163 [2024-12-16 14:33:50.138395] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.163 [2024-12-16 14:33:50.138833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.163 [2024-12-16 14:33:50.138843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.163 [2024-12-16 14:33:50.138849] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.163 [2024-12-16 14:33:50.140463] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.163 [2024-12-16 14:33:50.149239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.163 [2024-12-16 14:33:50.149582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.149816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.149849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.149891] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.150276] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.150659] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.150685] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.150707] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.152607] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.161133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.161461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.161630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.161662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.161686] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.162085] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.162211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.162218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.162225] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.163915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.173107] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.173481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.173761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.173805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.173812] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.173939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.174046] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.174056] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.174062] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.175761] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.185059] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.185452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.185602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.185613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.185620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.185713] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.185805] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.185813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.185819] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.187510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.196877] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.197223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.197451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.197463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.197470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.197614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.197714] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.197724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.197731] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.199512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.208704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.209038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.209247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.209259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.209267] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.209363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.209474] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.209482] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.209489] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.211115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.220547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.220903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.221194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.221236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.221261] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.221692] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.221943] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.221954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.221960] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.223643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.232319] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.232704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.232876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.232890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.232898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.233012] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.233124] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.233136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.233143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.234852] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.244395] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.244738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.244979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.245016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.245040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.164 [2024-12-16 14:33:50.245415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.164 [2024-12-16 14:33:50.245514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.164 [2024-12-16 14:33:50.245523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.164 [2024-12-16 14:33:50.245530] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.164 [2024-12-16 14:33:50.247096] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.164 [2024-12-16 14:33:50.256260] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.164 [2024-12-16 14:33:50.256636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.256893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.164 [2024-12-16 14:33:50.256929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.164 [2024-12-16 14:33:50.256961] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.257346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.257583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.257593] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.257600] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.259357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.268243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.268564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.268797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.268830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.165 [2024-12-16 14:33:50.268866] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.269295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.269436] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.269446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.269452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.271197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.280178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.280533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.280769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.280781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.165 [2024-12-16 14:33:50.280789] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.280883] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.281028] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.281043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.281050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.282719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.292130] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.292472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.292632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.292644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.165 [2024-12-16 14:33:50.292653] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.292756] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.292878] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.292887] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.292895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.294756] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.303938] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.304307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.304513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.304525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.165 [2024-12-16 14:33:50.304533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.304678] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.304806] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.304816] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.304823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.306397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.315917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.316292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.316543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.316575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.165 [2024-12-16 14:33:50.316599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.317045] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.317219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.317229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.317236] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.318874] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.327899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.328310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.328568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.328602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.165 [2024-12-16 14:33:50.328625] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.329021] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.329315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.329340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.329362] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.331244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.339627] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.340017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.340250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.340283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.165 [2024-12-16 14:33:50.340307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.340539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.340823] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.340850] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.340889] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.342981] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.351522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.351892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.352163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.352197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.165 [2024-12-16 14:33:50.352221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.165 [2024-12-16 14:33:50.352559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.165 [2024-12-16 14:33:50.352625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.165 [2024-12-16 14:33:50.352633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.165 [2024-12-16 14:33:50.352639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.165 [2024-12-16 14:33:50.354569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.165 [2024-12-16 14:33:50.363461] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.165 [2024-12-16 14:33:50.363863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.364094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.165 [2024-12-16 14:33:50.364127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.364150] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.364582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.364682] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.364696] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.364703] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.366476] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.375446] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.375817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.376116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.376149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.376173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.376486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.376602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.376612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.376619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.378318] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.387389] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.387778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.388097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.388133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.388157] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.388424] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.388508] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.388518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.388524] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.390249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.399223] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.399542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.399628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.399638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.399645] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.399777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.399890] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.399899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.399910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.401618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.411246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.411628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.411839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.411889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.411913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.412294] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.412553] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.412563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.412569] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.414253] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.423035] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.423429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.423585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.423597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.423604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.423731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.423828] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.423837] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.423844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.425469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.435099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.435355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.435521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.435533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.435540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.435652] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.435763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.435773] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.435780] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.437371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.447065] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.447439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.447645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.447678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.447702] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.448057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.448441] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.448469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.448493] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.450540] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.459012] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.459294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.459429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.459461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.459485] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.459877] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.166 [2024-12-16 14:33:50.459991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.166 [2024-12-16 14:33:50.460000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.166 [2024-12-16 14:33:50.460007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.166 [2024-12-16 14:33:50.461626] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.166 [2024-12-16 14:33:50.470998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.166 [2024-12-16 14:33:50.471327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.471491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.166 [2024-12-16 14:33:50.471522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.166 [2024-12-16 14:33:50.471545] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.166 [2024-12-16 14:33:50.471826] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.472064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.472075] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.472082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.473648] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.482932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.483317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.483521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.483533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.483541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.483624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.483735] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.483744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.483750] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.485455] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.494818] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.495099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.495330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.495362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.495386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.495716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.495900] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.495911] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.495917] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.497782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.506655] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.506904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.507091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.507123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.507147] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.507578] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.507756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.507765] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.507771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.509600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.518529] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.518900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.519060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.519093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.519115] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.519450] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.519741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.519751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.519758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.521636] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.530312] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.530698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.530867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.530880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.530887] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.531017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.531146] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.531156] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.531163] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.532896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.542225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.542561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.542693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.542705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.542714] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.542799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.542919] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.542928] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.542934] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.544591] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.554011] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.554386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.554618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.554657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.554680] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.555025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.555136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.555147] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.555153] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.556906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.566087] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.566438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.566679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.566711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.566734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.567132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.567367] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.167 [2024-12-16 14:33:50.567392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.167 [2024-12-16 14:33:50.567413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.167 [2024-12-16 14:33:50.569675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.167 [2024-12-16 14:33:50.578108] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.167 [2024-12-16 14:33:50.578513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.578705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.167 [2024-12-16 14:33:50.578716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.167 [2024-12-16 14:33:50.578723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.167 [2024-12-16 14:33:50.578829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.167 [2024-12-16 14:33:50.578990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.168 [2024-12-16 14:33:50.579001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.168 [2024-12-16 14:33:50.579007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.168 [2024-12-16 14:33:50.580644] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.168 [2024-12-16 14:33:50.589852] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.168 [2024-12-16 14:33:50.590277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.590517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.590549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.168 [2024-12-16 14:33:50.590580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.168 [2024-12-16 14:33:50.590977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.168 [2024-12-16 14:33:50.591191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.168 [2024-12-16 14:33:50.591200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.168 [2024-12-16 14:33:50.591207] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.168 [2024-12-16 14:33:50.592900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.168 [2024-12-16 14:33:50.601911] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.168 [2024-12-16 14:33:50.602176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.602379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.602390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.168 [2024-12-16 14:33:50.602398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.168 [2024-12-16 14:33:50.602524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.168 [2024-12-16 14:33:50.602635] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.168 [2024-12-16 14:33:50.602645] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.168 [2024-12-16 14:33:50.602652] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.168 [2024-12-16 14:33:50.604352] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.168 [2024-12-16 14:33:50.613728] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.168 [2024-12-16 14:33:50.614074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.614286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.614319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.168 [2024-12-16 14:33:50.614342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.168 [2024-12-16 14:33:50.614772] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.168 [2024-12-16 14:33:50.615042] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.168 [2024-12-16 14:33:50.615053] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.168 [2024-12-16 14:33:50.615059] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.168 [2024-12-16 14:33:50.617813] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.168 [2024-12-16 14:33:50.626519] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.168 [2024-12-16 14:33:50.626863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.627021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.627033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.168 [2024-12-16 14:33:50.627041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.168 [2024-12-16 14:33:50.627167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.168 [2024-12-16 14:33:50.627288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.168 [2024-12-16 14:33:50.627299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.168 [2024-12-16 14:33:50.627306] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.168 [2024-12-16 14:33:50.628915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.168 [2024-12-16 14:33:50.638457] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.168 [2024-12-16 14:33:50.638738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.638972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.638985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.168 [2024-12-16 14:33:50.638992] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.168 [2024-12-16 14:33:50.639119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.168 [2024-12-16 14:33:50.639216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.168 [2024-12-16 14:33:50.639225] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.168 [2024-12-16 14:33:50.639231] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.168 [2024-12-16 14:33:50.640973] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.168 [2024-12-16 14:33:50.650541] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.168 [2024-12-16 14:33:50.650922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.651104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.651116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.168 [2024-12-16 14:33:50.651123] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.168 [2024-12-16 14:33:50.651236] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.168 [2024-12-16 14:33:50.651318] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.168 [2024-12-16 14:33:50.651326] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.168 [2024-12-16 14:33:50.651333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.168 [2024-12-16 14:33:50.652960] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.168 [2024-12-16 14:33:50.662392] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.168 [2024-12-16 14:33:50.662736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.663013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.168 [2024-12-16 14:33:50.663047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.168 [2024-12-16 14:33:50.663071] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.168 [2024-12-16 14:33:50.663289] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.168 [2024-12-16 14:33:50.663419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.168 [2024-12-16 14:33:50.663429] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.168 [2024-12-16 14:33:50.663435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.168 [2024-12-16 14:33:50.665087] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.168 [2024-12-16 14:33:50.674217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.169 [2024-12-16 14:33:50.674532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.674691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.674702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.169 [2024-12-16 14:33:50.674710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.169 [2024-12-16 14:33:50.674850] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.169 [2024-12-16 14:33:50.674982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.169 [2024-12-16 14:33:50.674992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.169 [2024-12-16 14:33:50.674998] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.169 [2024-12-16 14:33:50.676653] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.169 [2024-12-16 14:33:50.686157] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.169 [2024-12-16 14:33:50.686566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.686796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.686828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.169 [2024-12-16 14:33:50.686852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.169 [2024-12-16 14:33:50.687299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.169 [2024-12-16 14:33:50.687411] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.169 [2024-12-16 14:33:50.687420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.169 [2024-12-16 14:33:50.687427] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.169 [2024-12-16 14:33:50.689191] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.169 [2024-12-16 14:33:50.698183] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.169 [2024-12-16 14:33:50.698472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.698704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.698736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.169 [2024-12-16 14:33:50.698760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.169 [2024-12-16 14:33:50.699057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.169 [2024-12-16 14:33:50.699327] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.169 [2024-12-16 14:33:50.699340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.169 [2024-12-16 14:33:50.699347] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.169 [2024-12-16 14:33:50.701080] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.169 [2024-12-16 14:33:50.710050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.169 [2024-12-16 14:33:50.710409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.710546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.710558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.169 [2024-12-16 14:33:50.710566] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.169 [2024-12-16 14:33:50.710681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.169 [2024-12-16 14:33:50.710796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.169 [2024-12-16 14:33:50.710806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.169 [2024-12-16 14:33:50.710812] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.169 [2024-12-16 14:33:50.712680] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.169 [2024-12-16 14:33:50.722050] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.169 [2024-12-16 14:33:50.722417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.722618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.169 [2024-12-16 14:33:50.722630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.169 [2024-12-16 14:33:50.722638] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.169 [2024-12-16 14:33:50.722753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.169 [2024-12-16 14:33:50.722875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.169 [2024-12-16 14:33:50.722884] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.169 [2024-12-16 14:33:50.722890] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.169 [2024-12-16 14:33:50.724544] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.430 [2024-12-16 14:33:50.733947] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.430 [2024-12-16 14:33:50.734288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.734525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.734558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.430 [2024-12-16 14:33:50.734581] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.430 [2024-12-16 14:33:50.734976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.430 [2024-12-16 14:33:50.735462] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.430 [2024-12-16 14:33:50.735487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.430 [2024-12-16 14:33:50.735515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.430 [2024-12-16 14:33:50.737262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.430 [2024-12-16 14:33:50.745830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.430 [2024-12-16 14:33:50.746165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.746314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.746326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.430 [2024-12-16 14:33:50.746333] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.430 [2024-12-16 14:33:50.746435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.430 [2024-12-16 14:33:50.746550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.430 [2024-12-16 14:33:50.746560] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.430 [2024-12-16 14:33:50.746566] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.430 [2024-12-16 14:33:50.748329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.430 [2024-12-16 14:33:50.757716] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.430 [2024-12-16 14:33:50.758088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.758303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.758335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.430 [2024-12-16 14:33:50.758358] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.430 [2024-12-16 14:33:50.758839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.430 [2024-12-16 14:33:50.759387] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.430 [2024-12-16 14:33:50.759413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.430 [2024-12-16 14:33:50.759435] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.430 [2024-12-16 14:33:50.761165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.430 [2024-12-16 14:33:50.769536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.430 [2024-12-16 14:33:50.769808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.770043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.770056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.430 [2024-12-16 14:33:50.770063] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.430 [2024-12-16 14:33:50.770190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.430 [2024-12-16 14:33:50.770316] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.430 [2024-12-16 14:33:50.770325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.430 [2024-12-16 14:33:50.770332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.430 [2024-12-16 14:33:50.772115] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.430 [2024-12-16 14:33:50.781517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.430 [2024-12-16 14:33:50.781845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.782000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.782013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.430 [2024-12-16 14:33:50.782021] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.430 [2024-12-16 14:33:50.782122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.430 [2024-12-16 14:33:50.782208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.430 [2024-12-16 14:33:50.782216] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.430 [2024-12-16 14:33:50.782224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.430 [2024-12-16 14:33:50.783823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.430 [2024-12-16 14:33:50.793499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.430 [2024-12-16 14:33:50.793806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.793970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.793982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.430 [2024-12-16 14:33:50.793990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.430 [2024-12-16 14:33:50.794137] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.430 [2024-12-16 14:33:50.794237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.430 [2024-12-16 14:33:50.794246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.430 [2024-12-16 14:33:50.794254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.430 [2024-12-16 14:33:50.795850] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.430 [2024-12-16 14:33:50.805442] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.430 [2024-12-16 14:33:50.805789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.806081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.806115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.430 [2024-12-16 14:33:50.806139] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.430 [2024-12-16 14:33:50.806382] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.430 [2024-12-16 14:33:50.806483] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.430 [2024-12-16 14:33:50.806493] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.430 [2024-12-16 14:33:50.806500] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.430 [2024-12-16 14:33:50.808174] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.430 [2024-12-16 14:33:50.817429] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.430 [2024-12-16 14:33:50.817770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.817906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.430 [2024-12-16 14:33:50.817919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.817927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.818043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.818129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.818137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.818145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.819817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.829460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.829681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.829910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.829922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.829931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.830078] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.830183] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.830193] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.830199] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.832036] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.841363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.841758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.841920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.841956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.841981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.842462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.842796] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.842822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.842843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.844655] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.853374] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.853640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.853820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.853868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.853896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.854379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.854613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.854622] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.854629] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.856288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.865436] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.865738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.865978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.866013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.866037] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.866421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.866803] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.866829] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.866851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.868520] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.877306] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.877706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.877886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.877899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.877907] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.878034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.878130] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.878140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.878147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.879873] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.889209] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.889590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.889847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.889905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.889930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.890123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.890249] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.890259] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.890266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.891896] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.901053] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.901369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.901601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.901633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.901657] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.902054] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.902489] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.902515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.902537] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.904567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.912959] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.913293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.913452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.913464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.431 [2024-12-16 14:33:50.913472] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.431 [2024-12-16 14:33:50.913552] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.431 [2024-12-16 14:33:50.913649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.431 [2024-12-16 14:33:50.913658] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.431 [2024-12-16 14:33:50.913664] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.431 [2024-12-16 14:33:50.915365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.431 [2024-12-16 14:33:50.924939] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.431 [2024-12-16 14:33:50.925214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.925371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.431 [2024-12-16 14:33:50.925403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.432 [2024-12-16 14:33:50.925440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.432 [2024-12-16 14:33:50.925822] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.432 [2024-12-16 14:33:50.925992] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.432 [2024-12-16 14:33:50.926002] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.432 [2024-12-16 14:33:50.926009] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.432 [2024-12-16 14:33:50.927802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.432 [2024-12-16 14:33:50.936802] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.432 [2024-12-16 14:33:50.937168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.937324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.937335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.432 [2024-12-16 14:33:50.937343] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.432 [2024-12-16 14:33:50.937454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.432 [2024-12-16 14:33:50.937566] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.432 [2024-12-16 14:33:50.937576] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.432 [2024-12-16 14:33:50.937582] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.432 [2024-12-16 14:33:50.939276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.432 [2024-12-16 14:33:50.948698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.432 [2024-12-16 14:33:50.949099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.949385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.949418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.432 [2024-12-16 14:33:50.949442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.432 [2024-12-16 14:33:50.949743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.432 [2024-12-16 14:33:50.949861] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.432 [2024-12-16 14:33:50.949872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.432 [2024-12-16 14:33:50.949879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.432 [2024-12-16 14:33:50.951770] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.432 [2024-12-16 14:33:50.960572] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.432 [2024-12-16 14:33:50.960909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.961077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.961111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.432 [2024-12-16 14:33:50.961135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.432 [2024-12-16 14:33:50.961525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.432 [2024-12-16 14:33:50.961771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.432 [2024-12-16 14:33:50.961781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.432 [2024-12-16 14:33:50.961787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.432 [2024-12-16 14:33:50.963582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.432 [2024-12-16 14:33:50.972397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.432 [2024-12-16 14:33:50.972734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.972907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.972920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.432 [2024-12-16 14:33:50.972927] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.432 [2024-12-16 14:33:50.973020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.432 [2024-12-16 14:33:50.973152] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.432 [2024-12-16 14:33:50.973162] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.432 [2024-12-16 14:33:50.973168] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.432 [2024-12-16 14:33:50.974821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.432 [2024-12-16 14:33:50.984330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.432 [2024-12-16 14:33:50.984670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.984893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.984938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.432 [2024-12-16 14:33:50.984963] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.432 [2024-12-16 14:33:50.985346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.432 [2024-12-16 14:33:50.985729] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.432 [2024-12-16 14:33:50.985754] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.432 [2024-12-16 14:33:50.985775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.432 [2024-12-16 14:33:50.987632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.432 [2024-12-16 14:33:50.996161] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.432 [2024-12-16 14:33:50.996547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.996772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.432 [2024-12-16 14:33:50.996784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.432 [2024-12-16 14:33:50.996792] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.432 [2024-12-16 14:33:50.996898] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.432 [2024-12-16 14:33:50.997016] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.432 [2024-12-16 14:33:50.997025] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.432 [2024-12-16 14:33:50.997032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.432 [2024-12-16 14:33:50.998747] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.692 [2024-12-16 14:33:51.008058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.692 [2024-12-16 14:33:51.008425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.692 [2024-12-16 14:33:51.008586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.692 [2024-12-16 14:33:51.008599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.692 [2024-12-16 14:33:51.008606] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.692 [2024-12-16 14:33:51.008722] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.692 [2024-12-16 14:33:51.008822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.692 [2024-12-16 14:33:51.008832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.692 [2024-12-16 14:33:51.008838] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.692 [2024-12-16 14:33:51.010646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.692 [2024-12-16 14:33:51.020079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.692 [2024-12-16 14:33:51.020388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.692 [2024-12-16 14:33:51.020592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.692 [2024-12-16 14:33:51.020604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.692 [2024-12-16 14:33:51.020612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.692 [2024-12-16 14:33:51.020723] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.692 [2024-12-16 14:33:51.020835] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.692 [2024-12-16 14:33:51.020845] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.692 [2024-12-16 14:33:51.020852] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.692 [2024-12-16 14:33:51.022675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.692 [2024-12-16 14:33:51.032040] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.692 [2024-12-16 14:33:51.032397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.692 [2024-12-16 14:33:51.032553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.692 [2024-12-16 14:33:51.032564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.692 [2024-12-16 14:33:51.032571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.692 [2024-12-16 14:33:51.032710] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.692 [2024-12-16 14:33:51.032822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.692 [2024-12-16 14:33:51.032833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.692 [2024-12-16 14:33:51.032840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.692 [2024-12-16 14:33:51.034353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.692 [2024-12-16 14:33:51.043874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.692 [2024-12-16 14:33:51.044301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.692 [2024-12-16 14:33:51.044454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.692 [2024-12-16 14:33:51.044467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.692 [2024-12-16 14:33:51.044474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.692 [2024-12-16 14:33:51.044603] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.692 [2024-12-16 14:33:51.044732] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.044742] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.044749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.046485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.055644] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.055979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.056133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.056169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.056193] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.056425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.056808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.056834] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.056870] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.058661] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.067529] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.067879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.068044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.068059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.068067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.068156] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.068256] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.068264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.068274] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.070203] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.079379] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.079689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.080532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.080557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.080565] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.080667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.080733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.080741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.080749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.082355] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.091007] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.091283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.091497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.091531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.091554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.091977] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.092097] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.092107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.092113] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.093811] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.102804] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.103049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.103259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.103292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.103315] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.103590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.103683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.103693] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.103699] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.105296] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.114416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.114681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.114788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.114799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.114806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.114958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.115079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.115088] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.115094] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.116714] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.126329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.126599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.126709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.126721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.126728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.126820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.126978] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.126988] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.126995] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.128711] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.138295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.138548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.138641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.138651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.138659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.138743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.138863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.138872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.138880] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.140666] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.150514] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.150886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.151047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.151060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.693 [2024-12-16 14:33:51.151069] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.693 [2024-12-16 14:33:51.151200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.693 [2024-12-16 14:33:51.151312] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.693 [2024-12-16 14:33:51.151323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.693 [2024-12-16 14:33:51.151330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.693 [2024-12-16 14:33:51.153332] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.693 [2024-12-16 14:33:51.162707] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.693 [2024-12-16 14:33:51.163153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.693 [2024-12-16 14:33:51.163307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.163320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.163340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.163519] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.163650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.163661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.163669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.165650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.694 [2024-12-16 14:33:51.175146] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.694 [2024-12-16 14:33:51.175519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.175669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.175682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.175691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.175777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.175937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.175949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.175958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.178029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.694 [2024-12-16 14:33:51.187354] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.694 [2024-12-16 14:33:51.187625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.187785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.187797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.187806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.187956] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.188070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.188081] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.188088] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.190079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.694 [2024-12-16 14:33:51.199630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.694 [2024-12-16 14:33:51.200005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.200247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.200261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.200269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.200434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.200597] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.200607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.200616] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.202753] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.694 [2024-12-16 14:33:51.212144] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.694 [2024-12-16 14:33:51.212522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.212731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.212745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.212754] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.212862] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.213037] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.213048] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.213057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.215133] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.694 [2024-12-16 14:33:51.224253] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.694 [2024-12-16 14:33:51.224676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.224838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.224852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.224867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.225015] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.225144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.225154] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.225162] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.227007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.694 [2024-12-16 14:33:51.236490] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.694 [2024-12-16 14:33:51.236878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.237116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.237129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.237138] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.237269] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.237414] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.237425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.237432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.239232] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.694 [2024-12-16 14:33:51.248594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.694 [2024-12-16 14:33:51.248964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.249055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.249069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.249078] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.249194] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.249307] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.249318] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.249325] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.251207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.694 [2024-12-16 14:33:51.260764] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.694 [2024-12-16 14:33:51.261007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.261132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.694 [2024-12-16 14:33:51.261145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.694 [2024-12-16 14:33:51.261158] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.694 [2024-12-16 14:33:51.261272] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.694 [2024-12-16 14:33:51.261402] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.694 [2024-12-16 14:33:51.261412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.694 [2024-12-16 14:33:51.261420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.694 [2024-12-16 14:33:51.263353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.954 [2024-12-16 14:33:51.272944] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.954 [2024-12-16 14:33:51.273179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.954 [2024-12-16 14:33:51.273383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.954 [2024-12-16 14:33:51.273416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.954 [2024-12-16 14:33:51.273440] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.954 [2024-12-16 14:33:51.273770] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.954 [2024-12-16 14:33:51.273898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.954 [2024-12-16 14:33:51.273910] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.954 [2024-12-16 14:33:51.273918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.275802] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.284922] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.285131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.285238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.285250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.285257] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.285387] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.285516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.285527] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.285534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.287205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.296850] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.297197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.297353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.297366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.297374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.297522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.297651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.297661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.297667] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.299475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.308751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.309106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.309342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.309375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.309398] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.309835] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.309938] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.309949] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.309955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.311638] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.320733] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.321041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.321127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.321137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.321145] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.321299] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.321439] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.321449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.321455] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.323054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.332544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.332920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.333956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.333986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.334000] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.334191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.334427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.334441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.334452] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.337236] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.344903] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.345265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.345371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.345384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.345393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.345484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.345621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.345632] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.345639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.347495] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.356796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.357066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.357170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.357181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.357188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.357280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.357373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.357382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.357388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.358994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.368544] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.368813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.368978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.368990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.368997] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.369063] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.369195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.369206] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.369213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.370965] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.380561] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.380845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.380948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.380959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.380966] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.955 [2024-12-16 14:33:51.381087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.955 [2024-12-16 14:33:51.381179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.955 [2024-12-16 14:33:51.381188] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.955 [2024-12-16 14:33:51.381195] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.955 [2024-12-16 14:33:51.382838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.955 [2024-12-16 14:33:51.392301] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.955 [2024-12-16 14:33:51.392589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.392760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.955 [2024-12-16 14:33:51.392792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.955 [2024-12-16 14:33:51.392816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.393215] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.393528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.393542] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.393553] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.396267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.404803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.405079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.405266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.405298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.405322] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.405702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.405822] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.405832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.405843] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.407606] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.416569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.416850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.417073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.417105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.417128] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.417561] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.417812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.417821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.417827] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.419492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.428467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.428851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.429144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.429177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.429201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.429365] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.429471] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.429481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.429487] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.431056] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.440300] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.440630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.440880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.440915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.440939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.441370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.441704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.441729] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.441751] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.443487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.452083] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.452469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.452678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.452710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.452734] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.453182] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.453282] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.453292] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.453298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.455084] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.463936] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.464330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.464582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.464616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.464639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.464984] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.465064] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.465074] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.465080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.466734] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.475573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.475891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.476173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.476205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.476229] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.476485] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.476592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.476601] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.476607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.478231] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.487239] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.487573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.487805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.487837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.487877] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.488263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.488410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.488420] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.488426] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.489993] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.956 [2024-12-16 14:33:51.499049] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.956 [2024-12-16 14:33:51.499419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.499649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.956 [2024-12-16 14:33:51.499660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.956 [2024-12-16 14:33:51.499667] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.956 [2024-12-16 14:33:51.499774] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.956 [2024-12-16 14:33:51.499885] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.956 [2024-12-16 14:33:51.499894] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.956 [2024-12-16 14:33:51.499900] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.956 [2024-12-16 14:33:51.501569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.957 [2024-12-16 14:33:51.510795] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.957 [2024-12-16 14:33:51.511065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.957 [2024-12-16 14:33:51.511300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.957 [2024-12-16 14:33:51.511311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.957 [2024-12-16 14:33:51.511318] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.957 [2024-12-16 14:33:51.511425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.957 [2024-12-16 14:33:51.511504] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.957 [2024-12-16 14:33:51.511513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.957 [2024-12-16 14:33:51.511519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.957 [2024-12-16 14:33:51.513207] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:36.957 [2024-12-16 14:33:51.522571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:36.957 [2024-12-16 14:33:51.522824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.957 [2024-12-16 14:33:51.523073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:36.957 [2024-12-16 14:33:51.523106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:36.957 [2024-12-16 14:33:51.523129] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:36.957 [2024-12-16 14:33:51.523381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:36.957 [2024-12-16 14:33:51.523512] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:36.957 [2024-12-16 14:33:51.523522] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:36.957 [2024-12-16 14:33:51.523529] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:36.957 [2024-12-16 14:33:51.525307] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.217 [2024-12-16 14:33:51.534489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.217 [2024-12-16 14:33:51.534846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.535057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.535068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.217 [2024-12-16 14:33:51.535076] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.217 [2024-12-16 14:33:51.535200] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.217 [2024-12-16 14:33:51.535325] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.217 [2024-12-16 14:33:51.535334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.217 [2024-12-16 14:33:51.535341] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.217 [2024-12-16 14:33:51.536929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.217 [2024-12-16 14:33:51.546360] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.217 [2024-12-16 14:33:51.546727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.546882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.546895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.217 [2024-12-16 14:33:51.546903] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.217 [2024-12-16 14:33:51.546974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.217 [2024-12-16 14:33:51.547133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.217 [2024-12-16 14:33:51.547142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.217 [2024-12-16 14:33:51.547149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.217 [2024-12-16 14:33:51.548883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.217 [2024-12-16 14:33:51.558133] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.217 [2024-12-16 14:33:51.558563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.558828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.558872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.217 [2024-12-16 14:33:51.558898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.217 [2024-12-16 14:33:51.559135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.217 [2024-12-16 14:33:51.559276] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.217 [2024-12-16 14:33:51.559286] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.217 [2024-12-16 14:33:51.559292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.217 [2024-12-16 14:33:51.561005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.217 [2024-12-16 14:33:51.570152] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.217 [2024-12-16 14:33:51.570504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.570664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.570697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.217 [2024-12-16 14:33:51.570720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.217 [2024-12-16 14:33:51.571115] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.217 [2024-12-16 14:33:51.571281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.217 [2024-12-16 14:33:51.571291] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.217 [2024-12-16 14:33:51.571297] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.217 [2024-12-16 14:33:51.573112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.217 [2024-12-16 14:33:51.581946] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.217 [2024-12-16 14:33:51.582272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.582511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.582543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.217 [2024-12-16 14:33:51.582567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.217 [2024-12-16 14:33:51.582749] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.217 [2024-12-16 14:33:51.583198] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.217 [2024-12-16 14:33:51.583226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.217 [2024-12-16 14:33:51.583248] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.217 [2024-12-16 14:33:51.585009] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.217 [2024-12-16 14:33:51.593864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.217 [2024-12-16 14:33:51.594230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.594426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.217 [2024-12-16 14:33:51.594439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.217 [2024-12-16 14:33:51.594450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.217 [2024-12-16 14:33:51.594553] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.217 [2024-12-16 14:33:51.594653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.217 [2024-12-16 14:33:51.594661] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.217 [2024-12-16 14:33:51.594668] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.217 [2024-12-16 14:33:51.596443] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.605515] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.605873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.606080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.606091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.606099] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.606219] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.606324] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.606333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.606340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.607872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.617191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.617568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.617807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.617840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.617879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.618213] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.618425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.618434] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.618440] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.620139] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.629019] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.629379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.629583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.629616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.629639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.629845] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.629987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.629997] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.630003] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.631608] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.640939] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.641206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.641363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.641397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.641420] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.641702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.642051] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.642077] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.642098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.644003] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.652870] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.653240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.653508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.653540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.653563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.653761] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.653862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.653872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.653879] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.655525] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.664593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.664961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.665169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.665201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.665225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.665690] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.665800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.665809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.665815] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.667516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.676168] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.676499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.676751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.676784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.676808] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.677044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.677164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.677174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.677181] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.678830] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.687910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.688270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.688495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.688507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.688514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.688621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.688727] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.688734] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.688741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.690339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.699676] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.700017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.700190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.700221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.700245] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.700675] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.218 [2024-12-16 14:33:51.700821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.218 [2024-12-16 14:33:51.700833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.218 [2024-12-16 14:33:51.700840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.218 [2024-12-16 14:33:51.702425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.218 [2024-12-16 14:33:51.711394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.218 [2024-12-16 14:33:51.711700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.711931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.218 [2024-12-16 14:33:51.711943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.218 [2024-12-16 14:33:51.711951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.218 [2024-12-16 14:33:51.712044] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.219 [2024-12-16 14:33:51.712136] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.219 [2024-12-16 14:33:51.712144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.219 [2024-12-16 14:33:51.712150] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.219 [2024-12-16 14:33:51.713569] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.219 [2024-12-16 14:33:51.723118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.219 [2024-12-16 14:33:51.723378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.723580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.723611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.219 [2024-12-16 14:33:51.723635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.219 [2024-12-16 14:33:51.723869] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.219 [2024-12-16 14:33:51.723991] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.219 [2024-12-16 14:33:51.724001] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.219 [2024-12-16 14:33:51.724007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.219 [2024-12-16 14:33:51.725677] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.219 [2024-12-16 14:33:51.734876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.219 [2024-12-16 14:33:51.735226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.735451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.735462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.219 [2024-12-16 14:33:51.735469] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.219 [2024-12-16 14:33:51.735575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.219 [2024-12-16 14:33:51.735681] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.219 [2024-12-16 14:33:51.735691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.219 [2024-12-16 14:33:51.735700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.219 [2024-12-16 14:33:51.737273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.219 [2024-12-16 14:33:51.746835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.219 [2024-12-16 14:33:51.747193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.747423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.747455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.219 [2024-12-16 14:33:51.747478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.219 [2024-12-16 14:33:51.747967] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.219 [2024-12-16 14:33:51.748074] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.219 [2024-12-16 14:33:51.748084] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.219 [2024-12-16 14:33:51.748091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.219 [2024-12-16 14:33:51.749732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.219 [2024-12-16 14:33:51.758486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.219 [2024-12-16 14:33:51.758800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.759023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.759036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.219 [2024-12-16 14:33:51.759044] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.219 [2024-12-16 14:33:51.759136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.219 [2024-12-16 14:33:51.759201] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.219 [2024-12-16 14:33:51.759210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.219 [2024-12-16 14:33:51.759216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.219 [2024-12-16 14:33:51.760725] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.219 [2024-12-16 14:33:51.770364] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.219 [2024-12-16 14:33:51.770723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.770982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.771017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.219 [2024-12-16 14:33:51.771040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.219 [2024-12-16 14:33:51.771571] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.219 [2024-12-16 14:33:51.771913] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.219 [2024-12-16 14:33:51.771922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.219 [2024-12-16 14:33:51.771929] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.219 [2024-12-16 14:33:51.773429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.219 [2024-12-16 14:33:51.782390] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.219 [2024-12-16 14:33:51.782736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.782892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.219 [2024-12-16 14:33:51.782905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.219 [2024-12-16 14:33:51.782912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.219 [2024-12-16 14:33:51.783046] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.219 [2024-12-16 14:33:51.783151] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.219 [2024-12-16 14:33:51.783161] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.219 [2024-12-16 14:33:51.783169] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.219 [2024-12-16 14:33:51.784744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.479 [2024-12-16 14:33:51.794255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.479 [2024-12-16 14:33:51.794611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.479 [2024-12-16 14:33:51.794815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.479 [2024-12-16 14:33:51.794827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.479 [2024-12-16 14:33:51.794835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.479 [2024-12-16 14:33:51.795000] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.479 [2024-12-16 14:33:51.795115] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.479 [2024-12-16 14:33:51.795125] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.479 [2024-12-16 14:33:51.795131] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.479 [2024-12-16 14:33:51.796772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.479 [2024-12-16 14:33:51.806080] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.479 [2024-12-16 14:33:51.806435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.479 [2024-12-16 14:33:51.806685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.479 [2024-12-16 14:33:51.806698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.479 [2024-12-16 14:33:51.806706] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.479 [2024-12-16 14:33:51.806836] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.806942] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.806951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.806958] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.808729] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.817977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.818354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.818586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.818619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.818643] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.818824] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.819138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.819148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.819154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.820904] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.829785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.830100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.830352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.830386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.830409] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.830841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.831167] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.831176] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.831182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.832742] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.841630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.842004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.842186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.842198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.842205] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.842311] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.842389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.842397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.842403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.844051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.853378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.853762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.853848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.853865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.853873] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.853981] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.854087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.854096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.854102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.855654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.865255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.865631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.865785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.865797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.865804] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.865903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.865996] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.866005] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.866012] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.867485] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.876878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.877234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.877439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.877471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.877494] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.877987] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.878364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.878378] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.878389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.881197] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.889452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.889828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.890130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.890164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.890188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.890432] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.890569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.890579] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.890586] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.892503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.901341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.901719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.901808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.901819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.901851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.902249] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.902456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.902465] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.902472] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.903997] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.913131] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.480 [2024-12-16 14:33:51.913475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.913628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.480 [2024-12-16 14:33:51.913640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.480 [2024-12-16 14:33:51.913647] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.480 [2024-12-16 14:33:51.913753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.480 [2024-12-16 14:33:51.913844] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.480 [2024-12-16 14:33:51.913861] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.480 [2024-12-16 14:33:51.913868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.480 [2024-12-16 14:33:51.915512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.480 [2024-12-16 14:33:51.924957] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:51.925314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.925485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.925496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:51.925506] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:51.925614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:51.925707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:51.925715] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:51.925722] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:51.927297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:51.936905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:51.937245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.937472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.937484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:51.937491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:51.937597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:51.937716] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:51.937726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:51.937732] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:51.939285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:51.948803] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:51.949077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.949287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.949319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:51.949342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:51.949625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:51.950021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:51.950049] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:51.950070] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:51.951935] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:51.960639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:51.960975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.961135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.961146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:51.961154] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:51.961264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:51.961382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:51.961392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:51.961398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:51.963033] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:51.972486] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:51.972743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.972923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.972957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:51.972981] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:51.973314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:51.973500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:51.973509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:51.973515] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:51.975136] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:51.984198] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:51.984459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.984714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.984746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:51.984770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:51.985170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:51.985611] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:51.985642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:51.985663] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:51.987230] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:51.995909] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:51.996247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.996426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:51.996437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:51.996464] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:51.996870] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:51.997186] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:51.997195] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:51.997202] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:51.998788] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:52.007648] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:52.007985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:52.008217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:52.008250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:52.008273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:52.008752] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:52.009147] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:52.009175] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:52.009197] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:52.011528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:52.020314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:52.020675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:52.020907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:52.020920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:52.020929] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:52.021036] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:52.021173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.481 [2024-12-16 14:33:52.021184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.481 [2024-12-16 14:33:52.021191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.481 [2024-12-16 14:33:52.023154] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.481 [2024-12-16 14:33:52.032210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.481 [2024-12-16 14:33:52.032739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:52.032931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.481 [2024-12-16 14:33:52.032943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.481 [2024-12-16 14:33:52.032951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.481 [2024-12-16 14:33:52.033076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.481 [2024-12-16 14:33:52.033197] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.482 [2024-12-16 14:33:52.033205] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.482 [2024-12-16 14:33:52.033211] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.482 [2024-12-16 14:33:52.034923] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.482 [2024-12-16 14:33:52.043974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.482 [2024-12-16 14:33:52.044253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.482 [2024-12-16 14:33:52.044476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.482 [2024-12-16 14:33:52.044486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.482 [2024-12-16 14:33:52.044493] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.482 [2024-12-16 14:33:52.044646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.482 [2024-12-16 14:33:52.044772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.482 [2024-12-16 14:33:52.044780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.482 [2024-12-16 14:33:52.044786] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.482 [2024-12-16 14:33:52.046498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.742 [2024-12-16 14:33:52.055953] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.742 [2024-12-16 14:33:52.056289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.056541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.056551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.742 [2024-12-16 14:33:52.056559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.742 [2024-12-16 14:33:52.056658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.742 [2024-12-16 14:33:52.056818] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.742 [2024-12-16 14:33:52.056827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.742 [2024-12-16 14:33:52.056834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.742 [2024-12-16 14:33:52.058528] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.742 [2024-12-16 14:33:52.067830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.742 [2024-12-16 14:33:52.068189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.068445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.068477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.742 [2024-12-16 14:33:52.068500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.742 [2024-12-16 14:33:52.068894] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.742 [2024-12-16 14:33:52.069330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.742 [2024-12-16 14:33:52.069355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.742 [2024-12-16 14:33:52.069383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.742 [2024-12-16 14:33:52.071342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.742 [2024-12-16 14:33:52.079574] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.742 [2024-12-16 14:33:52.079922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.080191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.080223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.742 [2024-12-16 14:33:52.080246] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.742 [2024-12-16 14:33:52.080462] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.742 [2024-12-16 14:33:52.080668] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.742 [2024-12-16 14:33:52.080680] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.742 [2024-12-16 14:33:52.080690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.742 [2024-12-16 14:33:52.083490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.742 [2024-12-16 14:33:52.092199] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.742 [2024-12-16 14:33:52.092541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.092813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.092843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.742 [2024-12-16 14:33:52.092884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.742 [2024-12-16 14:33:52.093265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.742 [2024-12-16 14:33:52.093733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.742 [2024-12-16 14:33:52.093741] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.742 [2024-12-16 14:33:52.093747] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.742 [2024-12-16 14:33:52.095679] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.742 [2024-12-16 14:33:52.104058] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.742 [2024-12-16 14:33:52.104411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.104585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.104595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.742 [2024-12-16 14:33:52.104602] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.742 [2024-12-16 14:33:52.104680] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.742 [2024-12-16 14:33:52.104784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.742 [2024-12-16 14:33:52.104791] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.742 [2024-12-16 14:33:52.104800] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.742 [2024-12-16 14:33:52.106512] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.742 [2024-12-16 14:33:52.115748] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.742 [2024-12-16 14:33:52.116087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.116341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.116372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.742 [2024-12-16 14:33:52.116395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.742 [2024-12-16 14:33:52.116576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.742 [2024-12-16 14:33:52.116680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.742 [2024-12-16 14:33:52.116687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.742 [2024-12-16 14:33:52.116693] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.742 [2024-12-16 14:33:52.118285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.742 [2024-12-16 14:33:52.127771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.742 [2024-12-16 14:33:52.128087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.128315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.128345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.742 [2024-12-16 14:33:52.128368] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.742 [2024-12-16 14:33:52.128649] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.742 [2024-12-16 14:33:52.128834] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.742 [2024-12-16 14:33:52.128841] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.742 [2024-12-16 14:33:52.128848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.742 [2024-12-16 14:33:52.130584] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.742 [2024-12-16 14:33:52.139617] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.742 [2024-12-16 14:33:52.139962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.140110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.742 [2024-12-16 14:33:52.140120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.742 [2024-12-16 14:33:52.140127] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.742 [2024-12-16 14:33:52.140205] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.742 [2024-12-16 14:33:52.140296] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.742 [2024-12-16 14:33:52.140303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.742 [2024-12-16 14:33:52.140309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.142014] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.151487] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.151822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.152022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.152033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.152040] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.152109] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.152219] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.152226] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.152232] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.153958] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.163257] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.163575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.163801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.163810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.163817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.163976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.164087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.164095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.164101] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.165751] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.175054] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.175374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.175524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.175534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.175540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.175659] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.175736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.175744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.175749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.177481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.186873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.187204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.187369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.187378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.187385] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.187489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.187621] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.187629] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.187634] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.189312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.198690] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.199040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.199300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.199332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.199355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.199748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.199853] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.199868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.199874] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.201462] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.210462] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.210786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.210936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.210981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.211004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.211484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.211741] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.211753] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.211763] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.214470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.222898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.223266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.223529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.223561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.223584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.223982] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.224262] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.224270] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.224277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.226227] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.234758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.235103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.235329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.235360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.235382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.235764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.236123] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.236131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.236137] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.237752] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.246581] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.246934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.247149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.247161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.247169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.247298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.743 [2024-12-16 14:33:52.247410] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.743 [2024-12-16 14:33:52.247418] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.743 [2024-12-16 14:33:52.247424] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.743 [2024-12-16 14:33:52.249025] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.743 [2024-12-16 14:33:52.258295] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.743 [2024-12-16 14:33:52.258677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.258830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.743 [2024-12-16 14:33:52.258841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.743 [2024-12-16 14:33:52.258852] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.743 [2024-12-16 14:33:52.258970] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.744 [2024-12-16 14:33:52.259094] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.744 [2024-12-16 14:33:52.259102] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.744 [2024-12-16 14:33:52.259108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.744 [2024-12-16 14:33:52.260913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.744 [2024-12-16 14:33:52.270243] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.744 [2024-12-16 14:33:52.270614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.744 [2024-12-16 14:33:52.271041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.744 [2024-12-16 14:33:52.271078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.744 [2024-12-16 14:33:52.271101] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.744 [2024-12-16 14:33:52.271262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.744 [2024-12-16 14:33:52.271354] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.744 [2024-12-16 14:33:52.271361] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.744 [2024-12-16 14:33:52.271367] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.744 [2024-12-16 14:33:52.273052] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.744 [2024-12-16 14:33:52.282192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.744 [2024-12-16 14:33:52.282548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.744 [2024-12-16 14:33:52.282815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.744 [2024-12-16 14:33:52.282846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.744 [2024-12-16 14:33:52.282883] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.744 [2024-12-16 14:33:52.283167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.744 [2024-12-16 14:33:52.283292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.744 [2024-12-16 14:33:52.283299] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.744 [2024-12-16 14:33:52.283305] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.744 [2024-12-16 14:33:52.285082] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.744 [2024-12-16 14:33:52.293950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.744 [2024-12-16 14:33:52.294270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.744 [2024-12-16 14:33:52.294422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.744 [2024-12-16 14:33:52.294431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.744 [2024-12-16 14:33:52.294441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.744 [2024-12-16 14:33:52.294546] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.744 [2024-12-16 14:33:52.294684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.744 [2024-12-16 14:33:52.294692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.744 [2024-12-16 14:33:52.294698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.744 [2024-12-16 14:33:52.296488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:37.744 [2024-12-16 14:33:52.306008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:37.744 [2024-12-16 14:33:52.306417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.744 [2024-12-16 14:33:52.306644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:37.744 [2024-12-16 14:33:52.306654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:37.744 [2024-12-16 14:33:52.306661] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:37.744 [2024-12-16 14:33:52.306775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:37.744 [2024-12-16 14:33:52.306910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:37.744 [2024-12-16 14:33:52.306918] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:37.744 [2024-12-16 14:33:52.306925] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:37.744 [2024-12-16 14:33:52.308567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.004 [2024-12-16 14:33:52.317754] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.004 [2024-12-16 14:33:52.318134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.318387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.318397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.004 [2024-12-16 14:33:52.318404] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.004 [2024-12-16 14:33:52.318531] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.004 [2024-12-16 14:33:52.318630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.004 [2024-12-16 14:33:52.318637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.004 [2024-12-16 14:33:52.318644] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.004 [2024-12-16 14:33:52.320263] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.004 [2024-12-16 14:33:52.329479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.004 [2024-12-16 14:33:52.329809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.330009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.330020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.004 [2024-12-16 14:33:52.330028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.004 [2024-12-16 14:33:52.330120] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.004 [2024-12-16 14:33:52.330237] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.004 [2024-12-16 14:33:52.330244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.004 [2024-12-16 14:33:52.330250] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.004 [2024-12-16 14:33:52.331911] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.004 [2024-12-16 14:33:52.341400] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.004 [2024-12-16 14:33:52.341730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.341965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.341998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.004 [2024-12-16 14:33:52.342020] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.004 [2024-12-16 14:33:52.342410] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.004 [2024-12-16 14:33:52.342521] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.004 [2024-12-16 14:33:52.342528] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.004 [2024-12-16 14:33:52.342534] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.004 [2024-12-16 14:33:52.344108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.004 [2024-12-16 14:33:52.353225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.004 [2024-12-16 14:33:52.353574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.353794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.353803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.004 [2024-12-16 14:33:52.353809] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.004 [2024-12-16 14:33:52.353968] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.004 [2024-12-16 14:33:52.354079] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.004 [2024-12-16 14:33:52.354086] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.004 [2024-12-16 14:33:52.354093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.004 [2024-12-16 14:33:52.355849] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.004 [2024-12-16 14:33:52.364800] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.004 [2024-12-16 14:33:52.365138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.365320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.004 [2024-12-16 14:33:52.365330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.004 [2024-12-16 14:33:52.365337] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.004 [2024-12-16 14:33:52.365419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.004 [2024-12-16 14:33:52.365518] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.365525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.365532] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.367257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.376500] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.376873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.377059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.377088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.377111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.377435] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.377544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.377552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.377558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.379189] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.388217] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.388460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.388688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.388719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.388741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.389091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.389250] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.389257] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.389264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.391049] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.400078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.400415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.400620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.400630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.400639] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.400750] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.400833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.400847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.400860] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.402579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.411853] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.412218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.412398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.412408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.412415] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.412526] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.412651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.412659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.412665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.414379] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.423590] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.423807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.423999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.424034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.424057] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.424391] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.424576] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.424584] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.424590] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.426244] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.435466] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.435825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.436041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.436074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.436097] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.436308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.436447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.436455] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.436464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.438179] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.447388] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.447739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.447989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.448026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.448049] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.448482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.448684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.448692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.448698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.450484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.459082] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.459376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.459654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.459685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.459708] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.460103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.460375] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.460382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.460388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.462059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.470916] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.471216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.471370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.471379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.005 [2024-12-16 14:33:52.471386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.005 [2024-12-16 14:33:52.471482] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.005 [2024-12-16 14:33:52.471578] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.005 [2024-12-16 14:33:52.471585] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.005 [2024-12-16 14:33:52.471592] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.005 [2024-12-16 14:33:52.473213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.005 [2024-12-16 14:33:52.482814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.005 [2024-12-16 14:33:52.483132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.483285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.005 [2024-12-16 14:33:52.483316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.006 [2024-12-16 14:33:52.483339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.006 [2024-12-16 14:33:52.483686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.006 [2024-12-16 14:33:52.483782] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.006 [2024-12-16 14:33:52.483789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.006 [2024-12-16 14:33:52.483795] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.006 [2024-12-16 14:33:52.485548] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.006 [2024-12-16 14:33:52.494538] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.006 [2024-12-16 14:33:52.494876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.495149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.495181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.006 [2024-12-16 14:33:52.495203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.006 [2024-12-16 14:33:52.495476] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.006 [2024-12-16 14:33:52.495558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.006 [2024-12-16 14:33:52.495566] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.006 [2024-12-16 14:33:52.495572] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.006 [2024-12-16 14:33:52.497245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.006 [2024-12-16 14:33:52.506250] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.006 [2024-12-16 14:33:52.506635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.506866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.506877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.006 [2024-12-16 14:33:52.506884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.006 [2024-12-16 14:33:52.506995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.006 [2024-12-16 14:33:52.507105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.006 [2024-12-16 14:33:52.507113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.006 [2024-12-16 14:33:52.507119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.006 [2024-12-16 14:33:52.508952] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.006 [2024-12-16 14:33:52.517977] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.006 [2024-12-16 14:33:52.518278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.518449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.518481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.006 [2024-12-16 14:33:52.518504] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.006 [2024-12-16 14:33:52.519048] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.006 [2024-12-16 14:33:52.519383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.006 [2024-12-16 14:33:52.519407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.006 [2024-12-16 14:33:52.519428] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.006 [2024-12-16 14:33:52.521448] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.006 [2024-12-16 14:33:52.529880] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.006 [2024-12-16 14:33:52.530276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.530435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.530446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.006 [2024-12-16 14:33:52.530453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.006 [2024-12-16 14:33:52.530581] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.006 [2024-12-16 14:33:52.530694] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.006 [2024-12-16 14:33:52.530702] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.006 [2024-12-16 14:33:52.530708] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.006 [2024-12-16 14:33:52.532498] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.006 [2024-12-16 14:33:52.541889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.006 [2024-12-16 14:33:52.542234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.542458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.542468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.006 [2024-12-16 14:33:52.542476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.006 [2024-12-16 14:33:52.542626] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.006 [2024-12-16 14:33:52.542730] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.006 [2024-12-16 14:33:52.542738] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.006 [2024-12-16 14:33:52.542745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.006 [2024-12-16 14:33:52.544461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.006 [2024-12-16 14:33:52.553708] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.006 [2024-12-16 14:33:52.554077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.554334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.554344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.006 [2024-12-16 14:33:52.554352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.006 [2024-12-16 14:33:52.554474] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.006 [2024-12-16 14:33:52.554625] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.006 [2024-12-16 14:33:52.554633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.006 [2024-12-16 14:33:52.554639] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.006 [2024-12-16 14:33:52.556577] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.006 [2024-12-16 14:33:52.565761] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.006 [2024-12-16 14:33:52.566026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.566201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.006 [2024-12-16 14:33:52.566212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.006 [2024-12-16 14:33:52.566219] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.006 [2024-12-16 14:33:52.566333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.006 [2024-12-16 14:33:52.566417] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.006 [2024-12-16 14:33:52.566425] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.006 [2024-12-16 14:33:52.566432] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.006 [2024-12-16 14:33:52.568184] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.266 [2024-12-16 14:33:52.577604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.266 [2024-12-16 14:33:52.577941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.266 [2024-12-16 14:33:52.578141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.266 [2024-12-16 14:33:52.578173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.266 [2024-12-16 14:33:52.578196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.578576] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.578773] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.578781] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.578788] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.580467] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.589569] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.589916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.590031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.590044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.590051] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.590167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.590295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.590303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.590309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.592081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.601365] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.601682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.601832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.601841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.601849] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.601966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.602062] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.602070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.602077] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.603760] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.613378] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.613688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.613796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.613805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.613813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.613930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.614069] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.614076] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.614083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.615750] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.625178] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.625601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.625824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.625835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.625845] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.625991] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.626089] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.626096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.626103] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.627823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.637093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.637401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.637649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.637659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.637666] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.637762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.637879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.637888] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.637895] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.639618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.648908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.649232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.649388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.649398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.649405] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.649487] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.649627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.649634] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.649640] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.651273] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.660917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.661290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.661400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.661410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.661417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.661532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.661657] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.661664] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.661671] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.663481] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.672814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.673194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.673352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.673361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.673369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.673479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.673590] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.673597] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.673603] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.675378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.267 [2024-12-16 14:33:52.684546] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.267 [2024-12-16 14:33:52.684848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.685069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.267 [2024-12-16 14:33:52.685079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.267 [2024-12-16 14:33:52.685086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.267 [2024-12-16 14:33:52.685212] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.267 [2024-12-16 14:33:52.685308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.267 [2024-12-16 14:33:52.685315] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.267 [2024-12-16 14:33:52.685321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.267 [2024-12-16 14:33:52.687050] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.696327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.696698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.696878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.696889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.696896] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.697022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.697135] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.697143] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.697149] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.698924] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.708283] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.708625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.708792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.708803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.708810] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.708927] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.709009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.709017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.709023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.710674] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.720256] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.720622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.720847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.720862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.720870] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.721024] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.721164] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.721172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.721179] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.722868] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.732046] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.732349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.732433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.732442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.732450] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.732575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.732671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.732683] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.732689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.734559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.743990] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.744272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.744426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.744437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.744444] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.744569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.744651] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.744659] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.744666] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.746396] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.755973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.756241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.756342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.756352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.756359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.756470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.756580] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.756588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.756594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.758285] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.767729] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.768114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.768334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.768344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.768352] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.768434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.768516] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.768523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.768533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.770234] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.779679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.780025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.780187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.780197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.780204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.780314] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.780382] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.780390] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.780396] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.782112] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.791622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.791984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.792164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.792175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.792182] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.792308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.268 [2024-12-16 14:33:52.792390] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.268 [2024-12-16 14:33:52.792397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.268 [2024-12-16 14:33:52.792403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.268 [2024-12-16 14:33:52.794214] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.268 [2024-12-16 14:33:52.803460] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.268 [2024-12-16 14:33:52.803836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.804063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.268 [2024-12-16 14:33:52.804075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.268 [2024-12-16 14:33:52.804082] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.268 [2024-12-16 14:33:52.804181] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.269 [2024-12-16 14:33:52.804295] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.269 [2024-12-16 14:33:52.804303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.269 [2024-12-16 14:33:52.804309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.269 [2024-12-16 14:33:52.806005] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.269 [2024-12-16 14:33:52.815439] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.269 [2024-12-16 14:33:52.815766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.269 [2024-12-16 14:33:52.815933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.269 [2024-12-16 14:33:52.815945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.269 [2024-12-16 14:33:52.815952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.269 [2024-12-16 14:33:52.816081] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.269 [2024-12-16 14:33:52.816209] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.269 [2024-12-16 14:33:52.816217] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.269 [2024-12-16 14:33:52.816224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.269 [2024-12-16 14:33:52.817883] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.269 [2024-12-16 14:33:52.827279] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.269 [2024-12-16 14:33:52.827603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.269 [2024-12-16 14:33:52.827808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.269 [2024-12-16 14:33:52.827818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.269 [2024-12-16 14:33:52.827825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.269 [2024-12-16 14:33:52.828004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.269 [2024-12-16 14:33:52.828133] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.269 [2024-12-16 14:33:52.828140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.269 [2024-12-16 14:33:52.828147] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.269 [2024-12-16 14:33:52.829897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.530 [2024-12-16 14:33:52.839303] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.530 [2024-12-16 14:33:52.839562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.839790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.839800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.530 [2024-12-16 14:33:52.839807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.530 [2024-12-16 14:33:52.839957] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.530 [2024-12-16 14:33:52.840058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.530 [2024-12-16 14:33:52.840066] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.530 [2024-12-16 14:33:52.840072] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.530 [2024-12-16 14:33:52.841913] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.530 [2024-12-16 14:33:52.851479] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.530 [2024-12-16 14:33:52.851851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.852069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.852079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.530 [2024-12-16 14:33:52.852087] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.530 [2024-12-16 14:33:52.852198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.530 [2024-12-16 14:33:52.852309] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.530 [2024-12-16 14:33:52.852316] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.530 [2024-12-16 14:33:52.852323] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.530 [2024-12-16 14:33:52.854094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.530 [2024-12-16 14:33:52.863394] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.530 [2024-12-16 14:33:52.863680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.863908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.863919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.530 [2024-12-16 14:33:52.863926] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.530 [2024-12-16 14:33:52.864009] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.530 [2024-12-16 14:33:52.864105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.530 [2024-12-16 14:33:52.864113] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.530 [2024-12-16 14:33:52.864119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.530 [2024-12-16 14:33:52.865891] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.530 [2024-12-16 14:33:52.875363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.530 [2024-12-16 14:33:52.875706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.875910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.875920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.530 [2024-12-16 14:33:52.875928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.530 [2024-12-16 14:33:52.876067] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.530 [2024-12-16 14:33:52.876177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.530 [2024-12-16 14:33:52.876184] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.530 [2024-12-16 14:33:52.876191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.530 [2024-12-16 14:33:52.877961] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.530 [2024-12-16 14:33:52.887159] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.530 [2024-12-16 14:33:52.887488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.887720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.887730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.530 [2024-12-16 14:33:52.887737] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.530 [2024-12-16 14:33:52.887833] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.530 [2024-12-16 14:33:52.887935] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.530 [2024-12-16 14:33:52.887943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.530 [2024-12-16 14:33:52.887949] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.530 [2024-12-16 14:33:52.889582] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.530 [2024-12-16 14:33:52.899119] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.530 [2024-12-16 14:33:52.899434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.899658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.899668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.530 [2024-12-16 14:33:52.899675] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.530 [2024-12-16 14:33:52.899800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.530 [2024-12-16 14:33:52.899888] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.530 [2024-12-16 14:33:52.899895] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.530 [2024-12-16 14:33:52.899902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.530 [2024-12-16 14:33:52.901469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.530 [2024-12-16 14:33:52.911008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.530 [2024-12-16 14:33:52.911354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.911603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.530 [2024-12-16 14:33:52.911613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.530 [2024-12-16 14:33:52.911620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.530 [2024-12-16 14:33:52.911716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.530 [2024-12-16 14:33:52.911812] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:52.911820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:52.911826] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:52.913510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 [2024-12-16 14:33:52.923122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:52.923476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.923703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.923715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:52.923723] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:52.923849] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:52.923966] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:52.923974] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:52.923981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:52.925561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 [2024-12-16 14:33:52.934974] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:52.935328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.935480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.935490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:52.935497] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:52.935593] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:52.935660] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:52.935668] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:52.935675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:52.937444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 [2024-12-16 14:33:52.947038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:52.947415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.947503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.947513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:52.947520] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:52.947617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:52.947742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:52.947750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:52.947757] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:52.949490] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 [2024-12-16 14:33:52.958825] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:52.959224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.959451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.959462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:52.959474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:52.959601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:52.959697] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:52.959705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:52.959712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:52.961457] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 [2024-12-16 14:33:52.970616] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:52.970982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.971136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.971146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:52.971153] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:52.971264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:52.971374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:52.971382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:52.971388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:52.973210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 [2024-12-16 14:33:52.982580] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:52.982953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.983177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.983187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:52.983194] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:52.983334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:52.983429] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:52.983436] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:52.983443] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:52.985229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 [2024-12-16 14:33:52.994545] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:52.994881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.995087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:52.995097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:52.995104] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:52.995190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:52.995286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:52.995293] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:52.995300] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:52.997028] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 [2024-12-16 14:33:53.006564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:53.006938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:53.007075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:53.007085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:53.007092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:53.007203] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:53.007328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:53.007335] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:53.007342] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:53.009164] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.531 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 547029 Killed "${NVMF_APP[@]}" "$@" 00:29:38.531 14:33:53 -- host/bdevperf.sh@36 -- # tgt_init 00:29:38.531 14:33:53 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:29:38.531 14:33:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:38.531 14:33:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:38.531 14:33:53 -- common/autotest_common.sh@10 -- # set +x 00:29:38.531 [2024-12-16 14:33:53.018576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.531 [2024-12-16 14:33:53.018868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:53.019025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.531 [2024-12-16 14:33:53.019037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.531 [2024-12-16 14:33:53.019045] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.531 [2024-12-16 14:33:53.019143] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.531 [2024-12-16 14:33:53.019271] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.531 [2024-12-16 14:33:53.019280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.531 [2024-12-16 14:33:53.019288] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.531 [2024-12-16 14:33:53.021023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.532 14:33:53 -- nvmf/common.sh@469 -- # nvmfpid=548443 00:29:38.532 14:33:53 -- nvmf/common.sh@470 -- # waitforlisten 548443 00:29:38.532 14:33:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:29:38.532 14:33:53 -- common/autotest_common.sh@829 -- # '[' -z 548443 ']' 00:29:38.532 14:33:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:38.532 14:33:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:38.532 14:33:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:38.532 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:38.532 14:33:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:38.532 14:33:53 -- common/autotest_common.sh@10 -- # set +x 00:29:38.532 [2024-12-16 14:33:53.030445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.532 [2024-12-16 14:33:53.030775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.030984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.030995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.532 [2024-12-16 14:33:53.031003] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.532 [2024-12-16 14:33:53.031103] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.532 [2024-12-16 14:33:53.031246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.532 [2024-12-16 14:33:53.031254] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.532 [2024-12-16 14:33:53.031260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.532 [2024-12-16 14:33:53.033135] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.532 [2024-12-16 14:33:53.042274] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.532 [2024-12-16 14:33:53.042631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.042863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.042874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.532 [2024-12-16 14:33:53.042881] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.532 [2024-12-16 14:33:53.043020] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.532 [2024-12-16 14:33:53.043102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.532 [2024-12-16 14:33:53.043110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.532 [2024-12-16 14:33:53.043116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.532 [2024-12-16 14:33:53.044668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.532 [2024-12-16 14:33:53.054075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.532 [2024-12-16 14:33:53.054442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.054672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.054683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.532 [2024-12-16 14:33:53.054691] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.532 [2024-12-16 14:33:53.054776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.532 [2024-12-16 14:33:53.054925] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.532 [2024-12-16 14:33:53.054934] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.532 [2024-12-16 14:33:53.054945] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.532 [2024-12-16 14:33:53.056733] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.532 [2024-12-16 14:33:53.065976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.532 [2024-12-16 14:33:53.066298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.066528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.066538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.532 [2024-12-16 14:33:53.066546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.532 [2024-12-16 14:33:53.066674] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.532 [2024-12-16 14:33:53.066772] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.532 [2024-12-16 14:33:53.066780] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.532 [2024-12-16 14:33:53.066787] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.532 [2024-12-16 14:33:53.068546] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.532 [2024-12-16 14:33:53.069003] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:38.532 [2024-12-16 14:33:53.069050] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:38.532 [2024-12-16 14:33:53.077798] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.532 [2024-12-16 14:33:53.078166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.078240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.078250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.532 [2024-12-16 14:33:53.078258] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.532 [2024-12-16 14:33:53.078341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.532 [2024-12-16 14:33:53.078456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.532 [2024-12-16 14:33:53.078464] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.532 [2024-12-16 14:33:53.078470] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.532 [2024-12-16 14:33:53.080357] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.532 [2024-12-16 14:33:53.089924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.532 [2024-12-16 14:33:53.090259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.090466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.532 [2024-12-16 14:33:53.090477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.532 [2024-12-16 14:33:53.090484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.532 [2024-12-16 14:33:53.090624] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.532 [2024-12-16 14:33:53.090781] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.532 [2024-12-16 14:33:53.090789] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.532 [2024-12-16 14:33:53.090796] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.532 [2024-12-16 14:33:53.092568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.532 EAL: No free 2048 kB hugepages reported on node 1 00:29:38.793 [2024-12-16 14:33:53.101955] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.793 [2024-12-16 14:33:53.102348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.793 [2024-12-16 14:33:53.102569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.793 [2024-12-16 14:33:53.102580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.793 [2024-12-16 14:33:53.102588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.793 [2024-12-16 14:33:53.102687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.793 [2024-12-16 14:33:53.102801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.793 [2024-12-16 14:33:53.102809] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.793 [2024-12-16 14:33:53.102816] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.793 [2024-12-16 14:33:53.104594] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.793 [2024-12-16 14:33:53.113808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.793 [2024-12-16 14:33:53.114179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.793 [2024-12-16 14:33:53.114337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.793 [2024-12-16 14:33:53.114347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.793 [2024-12-16 14:33:53.114355] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.793 [2024-12-16 14:33:53.114454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.793 [2024-12-16 14:33:53.114583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.793 [2024-12-16 14:33:53.114591] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.793 [2024-12-16 14:33:53.114597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.793 [2024-12-16 14:33:53.116293] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.793 [2024-12-16 14:33:53.125720] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.793 [2024-12-16 14:33:53.126040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.793 [2024-12-16 14:33:53.126269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.793 [2024-12-16 14:33:53.126280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.126287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.126383] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.126479] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.126490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.126496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.128208] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.132240] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:29:38.794 [2024-12-16 14:33:53.137633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.137947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.138177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.138188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.138196] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.138350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.138463] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.138472] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.138478] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.140094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.149491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.149848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.150081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.150092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.150100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.150225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.150337] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.150346] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.150353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.152079] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.161155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.161531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.161700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.161712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.161719] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.161830] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.161946] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.161959] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.161965] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.163692] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.172982] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.173313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.173523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.173534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.173543] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.173682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.173795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.173803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.173810] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.175515] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.184858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.185248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.185492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.185503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.185511] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.185625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.185742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.185751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.185758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.187430] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.196849] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.197193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.197376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.197386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.197393] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.197518] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.197629] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.197637] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.197648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.199449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.206352] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:38.794 [2024-12-16 14:33:53.206449] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:38.794 [2024-12-16 14:33:53.206457] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:38.794 [2024-12-16 14:33:53.206463] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:38.794 [2024-12-16 14:33:53.206505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:29:38.794 [2024-12-16 14:33:53.206561] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:29:38.794 [2024-12-16 14:33:53.206563] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:38.794 [2024-12-16 14:33:53.208858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.209141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.209372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.209383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.209391] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.209491] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.209605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.209613] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.209620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.211398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.220801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.221187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.221338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.221349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.794 [2024-12-16 14:33:53.221357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.794 [2024-12-16 14:33:53.221458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.794 [2024-12-16 14:33:53.221544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.794 [2024-12-16 14:33:53.221552] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.794 [2024-12-16 14:33:53.221558] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.794 [2024-12-16 14:33:53.223267] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.794 [2024-12-16 14:33:53.232758] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.794 [2024-12-16 14:33:53.233160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.794 [2024-12-16 14:33:53.233366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.233378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.233392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.233522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.233664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.233673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.233680] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.235461] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.244822] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.245202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.245347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.245357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.245366] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.245467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.245552] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.245559] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.245567] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.247316] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.256829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.257188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.257350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.257361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.257369] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.257470] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.257601] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.257610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.257619] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.259326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.268875] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.269274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.269377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.269388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.269395] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.269486] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.269644] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.269653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.269660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.271421] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.280885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.281257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.281464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.281475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.281482] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.281597] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.281711] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.281721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.281727] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.283690] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.292884] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.293197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.293402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.293414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.293421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.293521] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.293679] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.293687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.293694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.295456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.304791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.305063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.305217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.305227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.305234] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.305334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.305451] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.305462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.305471] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.306957] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.316587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.316929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.317070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.317081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.317088] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.317174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.317273] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.317280] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.317286] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.319015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.328635] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.328991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.329170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.329181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.329188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.329287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.329401] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.329409] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.329415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.331117] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.795 [2024-12-16 14:33:53.340447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.795 [2024-12-16 14:33:53.340839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.341077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.795 [2024-12-16 14:33:53.341088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.795 [2024-12-16 14:33:53.341095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.795 [2024-12-16 14:33:53.341209] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.795 [2024-12-16 14:33:53.341322] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.795 [2024-12-16 14:33:53.341333] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.795 [2024-12-16 14:33:53.341340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.795 [2024-12-16 14:33:53.343048] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.796 [2024-12-16 14:33:53.352443] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.796 [2024-12-16 14:33:53.352831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.796 [2024-12-16 14:33:53.353044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:38.796 [2024-12-16 14:33:53.353055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:38.796 [2024-12-16 14:33:53.353062] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:38.796 [2024-12-16 14:33:53.353192] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:38.796 [2024-12-16 14:33:53.353306] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:38.796 [2024-12-16 14:33:53.353314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:38.796 [2024-12-16 14:33:53.353321] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:38.796 [2024-12-16 14:33:53.355201] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:38.796 [2024-12-16 14:33:53.364396] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:38.796 [2024-12-16 14:33:53.364753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.364983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.364995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.056 [2024-12-16 14:33:53.365002] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.056 [2024-12-16 14:33:53.365087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.056 [2024-12-16 14:33:53.365200] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.056 [2024-12-16 14:33:53.365209] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.056 [2024-12-16 14:33:53.365215] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.056 [2024-12-16 14:33:53.367020] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.056 [2024-12-16 14:33:53.376416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.056 [2024-12-16 14:33:53.376685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.376839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.376850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.056 [2024-12-16 14:33:53.376862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.056 [2024-12-16 14:33:53.376948] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.056 [2024-12-16 14:33:53.377061] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.056 [2024-12-16 14:33:53.377072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.056 [2024-12-16 14:33:53.377082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.056 [2024-12-16 14:33:53.378785] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.056 [2024-12-16 14:33:53.388353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.056 [2024-12-16 14:33:53.388701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.388930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.388942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.056 [2024-12-16 14:33:53.388949] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.056 [2024-12-16 14:33:53.389049] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.056 [2024-12-16 14:33:53.389177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.056 [2024-12-16 14:33:53.389185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.056 [2024-12-16 14:33:53.389192] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.056 [2024-12-16 14:33:53.390950] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.056 [2024-12-16 14:33:53.400181] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.056 [2024-12-16 14:33:53.400555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.400782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.400792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.056 [2024-12-16 14:33:53.400799] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.056 [2024-12-16 14:33:53.400918] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.056 [2024-12-16 14:33:53.401018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.056 [2024-12-16 14:33:53.401026] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.056 [2024-12-16 14:33:53.401033] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.056 [2024-12-16 14:33:53.402631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.056 [2024-12-16 14:33:53.412098] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.056 [2024-12-16 14:33:53.412483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.412710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.412721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.056 [2024-12-16 14:33:53.412728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.056 [2024-12-16 14:33:53.412813] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.056 [2024-12-16 14:33:53.412960] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.056 [2024-12-16 14:33:53.412969] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.056 [2024-12-16 14:33:53.412975] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.056 [2024-12-16 14:33:53.414646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.056 [2024-12-16 14:33:53.423976] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.056 [2024-12-16 14:33:53.424357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.424562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.424573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.056 [2024-12-16 14:33:53.424580] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.056 [2024-12-16 14:33:53.424679] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.056 [2024-12-16 14:33:53.424807] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.056 [2024-12-16 14:33:53.424815] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.056 [2024-12-16 14:33:53.424821] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.056 [2024-12-16 14:33:53.426555] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.056 [2024-12-16 14:33:53.436061] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.056 [2024-12-16 14:33:53.436403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.436630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.436641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.056 [2024-12-16 14:33:53.436648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.056 [2024-12-16 14:33:53.436777] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.056 [2024-12-16 14:33:53.436895] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.056 [2024-12-16 14:33:53.436903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.056 [2024-12-16 14:33:53.436910] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.056 [2024-12-16 14:33:53.438698] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.056 [2024-12-16 14:33:53.447859] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.056 [2024-12-16 14:33:53.448240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.448410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.056 [2024-12-16 14:33:53.448420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.056 [2024-12-16 14:33:53.448427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.448556] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.448640] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.448648] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.448654] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.450346] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.459889] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.460241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.460442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.460453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.460460] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.460589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.460717] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.460726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.460733] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.462567] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.471970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.472300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.472457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.472467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.472475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.472589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.472731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.472739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.472745] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.474510] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.483978] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.484350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.484570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.484581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.484588] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.484702] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.484830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.484839] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.484845] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.486579] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.495940] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.496267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.496496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.496506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.496513] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.496569] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.496667] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.496674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.496681] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.498459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.507960] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.508280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.508506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.508516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.508523] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.508682] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.508795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.508803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.508809] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.510440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.519801] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.520144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.520371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.520382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.520389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.520517] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.520645] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.520653] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.520660] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.522466] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.531773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.532090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.532252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.532268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.532275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.532375] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.532473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.532480] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.532486] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.534402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.543719] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.544073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.544216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.544226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.544233] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.544347] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.544446] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.544454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.544462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.546123] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.555587] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.555935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.556020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.057 [2024-12-16 14:33:53.556030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.057 [2024-12-16 14:33:53.556038] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.057 [2024-12-16 14:33:53.556138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.057 [2024-12-16 14:33:53.556281] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.057 [2024-12-16 14:33:53.556289] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.057 [2024-12-16 14:33:53.556295] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.057 [2024-12-16 14:33:53.558017] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.057 [2024-12-16 14:33:53.567433] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.057 [2024-12-16 14:33:53.567781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.567984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.567995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.058 [2024-12-16 14:33:53.568005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.058 [2024-12-16 14:33:53.568106] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.058 [2024-12-16 14:33:53.568234] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.058 [2024-12-16 14:33:53.568242] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.058 [2024-12-16 14:33:53.568249] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.058 [2024-12-16 14:33:53.570051] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.058 [2024-12-16 14:33:53.579284] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.058 [2024-12-16 14:33:53.579579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.579806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.579816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.058 [2024-12-16 14:33:53.579823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.058 [2024-12-16 14:33:53.579958] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.058 [2024-12-16 14:33:53.580102] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.058 [2024-12-16 14:33:53.580110] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.058 [2024-12-16 14:33:53.580116] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.058 [2024-12-16 14:33:53.581762] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.058 [2024-12-16 14:33:53.591122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.058 [2024-12-16 14:33:53.591492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.591723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.591734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.058 [2024-12-16 14:33:53.591742] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.058 [2024-12-16 14:33:53.591890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.058 [2024-12-16 14:33:53.591975] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.058 [2024-12-16 14:33:53.591983] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.058 [2024-12-16 14:33:53.591990] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.058 [2024-12-16 14:33:53.593719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.058 [2024-12-16 14:33:53.602968] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.058 [2024-12-16 14:33:53.603317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.603541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.603551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.058 [2024-12-16 14:33:53.603558] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.058 [2024-12-16 14:33:53.603646] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.058 [2024-12-16 14:33:53.603745] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.058 [2024-12-16 14:33:53.603752] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.058 [2024-12-16 14:33:53.603759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.058 [2024-12-16 14:33:53.605459] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.058 [2024-12-16 14:33:53.614897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.058 [2024-12-16 14:33:53.615275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.615450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.615460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.058 [2024-12-16 14:33:53.615467] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.058 [2024-12-16 14:33:53.615567] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.058 [2024-12-16 14:33:53.615680] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.058 [2024-12-16 14:33:53.615687] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.058 [2024-12-16 14:33:53.615694] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.058 [2024-12-16 14:33:53.617497] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.058 [2024-12-16 14:33:53.626908] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.058 [2024-12-16 14:33:53.627271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.627496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.058 [2024-12-16 14:33:53.627507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.058 [2024-12-16 14:33:53.627514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.058 [2024-12-16 14:33:53.627614] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.058 [2024-12-16 14:33:53.627698] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.058 [2024-12-16 14:33:53.627705] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.058 [2024-12-16 14:33:53.627712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.629374] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.638856] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.639248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.639478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.639489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.639496] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.639625] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.639726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.639735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.319 [2024-12-16 14:33:53.639741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.641398] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.650679] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.651047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.651274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.651285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.651292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.651407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.651505] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.651513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.319 [2024-12-16 14:33:53.651519] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.653206] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.662646] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.662968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.663203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.663213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.663221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.663277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.663376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.663383] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.319 [2024-12-16 14:33:53.663389] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.665283] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.674628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.674939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.675165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.675175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.675183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.675342] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.675470] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.675481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.319 [2024-12-16 14:33:53.675488] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.677425] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.686628] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.686978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.687207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.687218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.687225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.687339] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.687466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.687474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.319 [2024-12-16 14:33:53.687480] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.689023] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.698496] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.698812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.699036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.699048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.699055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.699198] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.699315] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.699323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.319 [2024-12-16 14:33:53.699330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.701223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.710414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.710683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.710841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.710851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.710863] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.710992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.711091] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.711099] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.319 [2024-12-16 14:33:53.711108] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.712823] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.722251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.722523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.722673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.722683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.722690] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.722820] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.722923] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.722932] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.319 [2024-12-16 14:33:53.722938] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.319 [2024-12-16 14:33:53.724623] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.319 [2024-12-16 14:33:53.734299] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.319 [2024-12-16 14:33:53.734692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.734849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.319 [2024-12-16 14:33:53.734864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.319 [2024-12-16 14:33:53.734871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.319 [2024-12-16 14:33:53.734986] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.319 [2024-12-16 14:33:53.735128] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.319 [2024-12-16 14:33:53.735136] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.735143] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.737007] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.746185] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.746568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.746725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.746735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.746743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.746861] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.746990] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.746998] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.747004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.748688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.758148] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.758532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.758758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.758769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.758776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.758881] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.759010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.759018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.759025] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.760549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.769981] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.770315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.770523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.770534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.770541] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.770640] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.770739] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.770746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.770752] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.772470] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.781970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.782321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.782552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.782563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.782571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.782671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.782769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.782778] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.782784] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.784447] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.793857] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.794261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.794416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.794427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.794435] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.794549] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.794634] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.794642] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.794648] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.796353] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.805866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.806234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.806459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.806471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.806478] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.806592] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.806707] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.806717] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.806724] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.808372] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.817672] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.817962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.818118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.818130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.818137] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.818252] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.818351] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.818360] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.818366] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.820086] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.829615] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.829963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.830155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.830165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.830173] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.830243] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.830356] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.830363] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.830369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.832157] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.841603] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.841931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.842094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.842106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.320 [2024-12-16 14:33:53.842113] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.320 [2024-12-16 14:33:53.842229] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.320 [2024-12-16 14:33:53.842344] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.320 [2024-12-16 14:33:53.842354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.320 [2024-12-16 14:33:53.842360] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.320 [2024-12-16 14:33:53.844270] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.320 [2024-12-16 14:33:53.853491] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.320 [2024-12-16 14:33:53.853849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.854067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.320 [2024-12-16 14:33:53.854078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.321 [2024-12-16 14:33:53.854085] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.321 [2024-12-16 14:33:53.854185] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.321 [2024-12-16 14:33:53.854269] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.321 [2024-12-16 14:33:53.854276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.321 [2024-12-16 14:33:53.854283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.321 [2024-12-16 14:33:53.856171] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.321 [2024-12-16 14:33:53.865420] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.321 [2024-12-16 14:33:53.865721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.321 [2024-12-16 14:33:53.865977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.321 [2024-12-16 14:33:53.865991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.321 [2024-12-16 14:33:53.865999] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.321 [2024-12-16 14:33:53.866114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.321 [2024-12-16 14:33:53.866213] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.321 [2024-12-16 14:33:53.866221] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.321 [2024-12-16 14:33:53.866227] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.321 [2024-12-16 14:33:53.867897] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.321 [2024-12-16 14:33:53.877346] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.321 [2024-12-16 14:33:53.877695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.321 [2024-12-16 14:33:53.877850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.321 [2024-12-16 14:33:53.877866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.321 [2024-12-16 14:33:53.877874] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.321 [2024-12-16 14:33:53.877974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.321 [2024-12-16 14:33:53.878087] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.321 [2024-12-16 14:33:53.878095] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.321 [2024-12-16 14:33:53.878102] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.321 [2024-12-16 14:33:53.879800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.321 14:33:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:39.321 14:33:53 -- common/autotest_common.sh@862 -- # return 0 00:29:39.321 14:33:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:39.321 14:33:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:39.321 14:33:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.321 [2024-12-16 14:33:53.889268] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.321 [2024-12-16 14:33:53.889649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.321 [2024-12-16 14:33:53.889894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.321 [2024-12-16 14:33:53.889906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.321 [2024-12-16 14:33:53.889913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.321 [2024-12-16 14:33:53.890041] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.321 [2024-12-16 14:33:53.890140] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.321 [2024-12-16 14:33:53.890148] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.321 [2024-12-16 14:33:53.890154] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.580 [2024-12-16 14:33:53.891917] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.580 [2024-12-16 14:33:53.901246] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.580 [2024-12-16 14:33:53.901729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.580 [2024-12-16 14:33:53.901910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.580 [2024-12-16 14:33:53.901922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.580 [2024-12-16 14:33:53.901930] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.580 [2024-12-16 14:33:53.902059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.580 [2024-12-16 14:33:53.902143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.580 [2024-12-16 14:33:53.902150] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.580 [2024-12-16 14:33:53.902157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.580 [2024-12-16 14:33:53.903798] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.580 [2024-12-16 14:33:53.913160] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.580 [2024-12-16 14:33:53.913357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.580 [2024-12-16 14:33:53.913473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.580 [2024-12-16 14:33:53.913483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.580 [2024-12-16 14:33:53.913491] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.580 [2024-12-16 14:33:53.913575] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.580 [2024-12-16 14:33:53.913702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.580 [2024-12-16 14:33:53.913710] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.580 [2024-12-16 14:33:53.913716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.580 [2024-12-16 14:33:53.915394] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.580 14:33:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:39.580 14:33:53 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:29:39.580 14:33:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.580 14:33:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.580 [2024-12-16 14:33:53.921639] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:39.580 [2024-12-16 14:33:53.925091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.580 [2024-12-16 14:33:53.925311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.580 [2024-12-16 14:33:53.925469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.580 [2024-12-16 14:33:53.925479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.580 [2024-12-16 14:33:53.925486] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.580 [2024-12-16 14:33:53.925601] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.581 [2024-12-16 14:33:53.925685] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.581 [2024-12-16 14:33:53.925692] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.581 [2024-12-16 14:33:53.925698] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.581 14:33:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.581 14:33:53 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:39.581 14:33:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.581 [2024-12-16 14:33:53.927437] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.581 14:33:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.581 [2024-12-16 14:33:53.937066] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.581 [2024-12-16 14:33:53.937448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.581 [2024-12-16 14:33:53.937723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.581 [2024-12-16 14:33:53.937734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.581 [2024-12-16 14:33:53.937741] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.581 [2024-12-16 14:33:53.937841] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.581 [2024-12-16 14:33:53.937973] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.581 [2024-12-16 14:33:53.937982] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.581 [2024-12-16 14:33:53.937989] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.581 [2024-12-16 14:33:53.939819] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.581 [2024-12-16 14:33:53.949038] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.581 [2024-12-16 14:33:53.949287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.581 [2024-12-16 14:33:53.949465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.581 [2024-12-16 14:33:53.949476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.581 [2024-12-16 14:33:53.949484] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.581 [2024-12-16 14:33:53.949613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.581 [2024-12-16 14:33:53.949755] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.581 [2024-12-16 14:33:53.949764] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.581 [2024-12-16 14:33:53.949770] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.581 [2024-12-16 14:33:53.951549] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.581 Malloc0 00:29:39.581 14:33:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.581 14:33:53 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:39.581 14:33:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.581 14:33:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.581 [2024-12-16 14:33:53.961021] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.581 [2024-12-16 14:33:53.961339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.581 [2024-12-16 14:33:53.961447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.581 [2024-12-16 14:33:53.961458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.581 [2024-12-16 14:33:53.961465] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.581 [2024-12-16 14:33:53.961565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.581 [2024-12-16 14:33:53.961683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.581 [2024-12-16 14:33:53.961691] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.581 [2024-12-16 14:33:53.961697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.581 [2024-12-16 14:33:53.963519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.581 14:33:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.581 14:33:53 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:39.581 14:33:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.581 14:33:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.581 [2024-12-16 14:33:53.972914] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.581 [2024-12-16 14:33:53.973267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.581 [2024-12-16 14:33:53.973428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:39.581 [2024-12-16 14:33:53.973438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x129a2a0 with addr=10.0.0.2, port=4420 00:29:39.581 [2024-12-16 14:33:53.973446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x129a2a0 is same with the state(5) to be set 00:29:39.581 [2024-12-16 14:33:53.973618] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x129a2a0 (9): Bad file descriptor 00:29:39.581 [2024-12-16 14:33:53.973731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:29:39.581 [2024-12-16 14:33:53.973739] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:29:39.581 [2024-12-16 14:33:53.973746] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:29:39.581 [2024-12-16 14:33:53.975452] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:39.581 14:33:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.581 14:33:53 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:39.581 14:33:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:39.581 14:33:53 -- common/autotest_common.sh@10 -- # set +x 00:29:39.581 [2024-12-16 14:33:53.980171] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:39.581 [2024-12-16 14:33:53.984651] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:29:39.581 14:33:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:39.581 14:33:53 -- host/bdevperf.sh@38 -- # wait 547423 00:29:39.581 [2024-12-16 14:33:54.131497] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:29:49.555 00:29:49.555 Latency(us) 00:29:49.555 [2024-12-16T13:34:04.129Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.555 [2024-12-16T13:34:04.129Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:29:49.555 Verification LBA range: start 0x0 length 0x4000 00:29:49.555 Nvme1n1 : 15.01 12803.34 50.01 20314.57 0.00 3853.48 487.62 22594.32 00:29:49.555 [2024-12-16T13:34:04.129Z] =================================================================================================================== 00:29:49.555 [2024-12-16T13:34:04.129Z] Total : 12803.34 50.01 20314.57 0.00 3853.48 487.62 22594.32 00:29:49.555 14:34:02 -- host/bdevperf.sh@39 -- # sync 00:29:49.555 14:34:02 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:29:49.555 14:34:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:49.555 14:34:02 -- common/autotest_common.sh@10 -- # set +x 00:29:49.555 14:34:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:49.555 14:34:02 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:29:49.555 14:34:02 -- host/bdevperf.sh@44 -- # nvmftestfini 00:29:49.555 14:34:02 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:49.555 14:34:02 -- nvmf/common.sh@116 -- # sync 00:29:49.555 14:34:02 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:49.555 14:34:02 -- nvmf/common.sh@119 -- # set +e 00:29:49.555 14:34:02 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:49.555 14:34:02 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:49.555 rmmod nvme_tcp 00:29:49.555 rmmod nvme_fabrics 00:29:49.555 rmmod nvme_keyring 00:29:49.555 14:34:02 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:49.555 14:34:02 -- nvmf/common.sh@123 -- # set -e 00:29:49.555 14:34:02 -- nvmf/common.sh@124 -- # return 0 00:29:49.555 14:34:02 -- nvmf/common.sh@477 -- # '[' -n 548443 ']' 00:29:49.555 14:34:02 -- nvmf/common.sh@478 -- # killprocess 548443 00:29:49.555 14:34:02 -- common/autotest_common.sh@936 -- # '[' -z 548443 ']' 00:29:49.555 14:34:02 -- common/autotest_common.sh@940 -- # kill -0 548443 00:29:49.555 14:34:02 -- common/autotest_common.sh@941 -- # uname 00:29:49.555 14:34:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:49.555 14:34:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 548443 00:29:49.555 14:34:02 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:49.555 14:34:02 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:49.555 14:34:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 548443' 00:29:49.555 killing process with pid 548443 00:29:49.555 14:34:02 -- common/autotest_common.sh@955 -- # kill 548443 00:29:49.555 14:34:02 -- common/autotest_common.sh@960 -- # wait 548443 00:29:49.555 14:34:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:49.555 14:34:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:49.555 14:34:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:49.555 14:34:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:49.555 14:34:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:49.555 14:34:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:49.555 14:34:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:49.555 14:34:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:50.523 14:34:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:50.523 00:29:50.523 real 0m26.356s 00:29:50.523 user 1m3.155s 00:29:50.523 sys 0m6.475s 00:29:50.857 14:34:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:50.857 14:34:05 -- common/autotest_common.sh@10 -- # set +x 00:29:50.857 ************************************ 00:29:50.857 END TEST nvmf_bdevperf 00:29:50.857 ************************************ 00:29:50.857 14:34:05 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:29:50.857 14:34:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:50.857 14:34:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:50.857 14:34:05 -- common/autotest_common.sh@10 -- # set +x 00:29:50.857 ************************************ 00:29:50.857 START TEST nvmf_target_disconnect 00:29:50.857 ************************************ 00:29:50.857 14:34:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:29:50.857 * Looking for test storage... 00:29:50.857 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:50.857 14:34:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:50.857 14:34:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:50.857 14:34:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:50.857 14:34:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:50.857 14:34:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:50.857 14:34:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:50.857 14:34:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:50.857 14:34:05 -- scripts/common.sh@335 -- # IFS=.-: 00:29:50.857 14:34:05 -- scripts/common.sh@335 -- # read -ra ver1 00:29:50.857 14:34:05 -- scripts/common.sh@336 -- # IFS=.-: 00:29:50.857 14:34:05 -- scripts/common.sh@336 -- # read -ra ver2 00:29:50.857 14:34:05 -- scripts/common.sh@337 -- # local 'op=<' 00:29:50.857 14:34:05 -- scripts/common.sh@339 -- # ver1_l=2 00:29:50.857 14:34:05 -- scripts/common.sh@340 -- # ver2_l=1 00:29:50.857 14:34:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:50.857 14:34:05 -- scripts/common.sh@343 -- # case "$op" in 00:29:50.857 14:34:05 -- scripts/common.sh@344 -- # : 1 00:29:50.857 14:34:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:50.857 14:34:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:50.857 14:34:05 -- scripts/common.sh@364 -- # decimal 1 00:29:50.857 14:34:05 -- scripts/common.sh@352 -- # local d=1 00:29:50.857 14:34:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:50.857 14:34:05 -- scripts/common.sh@354 -- # echo 1 00:29:50.857 14:34:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:50.857 14:34:05 -- scripts/common.sh@365 -- # decimal 2 00:29:50.857 14:34:05 -- scripts/common.sh@352 -- # local d=2 00:29:50.857 14:34:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:50.857 14:34:05 -- scripts/common.sh@354 -- # echo 2 00:29:50.857 14:34:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:50.857 14:34:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:50.857 14:34:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:50.857 14:34:05 -- scripts/common.sh@367 -- # return 0 00:29:50.857 14:34:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:50.857 14:34:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:50.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:50.857 --rc genhtml_branch_coverage=1 00:29:50.857 --rc genhtml_function_coverage=1 00:29:50.857 --rc genhtml_legend=1 00:29:50.857 --rc geninfo_all_blocks=1 00:29:50.857 --rc geninfo_unexecuted_blocks=1 00:29:50.857 00:29:50.857 ' 00:29:50.857 14:34:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:50.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:50.857 --rc genhtml_branch_coverage=1 00:29:50.857 --rc genhtml_function_coverage=1 00:29:50.857 --rc genhtml_legend=1 00:29:50.857 --rc geninfo_all_blocks=1 00:29:50.857 --rc geninfo_unexecuted_blocks=1 00:29:50.857 00:29:50.857 ' 00:29:50.857 14:34:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:50.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:50.857 --rc genhtml_branch_coverage=1 00:29:50.857 --rc genhtml_function_coverage=1 00:29:50.857 --rc genhtml_legend=1 00:29:50.857 --rc geninfo_all_blocks=1 00:29:50.857 --rc geninfo_unexecuted_blocks=1 00:29:50.857 00:29:50.857 ' 00:29:50.857 14:34:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:50.857 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:50.857 --rc genhtml_branch_coverage=1 00:29:50.857 --rc genhtml_function_coverage=1 00:29:50.857 --rc genhtml_legend=1 00:29:50.857 --rc geninfo_all_blocks=1 00:29:50.857 --rc geninfo_unexecuted_blocks=1 00:29:50.857 00:29:50.857 ' 00:29:50.857 14:34:05 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:50.857 14:34:05 -- nvmf/common.sh@7 -- # uname -s 00:29:50.857 14:34:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:50.857 14:34:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:50.857 14:34:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:50.857 14:34:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:50.857 14:34:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:50.857 14:34:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:50.857 14:34:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:50.857 14:34:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:50.857 14:34:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:50.857 14:34:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:50.857 14:34:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:29:50.857 14:34:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:29:50.857 14:34:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:50.857 14:34:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:50.857 14:34:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:50.857 14:34:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:50.857 14:34:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:50.857 14:34:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:50.857 14:34:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:50.857 14:34:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.857 14:34:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.857 14:34:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.857 14:34:05 -- paths/export.sh@5 -- # export PATH 00:29:50.857 14:34:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:50.857 14:34:05 -- nvmf/common.sh@46 -- # : 0 00:29:50.857 14:34:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:50.857 14:34:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:50.857 14:34:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:50.857 14:34:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:50.857 14:34:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:50.857 14:34:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:50.857 14:34:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:50.857 14:34:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:50.858 14:34:05 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:29:50.858 14:34:05 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:29:50.858 14:34:05 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:29:50.858 14:34:05 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:29:50.858 14:34:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:50.858 14:34:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:50.858 14:34:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:50.858 14:34:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:50.858 14:34:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:50.858 14:34:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:50.858 14:34:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:50.858 14:34:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:50.858 14:34:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:50.858 14:34:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:50.858 14:34:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:50.858 14:34:05 -- common/autotest_common.sh@10 -- # set +x 00:29:56.143 14:34:10 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:56.143 14:34:10 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:56.143 14:34:10 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:56.143 14:34:10 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:56.143 14:34:10 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:56.143 14:34:10 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:56.143 14:34:10 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:56.143 14:34:10 -- nvmf/common.sh@294 -- # net_devs=() 00:29:56.143 14:34:10 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:56.143 14:34:10 -- nvmf/common.sh@295 -- # e810=() 00:29:56.143 14:34:10 -- nvmf/common.sh@295 -- # local -ga e810 00:29:56.143 14:34:10 -- nvmf/common.sh@296 -- # x722=() 00:29:56.143 14:34:10 -- nvmf/common.sh@296 -- # local -ga x722 00:29:56.143 14:34:10 -- nvmf/common.sh@297 -- # mlx=() 00:29:56.143 14:34:10 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:56.143 14:34:10 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:56.143 14:34:10 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:56.144 14:34:10 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:56.144 14:34:10 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:56.144 14:34:10 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:56.144 14:34:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:56.144 14:34:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:29:56.144 Found 0000:af:00.0 (0x8086 - 0x159b) 00:29:56.144 14:34:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:56.144 14:34:10 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:29:56.144 Found 0000:af:00.1 (0x8086 - 0x159b) 00:29:56.144 14:34:10 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:56.144 14:34:10 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:56.144 14:34:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.144 14:34:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:56.144 14:34:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.144 14:34:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:29:56.144 Found net devices under 0000:af:00.0: cvl_0_0 00:29:56.144 14:34:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.144 14:34:10 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:56.144 14:34:10 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:56.144 14:34:10 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:56.144 14:34:10 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:56.144 14:34:10 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:29:56.144 Found net devices under 0000:af:00.1: cvl_0_1 00:29:56.144 14:34:10 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:56.144 14:34:10 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:56.144 14:34:10 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:56.144 14:34:10 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:56.144 14:34:10 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:56.144 14:34:10 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:56.144 14:34:10 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:56.144 14:34:10 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:56.144 14:34:10 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:56.144 14:34:10 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:56.144 14:34:10 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:56.144 14:34:10 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:56.144 14:34:10 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:56.144 14:34:10 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:56.144 14:34:10 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:56.144 14:34:10 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:56.144 14:34:10 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:56.144 14:34:10 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:56.144 14:34:10 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:56.144 14:34:10 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:56.144 14:34:10 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:56.144 14:34:10 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:56.144 14:34:10 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:56.144 14:34:10 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:56.144 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:56.144 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.352 ms 00:29:56.144 00:29:56.144 --- 10.0.0.2 ping statistics --- 00:29:56.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:56.144 rtt min/avg/max/mdev = 0.352/0.352/0.352/0.000 ms 00:29:56.144 14:34:10 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:56.144 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:56.144 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:29:56.144 00:29:56.144 --- 10.0.0.1 ping statistics --- 00:29:56.144 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:56.144 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:29:56.144 14:34:10 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:56.144 14:34:10 -- nvmf/common.sh@410 -- # return 0 00:29:56.144 14:34:10 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:56.144 14:34:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:56.144 14:34:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:56.144 14:34:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:56.144 14:34:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:56.144 14:34:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:56.403 14:34:10 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:29:56.403 14:34:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:56.403 14:34:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:56.403 14:34:10 -- common/autotest_common.sh@10 -- # set +x 00:29:56.403 ************************************ 00:29:56.403 START TEST nvmf_target_disconnect_tc1 00:29:56.403 ************************************ 00:29:56.403 14:34:10 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:29:56.403 14:34:10 -- host/target_disconnect.sh@32 -- # set +e 00:29:56.403 14:34:10 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:56.403 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.403 [2024-12-16 14:34:10.843189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.403 [2024-12-16 14:34:10.843363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:56.403 [2024-12-16 14:34:10.843375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1e4ad70 with addr=10.0.0.2, port=4420 00:29:56.403 [2024-12-16 14:34:10.843395] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:56.403 [2024-12-16 14:34:10.843406] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:56.403 [2024-12-16 14:34:10.843412] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:29:56.403 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:29:56.403 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:29:56.403 Initializing NVMe Controllers 00:29:56.403 14:34:10 -- host/target_disconnect.sh@33 -- # trap - ERR 00:29:56.403 14:34:10 -- host/target_disconnect.sh@33 -- # print_backtrace 00:29:56.403 14:34:10 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:29:56.403 14:34:10 -- common/autotest_common.sh@1142 -- # return 0 00:29:56.403 14:34:10 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:29:56.403 14:34:10 -- host/target_disconnect.sh@41 -- # set -e 00:29:56.403 00:29:56.403 real 0m0.094s 00:29:56.404 user 0m0.040s 00:29:56.404 sys 0m0.052s 00:29:56.404 14:34:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:56.404 14:34:10 -- common/autotest_common.sh@10 -- # set +x 00:29:56.404 ************************************ 00:29:56.404 END TEST nvmf_target_disconnect_tc1 00:29:56.404 ************************************ 00:29:56.404 14:34:10 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:29:56.404 14:34:10 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:56.404 14:34:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:56.404 14:34:10 -- common/autotest_common.sh@10 -- # set +x 00:29:56.404 ************************************ 00:29:56.404 START TEST nvmf_target_disconnect_tc2 00:29:56.404 ************************************ 00:29:56.404 14:34:10 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:29:56.404 14:34:10 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:29:56.404 14:34:10 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:29:56.404 14:34:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:56.404 14:34:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:56.404 14:34:10 -- common/autotest_common.sh@10 -- # set +x 00:29:56.404 14:34:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:29:56.404 14:34:10 -- nvmf/common.sh@469 -- # nvmfpid=553391 00:29:56.404 14:34:10 -- nvmf/common.sh@470 -- # waitforlisten 553391 00:29:56.404 14:34:10 -- common/autotest_common.sh@829 -- # '[' -z 553391 ']' 00:29:56.404 14:34:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:56.404 14:34:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:56.404 14:34:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:56.404 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:56.404 14:34:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:56.404 14:34:10 -- common/autotest_common.sh@10 -- # set +x 00:29:56.404 [2024-12-16 14:34:10.927168] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:56.404 [2024-12-16 14:34:10.927206] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:56.404 EAL: No free 2048 kB hugepages reported on node 1 00:29:56.663 [2024-12-16 14:34:10.997715] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:29:56.663 [2024-12-16 14:34:11.072057] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:56.663 [2024-12-16 14:34:11.072167] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:56.663 [2024-12-16 14:34:11.072174] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:56.663 [2024-12-16 14:34:11.072181] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:56.663 [2024-12-16 14:34:11.072484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:29:56.663 [2024-12-16 14:34:11.072572] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:29:56.663 [2024-12-16 14:34:11.072676] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:29:56.663 [2024-12-16 14:34:11.072677] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:29:57.229 14:34:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:57.229 14:34:11 -- common/autotest_common.sh@862 -- # return 0 00:29:57.229 14:34:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:57.229 14:34:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:57.229 14:34:11 -- common/autotest_common.sh@10 -- # set +x 00:29:57.229 14:34:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:57.229 14:34:11 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:29:57.229 14:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.229 14:34:11 -- common/autotest_common.sh@10 -- # set +x 00:29:57.488 Malloc0 00:29:57.488 14:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.488 14:34:11 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:29:57.488 14:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.488 14:34:11 -- common/autotest_common.sh@10 -- # set +x 00:29:57.488 [2024-12-16 14:34:11.825163] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:57.488 14:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.488 14:34:11 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:29:57.488 14:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.488 14:34:11 -- common/autotest_common.sh@10 -- # set +x 00:29:57.488 14:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.488 14:34:11 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:29:57.488 14:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.488 14:34:11 -- common/autotest_common.sh@10 -- # set +x 00:29:57.488 14:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.488 14:34:11 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:29:57.488 14:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.488 14:34:11 -- common/autotest_common.sh@10 -- # set +x 00:29:57.488 [2024-12-16 14:34:11.854201] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:57.488 14:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.488 14:34:11 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:29:57.488 14:34:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:57.488 14:34:11 -- common/autotest_common.sh@10 -- # set +x 00:29:57.488 14:34:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:57.488 14:34:11 -- host/target_disconnect.sh@50 -- # reconnectpid=553581 00:29:57.488 14:34:11 -- host/target_disconnect.sh@52 -- # sleep 2 00:29:57.488 14:34:11 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:29:57.488 EAL: No free 2048 kB hugepages reported on node 1 00:29:59.397 14:34:13 -- host/target_disconnect.sh@53 -- # kill -9 553391 00:29:59.397 14:34:13 -- host/target_disconnect.sh@55 -- # sleep 2 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 [2024-12-16 14:34:13.880931] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 [2024-12-16 14:34:13.881131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Write completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 [2024-12-16 14:34:13.881316] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.397 Read completed with error (sct=0, sc=8) 00:29:59.397 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Read completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 Write completed with error (sct=0, sc=8) 00:29:59.398 starting I/O failed 00:29:59.398 [2024-12-16 14:34:13.881500] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:29:59.398 [2024-12-16 14:34:13.881750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.881966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.881979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.882085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.882307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.882317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.882557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.882749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.882779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.883080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.883271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.883301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.883435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.883556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.883586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.883781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.883901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.883912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.884064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.884169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.884180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.884252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.884502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.884512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.884708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.884956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.884988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.885239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.885423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.885453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.885702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.885891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.885935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.886146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.886244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.886254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.886406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.886598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.886627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.886841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.887005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.887036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.887236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.887411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.887440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.887706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.887860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.887871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.887949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.888090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.888100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.888191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.888281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.888291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.888524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.888614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.888624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.888889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.889102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.889131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.889239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.889381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.889412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.889603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.889675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.889685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.398 qpair failed and we were unable to recover it. 00:29:59.398 [2024-12-16 14:34:13.889852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.398 [2024-12-16 14:34:13.889992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.890002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.890096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.890190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.890200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.890330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.890537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.890546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.890749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.890847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.890862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.891116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.891320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.891350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.891636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.891877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.891910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.892086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.892344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.892375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.892660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.892864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.892895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.893095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.893286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.893317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.893526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.893656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.893686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.893908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.894119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.894149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.894286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.894522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.894552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.894745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.894884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.894894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.895047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.895193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.895204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.895391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.895673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.895703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.895906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.896079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.896109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.896237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.896438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.896468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.896643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.896900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.896933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.897191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.897333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.897362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.897705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.897871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.897882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.898052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.898226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.898255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.898566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.898753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.898763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.898974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.899080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.899090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.899187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.899380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.899390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.899660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.899899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.899910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.899994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.900156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.900166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.399 qpair failed and we were unable to recover it. 00:29:59.399 [2024-12-16 14:34:13.900317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.399 [2024-12-16 14:34:13.900407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.900417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.900504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.900645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.900655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.900870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.900995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.901026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.901306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.901601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.901640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.901933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.902139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.902157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.902270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.902361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.902378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.902566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.902792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.902822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.903056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.903267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.903299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.903474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.903678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.903709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.903919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.904194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.904225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.904362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.904487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.904517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.904698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.904840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.904861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.904971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.905198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.905213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.905321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.905545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.905580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.905775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.905969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.906002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.906133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.906357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.906387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.906647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.906864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.906897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.907086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.907181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.907196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.907271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.907554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.907570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.907753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.907908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.907923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.908085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.908320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.908350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.908553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.908787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.908817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.909088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.909301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.909331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.909544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.909780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.909809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.910011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.910274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.910306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.910442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.910653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.910684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.910944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.911050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.911065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.911285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.911446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.911477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.400 [2024-12-16 14:34:13.911761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.911987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.400 [2024-12-16 14:34:13.912003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.400 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.912092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.912241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.912256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.912370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.912452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.912462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.912618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.912813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.912844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.913031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.913247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.913278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.913516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.913775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.913806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.914058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.914248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.914279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.914439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.914571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.914601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.914878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.915068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.915099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.915286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.915494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.915525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.915799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.916026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.916037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.916253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.916475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.916504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.916733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.916938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.916969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.917198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.917335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.917344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.917603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.917831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.917870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.918081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.918226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.918256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.918394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.918666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.918696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.918869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.919018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.919027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.919175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.919382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.919412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.919549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.919716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.919752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.920014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.920249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.920281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.920594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.920788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.920818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.921003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.921268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.921299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.401 [2024-12-16 14:34:13.921503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.921627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.401 [2024-12-16 14:34:13.921656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.401 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.921884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.922080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.922110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.922366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.922616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.922646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.922902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.923044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.923053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.923154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.923308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.923318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.923393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.923479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.923488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.923623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.923754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.923767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.923862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.924048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.924079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.924287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.924484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.924514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.924779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.925012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.925022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.925221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.925368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.925378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.925625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.925788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.925798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.925902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.926050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.926060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.926189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.926321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.926330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.926536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.926663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.926673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.926820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.926942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.926952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.927099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.927318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.927329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.927477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.927692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.927702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.927954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.928138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.928148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.928291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.928523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.928552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.928804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.928994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.929025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.929215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.929410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.929441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.929653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.929873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.929906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.930078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.930278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.930308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.930497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.930707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.930736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.930970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.931219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.931230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.931380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.931534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.931546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.931743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.931806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.931816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.931946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.932024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.932035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.402 qpair failed and we were unable to recover it. 00:29:59.402 [2024-12-16 14:34:13.932101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.402 [2024-12-16 14:34:13.932244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.932254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.932432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.932606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.932637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.932823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.933040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.933073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.933319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.933444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.933473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.933697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.933932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.933963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.934213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.934359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.934390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.934666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.934864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.934897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.935106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.935286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.935316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.935516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.935782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.935819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.935965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.936077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.936087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.936235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.936443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.936453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.936523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.936591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.936601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.936741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.936915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.936925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.937027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.937162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.937172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.937315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.937426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.937456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.937687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.937933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.937965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.938162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.938353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.938383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.938612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.938813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.938843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.939049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.939246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.939277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.939530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.939789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.939819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.939991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.940086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.940096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.940248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.940352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.940361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.940578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.940726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.940736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.940937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.941173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.941204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.941329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.941589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.941620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.941933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.942112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.942142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.942319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.942535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.942565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.942845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.942999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.943009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.403 [2024-12-16 14:34:13.943099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.943238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.403 [2024-12-16 14:34:13.943248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.403 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.943391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.943556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.943566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.943752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.943897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.943907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.943995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.944094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.944104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.944208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.944308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.944318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.944478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.944606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.944616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.944856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.945115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.945145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.945330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.945592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.945622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.945820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.945908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.945919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.946056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.946184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.946194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.946357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.946508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.946518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.946682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.946970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.947001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.947141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.947242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.947252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.947338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.947441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.947451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.947606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.947765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.947775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.947945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.948042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.948052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.948147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.948389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.948399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.948582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.948810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.948820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.948983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.949174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.949211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.949337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.949532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.949561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.949764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.950020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.950052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.950251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.950446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.950476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.950678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.950901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.950933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.951134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.951315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.951346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.951482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.951753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.951784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.951985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.952119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.952149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.952419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.952710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.952747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.952920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.953118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.953128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.404 [2024-12-16 14:34:13.953274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.953359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.404 [2024-12-16 14:34:13.953370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.404 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.953482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.953652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.953663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.953916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.954068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.954078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.954166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.954310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.954320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.954542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.954689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.954699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.954837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.954986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.954997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.955147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.955375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.955405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.955594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.955814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.955843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.955981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.956095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.956105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.956204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.956355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.956386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.956679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.956983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.957016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.957160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.957304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.957335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.957586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.957720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.957750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.957994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.958199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.958229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.958411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.958530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.958560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.958849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.959131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.959163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.959357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.959604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.959634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.959847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.960044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.960066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.960174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.960319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.960329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.960460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.960643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.960653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.960788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.960883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.960895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.961123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.961275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.961285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.961453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.961546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.961556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.961801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.961934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.961965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.962179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.962331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.962361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.962589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.962723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.962753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.962970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.963141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.963152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.963290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.963421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.963431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.963575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.963726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.963736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.405 qpair failed and we were unable to recover it. 00:29:59.405 [2024-12-16 14:34:13.963962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.405 [2024-12-16 14:34:13.964113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.406 [2024-12-16 14:34:13.964123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.406 qpair failed and we were unable to recover it. 00:29:59.406 [2024-12-16 14:34:13.964344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.406 [2024-12-16 14:34:13.964632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.406 [2024-12-16 14:34:13.964661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.406 qpair failed and we were unable to recover it. 00:29:59.406 [2024-12-16 14:34:13.964901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.406 [2024-12-16 14:34:13.965163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.679 [2024-12-16 14:34:13.965173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.679 qpair failed and we were unable to recover it. 00:29:59.679 [2024-12-16 14:34:13.965401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.679 [2024-12-16 14:34:13.965648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.679 [2024-12-16 14:34:13.965658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.965793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.965938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.965948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.966044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.966205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.966215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.966369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.966563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.966573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.966806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.967129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.967161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.967458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.967650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.967680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.967934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.968061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.968091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.968245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.968430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.968460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.968759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.969002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.969033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.969271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.969343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.969353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.969449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.969669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.969700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.969908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.970094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.970124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.970320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.970545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.970575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.970851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.971041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.971051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.971139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.971289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.971299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.971391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.971480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.971490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.971659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.971796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.971806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.971984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.972201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.972231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.972372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.972498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.972529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.972785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.972961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.972994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.973106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.973195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.973204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.973405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.973659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.973688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.973891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.974101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.974132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.974329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.974526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.974557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.974827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.975013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.975024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.975174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.975258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.975268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.975427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.975688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.975718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.975835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.976015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.976047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.976238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.976541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.976571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.680 qpair failed and we were unable to recover it. 00:29:59.680 [2024-12-16 14:34:13.976768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.680 [2024-12-16 14:34:13.976930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.976940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.977144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.977277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.977286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.977371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.977443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.977453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.977668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.977839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.977849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.977994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.978091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.978101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.978207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.978307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.978317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.978449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.978606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.978616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.978709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.978875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.978885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.979065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.979141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.979151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.979304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.979526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.979556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.979821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.980016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.980047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.980168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.980318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.980330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.980548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.980766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.980776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.980916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.981132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.981142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.981285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.981454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.981464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.981665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.981737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.981747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.981950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.982097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.982107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.982235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.982413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.982423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.982642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.982811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.982821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.983068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.983257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.983288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.983494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.983698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.983728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.983926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.984063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.984098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.984293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.984423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.984453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.984749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.984945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.984977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.985171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.985313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.985323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.985449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.985748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.985778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.986037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.986188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.986198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.986354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.986580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.986610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.986805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.987034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.987067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.681 qpair failed and we were unable to recover it. 00:29:59.681 [2024-12-16 14:34:13.987306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.681 [2024-12-16 14:34:13.987453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.987463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.987661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.987790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.987800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.987965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.988125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.988137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.988294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.988449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.988479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.988774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.988977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.989009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.989177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.989351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.989361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.989451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.989723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.989752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.990013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.990262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.990292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.990554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.990743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.990773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.990979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.991218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.991249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.991507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.991688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.991717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.991976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.992181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.992212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.992402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.992660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.992696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.992892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.993137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.993168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.993357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.993460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.993489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.993763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.994055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.994094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.994187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.994383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.994393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.994665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.994749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.994759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.994899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.995122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.995133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.995297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.995387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.995397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.995596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.995820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.995850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.996118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.996304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.996334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.996467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.996673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.996703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.996899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.997095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.997126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.997332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.997520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.997550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.997842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.997992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.998023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.998244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.998469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.998499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.998718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.998974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.999007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.999271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.999422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.999432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.999515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.999685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.682 [2024-12-16 14:34:13.999695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.682 qpair failed and we were unable to recover it. 00:29:59.682 [2024-12-16 14:34:13.999913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.000153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.000185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.000372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.000593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.000624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.000891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.001152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.001183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.001409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.001669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.001699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.001944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.002159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.002189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.002302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.002401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.002411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.002634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.002802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.002833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.002983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.003127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.003156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.003340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.003569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.003599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.003892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.004137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.004168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.004304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.004499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.004530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.004708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.004944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.004955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.005207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.005499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.005529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.005738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.005912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.005944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.006080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.006324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.006334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.006550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.006630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.006641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.006782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.006927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.006937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.007135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.007296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.007306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.007504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.007673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.007684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.007823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.007982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.007993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.008181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.008345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.008375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.008700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.008958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.008991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.009217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.009398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.009428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.009563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.009735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.009766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.010033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.010145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.010175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.010372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.010657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.010687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.010886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.010995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.011025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.011224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.011352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.011381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.011584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.011780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.011811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.683 qpair failed and we were unable to recover it. 00:29:59.683 [2024-12-16 14:34:14.012028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.683 [2024-12-16 14:34:14.012162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.012172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.012368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.012510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.012519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.012669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.012944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.012976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.013198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.013311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.013342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.013558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.013797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.013827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.014006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.014151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.014160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.014413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.014560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.014570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.014719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.014941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.014973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.015202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.015451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.015462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.015664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.015805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.015815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.016037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.016201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.016231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.016498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.016761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.016791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.016925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.017119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.017152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.017356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.017465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.017495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.017650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.017918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.017949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.018153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.018303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.018313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.018446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.018615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.018645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.018874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.019090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.019122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.019327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.019482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.019493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.019637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.019899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.019932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.020128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.020325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.020355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.020624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.020892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.020924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.021036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.021256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.021287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.021430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.021626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.021656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.684 qpair failed and we were unable to recover it. 00:29:59.684 [2024-12-16 14:34:14.021883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.022092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.684 [2024-12-16 14:34:14.022123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.022268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.022461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.022494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.022740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.022824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.022834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.022990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.023166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.023196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.023329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.023602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.023633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.023807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.023962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.023973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.024137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.024228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.024238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.024379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.024522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.024532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.024606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.024838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.024849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.025046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.025177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.025187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.025414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.025672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.025701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.025998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.026197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.026207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.026359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.026462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.026472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.026652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.026801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.026811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.026894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.027121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.027151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.027282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.027472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.027502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.027701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.027884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.027916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.028103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.028240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.028275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.028499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.028610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.028620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.028757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.029005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.029015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.029084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.029188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.029198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.029377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.029533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.029543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.029746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.030000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.030009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.030187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.030333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.030342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.030562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.030787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.030796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.030949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.031155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.031163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.031305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.031497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.031505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.031667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.031900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.031909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.032079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.032208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.032216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.032359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.032646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.685 [2024-12-16 14:34:14.032656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.685 qpair failed and we were unable to recover it. 00:29:59.685 [2024-12-16 14:34:14.032808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.033042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.033052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.033223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.033298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.033307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.033452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.033621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.033630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.033706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.033962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.033972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.034104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.034358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.034367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.034515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.034665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.034674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.034826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.034905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.034915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.035024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.035106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.035116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.035269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.035350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.035359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.035606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.035830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.035839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.035935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.036048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.036058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.036258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.036460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.036471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.036703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.036886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.036898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.036995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.037102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.037111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.037333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.037495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.037505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.037705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.037858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.037870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.037969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.038131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.038141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.038238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.038320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.038330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.038429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.038622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.038632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.038697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.038913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.038924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.039075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.039225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.039235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.039380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.039547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.039557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.039759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.039830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.039840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.039957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.040042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.040053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.040275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.040510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.040520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.040671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.040824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.040834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.040994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.041090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.041099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.041183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.041311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.041322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.041494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.041642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.041652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.686 qpair failed and we were unable to recover it. 00:29:59.686 [2024-12-16 14:34:14.041863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.041963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.686 [2024-12-16 14:34:14.041973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.042120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.042211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.042223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.042387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.042569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.042580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.042812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.043024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.043034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.043201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.043402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.043412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.043668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.043831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.043842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.043914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.043986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.043996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.044152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.044239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.044249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.044387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.044561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.044571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.044670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.044814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.044824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.044961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.045101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.045111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.045193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.045274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.045286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.045446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.045655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.045664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.045735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.045831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.045841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.046061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.046218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.046229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.046373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.046600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.046610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.046708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.046846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.046859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.046987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.047147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.047157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.047299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.047381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.047391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.047650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.047804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.047814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.047952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.048085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.048094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.048319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.048473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.048485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.048643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.048751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.048761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.049004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.049153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.049163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.049272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.049363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.049373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.049580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.049712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.049722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.049983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.050115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.050125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.050211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.050371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.050381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.050651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.050850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.050865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.051023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.051171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.687 [2024-12-16 14:34:14.051180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.687 qpair failed and we were unable to recover it. 00:29:59.687 [2024-12-16 14:34:14.051331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.051513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.051523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.051619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.051760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.051770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.051915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.051990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.052000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.052071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.052240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.052250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.052510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.052697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.052707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.052871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.053091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.053101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.053270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.053432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.053442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.053704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.053860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.053871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.054028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.054249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.054259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.054497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.054696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.054706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.054857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.054957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.054967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.055117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.055312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.055322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.055429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.055588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.055598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.055838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.055931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.055941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.056111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.056281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.056291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.056422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.056561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.056572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.056699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.056863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.056874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.057024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.057242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.057252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.057400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.057637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.057647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.057872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.057989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.057999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.058176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.058317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.058327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.058411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.058586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.058596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.058805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.059036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.059047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.059140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.059290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.059300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.059515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.059732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.059742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.059916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.060142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.688 [2024-12-16 14:34:14.060152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.688 qpair failed and we were unable to recover it. 00:29:59.688 [2024-12-16 14:34:14.060302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.060518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.060528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.060768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.060985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.060996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.061196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.061397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.061406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.061580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.061722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.061732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.061924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.062103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.062113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.062202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.062397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.062407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.062630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.062716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.062726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.062971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.063137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.063147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.063375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.063519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.063529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.063701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.063843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.063866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.064115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.064350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.064360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.064528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.064635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.064645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.064780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.064975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.064986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.065052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.065158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.065167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.065260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.065482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.065492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.065715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.065909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.065920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.066090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.066241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.066251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.066480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.066621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.066631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.066803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.066960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.066970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.067196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.067338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.067348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.067578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.067732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.067742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.067910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.067990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.068000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.068205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.068364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.068374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.068519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.068749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.068759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.068905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.069146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.069156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.069249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.069323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.069333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.069557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.069705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.069715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.069935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.070063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.070072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.070205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.070442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.070452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.689 qpair failed and we were unable to recover it. 00:29:59.689 [2024-12-16 14:34:14.070616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.689 [2024-12-16 14:34:14.070839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.070849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.071023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.071169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.071179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.071274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.071469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.071479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.071559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.071646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.071656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.071875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.071957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.071966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.072118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.072319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.072329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.072531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.072772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.072782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.072994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.073167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.073177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.073270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.073413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.073423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.073578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.073795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.073805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.073951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.074167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.074177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.074264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.074487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.074497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.074695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.074849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.074862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.074955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.075086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.075096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.075244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.075466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.075476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.075627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.075813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.075823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.075972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.076202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.076212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.076294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.076489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.076499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.076710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.076868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.076879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.077026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.077104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.077114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.077294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.077483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.077493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.077566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.077786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.077795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.078030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.078246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.078256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.078415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.078652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.078662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.078755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.078882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.078893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.079044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.079133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.079143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.079413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.079542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.079552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.079799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.080018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.080028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.080180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.080422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.080431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.690 [2024-12-16 14:34:14.080682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.080892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.690 [2024-12-16 14:34:14.080902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.690 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.080980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.081123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.081133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.081337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.081481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.081491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.081579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.081796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.081806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.081969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.082241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.082251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.082397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.082621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.082631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.082770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.082859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.082870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.083053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.083222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.083233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.083375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.083599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.083609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.083812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.083940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.083951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.084101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.084251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.084260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.084443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.084639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.084648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.084779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.084995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.085005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.085201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.085446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.085456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.085616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.085786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.085796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.085946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.086089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.086099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.086234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.086450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.086461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.086692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.086903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.086913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.087137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.087279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.087290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.087484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.087705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.087716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.087846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.088073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.088084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.088247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.088384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.088394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.088605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.088829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.088839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.089071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.089200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.089210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.089424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.089637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.089647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.089863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.090097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.090108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.090256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.090396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.090406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.090613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.090808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.090818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.091029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.091239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.091249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.091418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.091629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.091639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.691 qpair failed and we were unable to recover it. 00:29:59.691 [2024-12-16 14:34:14.091796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.691 [2024-12-16 14:34:14.092012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.092023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.092154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.092295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.092305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.092528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.092668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.092678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.092826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.093044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.093054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.093292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.093426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.093436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.093662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.093919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.093929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.094134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.094329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.094339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.094402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.094635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.094645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.094875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.095136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.095148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.095315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.095453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.095463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.095684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.095888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.095898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.096117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.096343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.096353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.096516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.096648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.096659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.096813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.097036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.097046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.097121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.097337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.097347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.097593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.097724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.097734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.097960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.098203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.098213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.098355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.098524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.098534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.098752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.098902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.098914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.099059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.099208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.099218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.099484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.099566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.099576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.099712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.099846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.099859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.100011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.100142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.100152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.100329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.100477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.100487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.100613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.100696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.100705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.100849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.100940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.100951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.101077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.101218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.101228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.101369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.101462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.101471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.101687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.101951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.101963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.692 [2024-12-16 14:34:14.102112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.102265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.692 [2024-12-16 14:34:14.102275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.692 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.102405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.102638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.102648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.102779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.102978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.102988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.103205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.103406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.103416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.103556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.103704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.103714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.103922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.104070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.104080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.104293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.104514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.104524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.104720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.104921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.104931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.105059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.105207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.105217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.105305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.105522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.105533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.105630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.105772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.105782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.105934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.106011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.106021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.106169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.106319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.106329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.106415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.106561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.106571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.106734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.106928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.106939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.107178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.107392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.107402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.107626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.107847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.107860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.108131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.108365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.108374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.108457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.108528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.108538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.108710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.108927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.108938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.109026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.109107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.109117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.109339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.109511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.109521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.109715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.109859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.109869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.110086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.110233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.110243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.110485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.110561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.110570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.110811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.111011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.111021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.693 [2024-12-16 14:34:14.111230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.111362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.693 [2024-12-16 14:34:14.111372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.693 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.111596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.111791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.111801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.112021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.112099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.112109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.112332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.112463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.112473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.112656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.112850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.112864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.113002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.113092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.113102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.113234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.113362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.113372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.113573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.113773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.113782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.113912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.114134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.114145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.114291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.114539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.114549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.114698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.114843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.114858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.115084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.115299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.115310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.115590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.115742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.115753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.115903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.116132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.116142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.116368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.116632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.116642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.116781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.116937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.116948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.117114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.117213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.117224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.117371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.117584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.117594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.117736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.117898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.117909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.118111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.118281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.118303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.118526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.118739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.118750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.118971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.119205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.119215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.119365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.119597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.119607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.119786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.120020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.120047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.120190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.120336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.120346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.120546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.120790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.120800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.120947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.121105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.121115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.121313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.121480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.121490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.121657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.121859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.121870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.121967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.122099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.122109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.694 qpair failed and we were unable to recover it. 00:29:59.694 [2024-12-16 14:34:14.122335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.694 [2024-12-16 14:34:14.122481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.122491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.122734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.122903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.122913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.123128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.123294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.123304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.123390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.123642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.123652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.123736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.123882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.123893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.124146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.124310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.124320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.124474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.124671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.124680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.124928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.125087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.125097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.125251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.125381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.125392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.125609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.125826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.125837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.126038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.126257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.126267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.126444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.126613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.126623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.126859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.126987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.126997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.127233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.127443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.127453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.127610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.127821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.127831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.127996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.128202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.128213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.128410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.128623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.128634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.128779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.128927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.128938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.129070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.129290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.129300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.129439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.129515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.129525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.129722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.129865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.129875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.129965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.130252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.130263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.130484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.130657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.130668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.130828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.130909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.130920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.131008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.131174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.131184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.131278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.131500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.131510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.131739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.131928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.131938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.132087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.132237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.132247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.132402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.132643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.132653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.695 [2024-12-16 14:34:14.132872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.132948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.695 [2024-12-16 14:34:14.132959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.695 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.133092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.133305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.133316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.133565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.133696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.133718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.133958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.134179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.134189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.134444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.134686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.134696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.134842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.134994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.135004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.135145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.135363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.135373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.135587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.135766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.135776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.135929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.136004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.136014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.136226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.136424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.136434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.136598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.136729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.136739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.136880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.137011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.137021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.137107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.137270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.137280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.137429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.137578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.137588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.137810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.138054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.138065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.138231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.138455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.138465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.138644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.138860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.138870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.139015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.139213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.139224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.139376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.139528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.139539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.139737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.139959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.139969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.140135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.140335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.140346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.140481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.140644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.140654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.140788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.141012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.141023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.141249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.141379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.141389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.141635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.141774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.141784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.141984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.142205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.142215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.142367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.142520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.142531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.142774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.142909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.142920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.143091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.143224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.143235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.143392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.143561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.143572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.696 qpair failed and we were unable to recover it. 00:29:59.696 [2024-12-16 14:34:14.143728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.696 [2024-12-16 14:34:14.143875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.143886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.144099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.144194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.144204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.144369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.144462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.144472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.144641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.144871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.144881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.145035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.145203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.145213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.145346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.145423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.145433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.145575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.145813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.145823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.145979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.146183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.146194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.146393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.146561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.146571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.146797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.147021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.147032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.147254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.147471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.147481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.147626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.147848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.147863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.147929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.148097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.148109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.148238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.148385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.148395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.148565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.148790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.148800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.149064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.149307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.149318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.149555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.149705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.149715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.149917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.150050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.150060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.150268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.150415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.150425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.150589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.150750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.150760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.150930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.151165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.151176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.151379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.151521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.151532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.151628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.151714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.151724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.151922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.152064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.152075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.152207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.152369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.152379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.152601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.152814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.152826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.697 qpair failed and we were unable to recover it. 00:29:59.697 [2024-12-16 14:34:14.153071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.697 [2024-12-16 14:34:14.153227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.153237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.153402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.153533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.153542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.153761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.153909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.153920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.154118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.154321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.154332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.154544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.154643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.154653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.154794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.154974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.154984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.155135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.155292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.155302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.155451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.155618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.155628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.155786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.155977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.155987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.156179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.156304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.156316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.156466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.156633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.156643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.156863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.157088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.157098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.157248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.157486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.157496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.157645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.157795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.157805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.157978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.158119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.158129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.158406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.158560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.158569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.158719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.158867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.158878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.158952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.159194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.159203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.159349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.159555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.159565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.159628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.159846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.159862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.159945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.160075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.160085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.160304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.160459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.160469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.160629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.160776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.160786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.161031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.161216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.161226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.161518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.161661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.161671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.161801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.162014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.162024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.162256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.162396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.162406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.162564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.162772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.162782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.162976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.163204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.163214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.698 [2024-12-16 14:34:14.163306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.163472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.698 [2024-12-16 14:34:14.163483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.698 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.163632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.163775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.163785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.163991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.164166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.164176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.164400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.164561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.164571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.164768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.164910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.164921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.165069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.165295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.165306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.165498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.165695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.165705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.165802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.165986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.165997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.166142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.166323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.166333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.166530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.166591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.166601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.166842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.167018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.167028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.167176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.167310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.167320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.167452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.167671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.167681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.167846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.167960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.167971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.168190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.168331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.168341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.168516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.168663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.168672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.168842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.168982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.168992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.169144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.169293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.169303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.169516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.169757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.169767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.169917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.170145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.170155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.170283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.170480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.170489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.170689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.170838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.170848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.171106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.171247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.171257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.171407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.171599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.171610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.171812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.172032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.172043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.172175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.172398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.172408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.172627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.172834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.172844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.172926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.173093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.173103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.173363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.173443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.173453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.173666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.173811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.173821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.699 qpair failed and we were unable to recover it. 00:29:59.699 [2024-12-16 14:34:14.173973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.699 [2024-12-16 14:34:14.174072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.174082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.174226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.174438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.174447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.174698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.174906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.174916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.175140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.175360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.175370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.175531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.175691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.175701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.175795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.175941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.175951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.176083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.176300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.176310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.176533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.176663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.176673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.176753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.176894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.176905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.177128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.177260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.177269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.177520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.177756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.177766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.177983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.178205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.178215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.178413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.178491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.178501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.178676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.178808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.178818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.178914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.179112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.179122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.179324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.179541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.179551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.179743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.179953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.179964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.180109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.180263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.180273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.180486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.180622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.180633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.180807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.180998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.181008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.181224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.181435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.181446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.181539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.181685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.181694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.181830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.181929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.181939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.182168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.182387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.182396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.182545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.182739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.182749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.182879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.183041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.183051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.183190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.183267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.183277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.183362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.183517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.183527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.183769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.183831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.700 [2024-12-16 14:34:14.183841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.700 qpair failed and we were unable to recover it. 00:29:59.700 [2024-12-16 14:34:14.183909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.184128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.184138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.184222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.184362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.184372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.184546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.184756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.184766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.185010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.185193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.185203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.185371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.185507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.185516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.185645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.185867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.185877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.186083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.186254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.186264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.186410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.186539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.186548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.186768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.186908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.186918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.187085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.187299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.187309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.187395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.187667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.187677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.187878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.188023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.188033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.188201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.188315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.188335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.188564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.188741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.188757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.188991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.189211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.189226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.189407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.189569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.189585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.189699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.189907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.189923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.190030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.190198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.190214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.190375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.190523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.190540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.190633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.190720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.190735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.190990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.191216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.191226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.191378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.191532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.191542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.191741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.191870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.191881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.192094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.192303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.192313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.192539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.192681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.192690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.192917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.193164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.193174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.193426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.193674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.193684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.193906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.194159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.194169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.194307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.194502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.194512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.701 qpair failed and we were unable to recover it. 00:29:59.701 [2024-12-16 14:34:14.194653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.194892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.701 [2024-12-16 14:34:14.194903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.195062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.195210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.195219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.195395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.195600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.195610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.195700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.195926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.195936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.196154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.196302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.196312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.196458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.196587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.196596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.196742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.196964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.196975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.197196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.197397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.197407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.197572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.197766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.197776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.197881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.198083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.198093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.198304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.198505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.198515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.198578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.198661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.198669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.198738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.198901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.198911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.199142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.199225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.199235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.199430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.199596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.199606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.199831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.200040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.200051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.200277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.200508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.200519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.200683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.200824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.200833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.200986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.201135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.201145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.201314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.201455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.201465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.201686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.201763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.201773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.201993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.202121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.202131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.202352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.202525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.202535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.202750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.202980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.202992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.203212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.203303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.203313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.203502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.203577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.203586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.702 qpair failed and we were unable to recover it. 00:29:59.702 [2024-12-16 14:34:14.203660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.203753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.702 [2024-12-16 14:34:14.203762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.203932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.204088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.204098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.204295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.204514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.204524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.204765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.204924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.204935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.205166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.205340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.205350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.205555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.205754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.205764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.205969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.206124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.206134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.206297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.206498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.206511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.206735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.206886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.206897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.207131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.207261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.207271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.207466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.207607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.207616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.207774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.207865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.207875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.208023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.208264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.208274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.208469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.208627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.208636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.208808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.208956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.208966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.209113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.209185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.209195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.209428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.209579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.209589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.209798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.209946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.209958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.210086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.210320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.210329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.210474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.210623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.210633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.210790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.211008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.211018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.211112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.211268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.211277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.211501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.211638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.211648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.211868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.212072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.212082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.212226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.212465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.212475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.212720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.212813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.212822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.212991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.213118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.213128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.213353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.213496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.213508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.213675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.213820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.213829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.214077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.214152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.703 [2024-12-16 14:34:14.214162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.703 qpair failed and we were unable to recover it. 00:29:59.703 [2024-12-16 14:34:14.214330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.214458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.214468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.214608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.214827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.214838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.214990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.215235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.215245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.215389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.215615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.215624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.215818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.215950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.215960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.216129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.216294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.216303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.216475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.216618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.216628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.216789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.216960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.216971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.217118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.217324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.217334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.217478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.217698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.217708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.217866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.218106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.218115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.218330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.218461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.218471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.218633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.218828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.218838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.219015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.219231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.219241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.219376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.219572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.219582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.219748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.219891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.219901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.220032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.220120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.220130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.220364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.220572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.220581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.220760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.220934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.220945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.221013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.221096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.221106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.221330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.221521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.221531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.221676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.221831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.221841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.222013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.222159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.222169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.222395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.222470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.222479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.222620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.222790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.222800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.222894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.223079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.223110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.223374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.223650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.223679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.223958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.224091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.224101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.224287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.224461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.224491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.704 qpair failed and we were unable to recover it. 00:29:59.704 [2024-12-16 14:34:14.224700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.224874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.704 [2024-12-16 14:34:14.224905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.225150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.225336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.225365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.225616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.225755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.225764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.225898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.226112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.226142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.226413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.226668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.226678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.226846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.226989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.227000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.227160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.227313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.227354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.227628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.227923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.227955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.228095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.228364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.228393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.228585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.228808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.228837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.229112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.229381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.229410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.229594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.229824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.229861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.229996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.230178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.230207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.230417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.230639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.230649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.230803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.231047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.231078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.231342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.231607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.231636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.231905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.232074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.232104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.232348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.232610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.232640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.232901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.233139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.233169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.233425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.233683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.233712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.233952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.234106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.234117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.234339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.234488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.234498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.234683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.234876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.234908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.235152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.235438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.235468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.235634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.235784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.235793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.235955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.236178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.236188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.236385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.236528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.236571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.236866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.237102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.237133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.237388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.237592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.237622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.705 [2024-12-16 14:34:14.237820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.237995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.705 [2024-12-16 14:34:14.238006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.705 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.238218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.238441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.238452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.238625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.238843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.238857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.239024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.239242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.239252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.239475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.239628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.239638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.239873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.240098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.240108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.240287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.240520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.240530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.240703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.240871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.240882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.241103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.241253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.241263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.979 [2024-12-16 14:34:14.241357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.241524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.979 [2024-12-16 14:34:14.241534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.979 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.241732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.241862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.241872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.242135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.242280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.242290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.242420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.242592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.242601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.242798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.243004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.243036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.243276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.243514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.243544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.243766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.243939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.243971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.244264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.244444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.244454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.244585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.244810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.244820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.244974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.245203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.245233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.245484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.245769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.245798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.246117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.246425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.246444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.246593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.246774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.246790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.246924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.247060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.247076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.247177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.247402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.247417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.247628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.247924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.247941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.248081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.248314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.248345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.248573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.248696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.248726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.248971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.249080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.249095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.249327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.249466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.249496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.249784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.250023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.250054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.250229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.250495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.250525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.250775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.250862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.250873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.251103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.251336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.251366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.251551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.251808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.251838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.252028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.252263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.252293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.252555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.252805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.252834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.253035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.253289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.253330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.253579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.253802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.980 [2024-12-16 14:34:14.253811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.980 qpair failed and we were unable to recover it. 00:29:59.980 [2024-12-16 14:34:14.254008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.254094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.254104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.254271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.254437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.254467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.254736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.255018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.255051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.255232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.255441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.255471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.255730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.255898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.255929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.256172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.256384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.256414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.256607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.256871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.256881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.257129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.257345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.257355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.257575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.257775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.257804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.258036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.258300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.258331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.258573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.258701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.258732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.258944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.259146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.259176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.259373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.259546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.259577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.259821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.260079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.260089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.260311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.260483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.260513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.260700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.260982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.261013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.261256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.261442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.261451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.261628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.261701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.261711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.261859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.262009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.262019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.262175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.262370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.262380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.262512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.262674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.262684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.262824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.263053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.263085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.263276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.263566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.263596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.263762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.263934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.263974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.264216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.264461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.264497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.264738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.264888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.264918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.265126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.265374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.265403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.265668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.265835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.265883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.266010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.266265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.981 [2024-12-16 14:34:14.266296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.981 qpair failed and we were unable to recover it. 00:29:59.981 [2024-12-16 14:34:14.266565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.266708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.266718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.266898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.267159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.267189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.267458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.267725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.267735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.267958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.268121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.268156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.268427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.268677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.268706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.268946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.269209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.269239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.269489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.269775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.269804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.270111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.270302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.270331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.270604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.270817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.270826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.270986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.271115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.271124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.271322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.271413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.271422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.271571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.271723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.271733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.271955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.272190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.272220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.272417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.272672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.272707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.272886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.273065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.273095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.273287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.273456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.273486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.273698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.273925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.273956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.274220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.274455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.274485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.274757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.275009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.275042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.275286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.275450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.275480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.275728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.275985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.276016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.276191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.276461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.276491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.276748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.276937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.276967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.277259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.277544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.277578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.277830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.278035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.278045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.278185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.278381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.278391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.278609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.278800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.278829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.982 qpair failed and we were unable to recover it. 00:29:59.982 [2024-12-16 14:34:14.279129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.982 [2024-12-16 14:34:14.279421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.279450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.279753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.280050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.280082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.280382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.280591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.280602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.280675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.280871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.280881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.281119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.281313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.281323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.281464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.281628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.281638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.281782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.281943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.281956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.282185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.282423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.282452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.282565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.282834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.282872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.283085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.283256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.283285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.283421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.283611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.283641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.283876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.284067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.284098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.284209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.284468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.284497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.284732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.284933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.284964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.285167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.285371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.285401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.285673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.285934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.285966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.286210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.286394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.286424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.286696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.286881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.286913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.287096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.287302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.287332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.287605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.287875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.287907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.288082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.288269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.288298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.288500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.288784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.288814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.288991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.289221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.289251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.289438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.289621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.289650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.289873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.290120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.290150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.290420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.290591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.290621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.290882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.291032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.291043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.291254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.291442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.291471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.983 qpair failed and we were unable to recover it. 00:29:59.983 [2024-12-16 14:34:14.291688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.983 [2024-12-16 14:34:14.291995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.292025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.292213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.292471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.292500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.292623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.292805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.292836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.293085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.293275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.293305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.293489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.293672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.293714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.293935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.294146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.294156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.294255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.294400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.294410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.294499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.294693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.294703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.294776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.294910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.294920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.295070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.295283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.295293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.295460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.295684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.295714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.296018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.296210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.296240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.296528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.296764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.296795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.297020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.297195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.297225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.297410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.297670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.297700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.297935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.298177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.298187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.298407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.298609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.298639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.298864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.299145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.299175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.299422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.299589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.299598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.299778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.300005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.300037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.300299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.300490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.300520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.300714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.300941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.300971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.301239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.301501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.301531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.301728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.301989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.302019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.302197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.302478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.984 [2024-12-16 14:34:14.302508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.984 qpair failed and we were unable to recover it. 00:29:59.984 [2024-12-16 14:34:14.302631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.302779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.302800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.302889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.303102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.303112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.303331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.303526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.303536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.303679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.303900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.303911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.304112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.304273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.304302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.304545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.304713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.304742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.305010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.305174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.305184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.305413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.305664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.305695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.305961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.306153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.306182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.306442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.306620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.306649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.306890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.307145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.307175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.307363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.307609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.307639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.307817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.308082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.308114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.308374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.308563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.308593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.308841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.309110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.309139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.309349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.309598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.309629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.309845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.309998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.310029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.310288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.310544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.310573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.310873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.311138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.311168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.311431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.311665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.311694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.311862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.312088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.312117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.312254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.312489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.312518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.312782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.312930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.312940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.313112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.313234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.313266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.313528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.313737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.313766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.313943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.314141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.314171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.314413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.314695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.314705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.314904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.315073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.985 [2024-12-16 14:34:14.315083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.985 qpair failed and we were unable to recover it. 00:29:59.985 [2024-12-16 14:34:14.315181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.315348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.315378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.315572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.315804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.315834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.316104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.316306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.316316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.316524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.316677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.316687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.316952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.317198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.317227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.317488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.317722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.317751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.317998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.318209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.318219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.318366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.318591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.318600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.318836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.319049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.319079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.319266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.319444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.319473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.319738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.319850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.319889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.320159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.320292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.320322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.320605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.320787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.320817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.321022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.321209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.321239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.321529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.321792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.321821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.322113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.322303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.322333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.322530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.322733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.322763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.323005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.323265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.323295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.323544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.323776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.323786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.324000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.324157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.324187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.324463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.324742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.324771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.325047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.325257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.325286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.325551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.325787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.325828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.325972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.326203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.326233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.326424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.326596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.326626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.326793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.326930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.326940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.327081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.327275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.327284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.327563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.327820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.327829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.986 qpair failed and we were unable to recover it. 00:29:59.986 [2024-12-16 14:34:14.327977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.986 [2024-12-16 14:34:14.328118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.328128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.328275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.328425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.328434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.328664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.328795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.328804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.329007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.329247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.329276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.329453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.329632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.329661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.329931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.330193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.330223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.330491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.330733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.330743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.330985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.331125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.331134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.331368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.331544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.331574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.331872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.332066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.332096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.332353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.332588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.332619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.332809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.332985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.333017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.333285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.333486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.333516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.333778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.333924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.333934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.334063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.334152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.334161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.334357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.334505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.334514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.334580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.334746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.334756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.334904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.335037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.335047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.335128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.335326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.335338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.335499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.335657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.335687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.335927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.336256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.336286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.336556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.336802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.336831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.337132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.337336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.337365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.337486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.337724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.337753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.338017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.338223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.338252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.338379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.338612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.338642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.338904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.339092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.339122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.339303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.339504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.339534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.339802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.340094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.987 [2024-12-16 14:34:14.340132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.987 qpair failed and we were unable to recover it. 00:29:59.987 [2024-12-16 14:34:14.340329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.340516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.340546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.340758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.340875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.340885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.341136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.341301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.341331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.341524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.341784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.341814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.342093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.342261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.342290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.342556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.342738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.342747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.342986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.343117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.343127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.343343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.343537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.343567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.343813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.344008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.344040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.344281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.344534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.344569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.344747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.344872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.344882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.345030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.345189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.345199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.345347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.345428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.345438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.345503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.345724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.345734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.345890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.346123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.346152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.346272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.346522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.346551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.346835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.346988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.346999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.347228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.347411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.347441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.347628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.347879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.347890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.348112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.348195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.348206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.348337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.348508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.348518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.348676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.348832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.348875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.349080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.349353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.349382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.988 qpair failed and we were unable to recover it. 00:29:59.988 [2024-12-16 14:34:14.349600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.349870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.988 [2024-12-16 14:34:14.349902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.350191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.350477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.350507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.350752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.350937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.350968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.351233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.351510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.351540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.351718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.351818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.351847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.352056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.352273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.352284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.352443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.352573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.352583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.352726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.352867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.352877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.352970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.353123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.353133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.353353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.353511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.353521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.353670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.353910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.353941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.354244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.354488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.354518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.354787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.354952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.354962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.355190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.355385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.355395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.355618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.355765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.355775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.355997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.356256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.356286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.356480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.356762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.356791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.357062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.357300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.357310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.357509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.357723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.357732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.357971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.358255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.358284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.358476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.358661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.358690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.358876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.359100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.359110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.359246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.359444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.359454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.359688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.359972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.360004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.360239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.360369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.989 [2024-12-16 14:34:14.360379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.989 qpair failed and we were unable to recover it. 00:29:59.989 [2024-12-16 14:34:14.360520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.360739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.360748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.360885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.361027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.361037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.361172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.361405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.361434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.361622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.361891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.361923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.362185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.362399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.362409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.362555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.362757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.362767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.363009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.363234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.363263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.363528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.363768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.363778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.364023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.364232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.364242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.364466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.364598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.364608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.364736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.364864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.364874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.365017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.365159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.365169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.365316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.365467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.365477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.365784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.365975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.366006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.366223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.366394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.366423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.366602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.366795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.366824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.367071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.367161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.367170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.367407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.367666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.367695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.367963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.368227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.368257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.368385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.368640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.368670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.368940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.369200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.369230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.369417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.369674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.369703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.369975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.370177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.370206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.370474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.370711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.370741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.371003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.371228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.371238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.371380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.371635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.371665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.371874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.372006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.372036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.372302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.372596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.372625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.372869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.373050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.990 [2024-12-16 14:34:14.373081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.990 qpair failed and we were unable to recover it. 00:29:59.990 [2024-12-16 14:34:14.373345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.373534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.373564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.373688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.373927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.373958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.374239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.374416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.374445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.374717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.374883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.374893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.375125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.375327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.375357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.375538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.375740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.375769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.376053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.376234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.376263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.376537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.376707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.376736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.376999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.377295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.377324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.377578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.377705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.377736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.377999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.378195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.378225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.378470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.378663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.378693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.378986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.379050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.379059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.379258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.379341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.379351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.379548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.379806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.379835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.380115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.380329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.380358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.380533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.380719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.380748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.380995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.381291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.381321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.381558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.381734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.381743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.381966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.382061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.382071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.382232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.382379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.382388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.382465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.382616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.382626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.382784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.383003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.383013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.383101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.383309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.383319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.383380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.383563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.383573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.383742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.383980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.383990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.384152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.384371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.384381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.991 [2024-12-16 14:34:14.384608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.384671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.991 [2024-12-16 14:34:14.384680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.991 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.384899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.385118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.385128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.385348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.385497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.385507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.385651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.385869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.385880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.386041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.386238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.386248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.386461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.386669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.386679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.386818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.386895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.386905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.387049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.387213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.387223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.387308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.387542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.387552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.387683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.387832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.387841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.387975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.388111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.388121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.388250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.388493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.388503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.388637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.388864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.388875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.389012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.389172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.389182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.389325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.389401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.389411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.389674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.389845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.389858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.390009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.390221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.390231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.390394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.390538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.390548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.390744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.390910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.390920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.391130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.391283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.391293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.391465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.391663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.391673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.391911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.392143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.392153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.392423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.392649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.392659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.392809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.393004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.393014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.393164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.393305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.393314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.393390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.393583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.393593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.393741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.393885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.393895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.394074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.394318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.394328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.992 [2024-12-16 14:34:14.394457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.394622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.992 [2024-12-16 14:34:14.394632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.992 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.394779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.394869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.394879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.395005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.395165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.395174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.395254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.395400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.395410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.395558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.395793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.395803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.396029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.396208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.396219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.396365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.396559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.396569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.396790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.396991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.397001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.397091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.397308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.397318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.397446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.397663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.397673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.397872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.398088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.398098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.398297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.398431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.398441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.398673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.398837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.398847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.399017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.399242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.399252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.399474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.399646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.399655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.399801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.400020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.400031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.400238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.400385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.400395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.400543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.400688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.400698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.400868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.401014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.401026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.401167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.401404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.401414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.401604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.401744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.401754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.402000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.402153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.402163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.993 [2024-12-16 14:34:14.402406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.402627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.993 [2024-12-16 14:34:14.402637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.993 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.402885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.403013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.403023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.403254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.403383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.403393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.403593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.403790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.403801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.403999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.404244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.404254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.404478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.404675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.404685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.404834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.404981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.404994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.405220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.405383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.405393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.405536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.405645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.405654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.405791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.406008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.406019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.406100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.406370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.406380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.406600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.406727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.406737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.406886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.407138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.407148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.407371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.407533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.407543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.407742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.407944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.407955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.408164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.408292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.408301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.408462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.408622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.408633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.408860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.409033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.409042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.409196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.409346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.409356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.409488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.409626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.409636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.409784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.409916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.409926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.410146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.410365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.410375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.410572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.410774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.410784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.410935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.411077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.411086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.411169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.411313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.411322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.411463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.411676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.411685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.411833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.412078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.412091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.412304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.412588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.412598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.412749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.412927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.412937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.994 qpair failed and we were unable to recover it. 00:29:59.994 [2024-12-16 14:34:14.413071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.413267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.994 [2024-12-16 14:34:14.413276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.413444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.413667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.413677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.413809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.413896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.413907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.414065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.414200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.414210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.414432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.414558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.414568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.414708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.414834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.414844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.415121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.415294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.415314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.415572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.415801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.415817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.416004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.416094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.416109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.416323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.416567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.416582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.416674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.416861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.416877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.417110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.417212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.417227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.417329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.417484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.417500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.417732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.417941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.417957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.418129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.418362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.418372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.418533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.418677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.418687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.418895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.419063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.419073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.419298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.419526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.419536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.419692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.419885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.419895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.419965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.420184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.420194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.420356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.420501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.420511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.420598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.420675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.420685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.420917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.421057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.421067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.421138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.421299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.421309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.421537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.421740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.421750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.421975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.422171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.422181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.422330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.422550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.422560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.422645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.422840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.422850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.995 [2024-12-16 14:34:14.423012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.423210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.995 [2024-12-16 14:34:14.423220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.995 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.423414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.423563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.423573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.423795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.423998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.424009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.424159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.424235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.424244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.424390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.424584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.424594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.424791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.424980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.424990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.425123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.425254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.425263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.425412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.425611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.425621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.425873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.426001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.426011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.426198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.426421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.426430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.426560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.426636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.426646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.426787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.427005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.427016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.427108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.427338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.427348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.427545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.427763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.427773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.427996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.428145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.428155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.428386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.428623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.428633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.428831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.429048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.429058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.429280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.429499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.429509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.429733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.429820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.429830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.430053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.430185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.430195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.430392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.430540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.430549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.430626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.430766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.430776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.430847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.430999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.431010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.431078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.431299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.431309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.431478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.431674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.996 [2024-12-16 14:34:14.431685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.996 qpair failed and we were unable to recover it. 00:29:59.996 [2024-12-16 14:34:14.431904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.432123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.432133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.432265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.432462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.432472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.432623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.432778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.432788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.433009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.433247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.433257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.433518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.433647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.433657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.433877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.433971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.433981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.434199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.434349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.434359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.434591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.434804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.434814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.434910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.435129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.435138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.435345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.435497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.435508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.435658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.435784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.435794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.435980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.436197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.436207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.436427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.436637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.436647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.436733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.436954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.436964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.437027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.437266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.437276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.437473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.437625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.437635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.437868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.437937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.437947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.438145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.438229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.438239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.438383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.438608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.438618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.438812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.439014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.439025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.439238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.439379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.439389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.439538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.439764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.439774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.439918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.440067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.440077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.440227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.440357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.440367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.440499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.440681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.440691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.440859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.441020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.441030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.441111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.441326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.441335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.441465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.441599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.441610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.441833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.442009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.442019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.997 qpair failed and we were unable to recover it. 00:29:59.997 [2024-12-16 14:34:14.442126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.997 [2024-12-16 14:34:14.442365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.442375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.442571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.442715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.442725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.442872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.443025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.443035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.443258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.443454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.443464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.443614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.443746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.443755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.443887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.444128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.444138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.444349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.444558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.444568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.444738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.444938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.444948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.445116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.445257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.445266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.445480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.445544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.445555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.445711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.445915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.445925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.446071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.446277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.446287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.446350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.446412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.446420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.446557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.446645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.446655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.446823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.446981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.446991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.447081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.447206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.447216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.447391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.447535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.447545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.447744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.447818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.447828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.447962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.448207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.448217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.448393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.448565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.448575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.448805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.449021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.449032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.449252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.449487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.449496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.449678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.449898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.449908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.998 [2024-12-16 14:34:14.450117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.450333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.998 [2024-12-16 14:34:14.450343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.998 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.450438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.450629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.450639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.450860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.451007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.451017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.451257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.451402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.451414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.451657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.451882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.451892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.452115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.452197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.452207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.452356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.452554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.452564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.452712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.452940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.452950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.453120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.453199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.453209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.453447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.453599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.453609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.453816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.453969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.453980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.454112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.454348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.454358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.454422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.454639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.454650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.454863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.455089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.455100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.455321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.455540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.455550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.455771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.455920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.455930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.456183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.456336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.456346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.456525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.456610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.456620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.456843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.456983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.456993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.457145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.457223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.457233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.457438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.457596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.457606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.457832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.457995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.458005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.458155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.458284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.458293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.458515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.458645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.458657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.458905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.458997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.459007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.459250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.459394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.459404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.459640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.459837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.459847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.460000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.460132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.460142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.460282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.460475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.460485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.460637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.460791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:59.999 [2024-12-16 14:34:14.460800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:29:59.999 qpair failed and we were unable to recover it. 00:29:59.999 [2024-12-16 14:34:14.461041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.461245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.461255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.461453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.461599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.461609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.461708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.461925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.461936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.462189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.462382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.462394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.462570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.462807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.462817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.463017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.463240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.463251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.463398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.463472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.463482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.463679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.463898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.463908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.464069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.464263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.464276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.464526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.464699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.464710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.464859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.465074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.465087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.465243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.465393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.465404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.465606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.465750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.465760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.465915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.466084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.466094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.466170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.466388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.466398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.466547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.466715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.466725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.466864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.467035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.467045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.467286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.467361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.467371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.467522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.467740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.467749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.467981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.468072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.468082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.468250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.468398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.468408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.468481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.468697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.468707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.468930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.469155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.469165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.469386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.469582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.469592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.469685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.469810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.469820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.470017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.470107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.470117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.470337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.470537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.470547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.000 qpair failed and we were unable to recover it. 00:30:00.000 [2024-12-16 14:34:14.470722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.000 [2024-12-16 14:34:14.470862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.470874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.471020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.471161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.471171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.471393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.471632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.471643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.471821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.471982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.471992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.472210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.472380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.472391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.472547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.472780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.472791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.472942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.473015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.473025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.473106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.473289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.473300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.473443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.473587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.473597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.473752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.473971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.473982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.474080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.474345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.474355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.474572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.474737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.474748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.474916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.475070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.475080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.475284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.475426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.475436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.475604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.475813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.475824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.475994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.476142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.476153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.476296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.476442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.476452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.476625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.476706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.476716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.476914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.477070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.477080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.477236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.477381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.477391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.477554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.477782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.477792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.477901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.478034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.478044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.478110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.478241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.478252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.478404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.478551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.478562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.478762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.478959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.478970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.479181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.479343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.479353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.479434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.479627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.479637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.479841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.480097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.480108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.480308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.480407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.480417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.001 qpair failed and we were unable to recover it. 00:30:00.001 [2024-12-16 14:34:14.480622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.001 [2024-12-16 14:34:14.480840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.480851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.481017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.481158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.481168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.481399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.481543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.481553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.481643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.481785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.481796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.481941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.482139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.482149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.482314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.482559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.482569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.482722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.482865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.482877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.483045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.483191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.483201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.483460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.483695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.483705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.483864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.484109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.484120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.484283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.484415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.484425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.484650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.484867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.484877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.484974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.485122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.485133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.485331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.485527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.485537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.485703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.485851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.485867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.486072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.486243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.486253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.486425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.486589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.486599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.486679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.486846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.486861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.487042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.487292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.487303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.487435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.487512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.487522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.487687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.487902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.487913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.488069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.488213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.488223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.488368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.488594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.488604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.488820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.488900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.488911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.489078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.489220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.489231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.489378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.489538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.489549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.489685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.489826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.489837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.489921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.490116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.490127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.490268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.490462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.490472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.002 qpair failed and we were unable to recover it. 00:30:00.002 [2024-12-16 14:34:14.490694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.002 [2024-12-16 14:34:14.490821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.490832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.490960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.491174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.491184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.491406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.491622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.491632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.491852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.491945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.491956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.492136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.492283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.492293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.492369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.492506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.492516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.492666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.492914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.492925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.493080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.493294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.493304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.493530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.493669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.493679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.493922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.494055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.494065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.494148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.494379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.494389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.494575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.494793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.494803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.494900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.495056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.495066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.495338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.495557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.495567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.495815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.496033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.496043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.496127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.496187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.496196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.496397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.496543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.496553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.496777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.496998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.497009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.497169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.497361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.497372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.497435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.497579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.497589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.497830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.497976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.497987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.003 qpair failed and we were unable to recover it. 00:30:00.003 [2024-12-16 14:34:14.498207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.498353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.003 [2024-12-16 14:34:14.498364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.498515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.498647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.498657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.498864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.498933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.498944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.499144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.499383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.499394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.499560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.499720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.499730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.499862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.499956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.499967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.500157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.500304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.500314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.500458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.500602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.500612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.500686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.500926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.500937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.501069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.501158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.501169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.501370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.501581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.501592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.501815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.502031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.502042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.502192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.502369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.502379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.502554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.502770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.502780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.502977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.503043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.503053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.503217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.503297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.503307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.503435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.503592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.503602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.503850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.504119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.504130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.504340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.504555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.504565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.504710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.504860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.504871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.505035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.505110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.505121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.505221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.505360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.505370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.505591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.505806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.505816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.506016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.506108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.506118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.506250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.506388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.506399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.506492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.506634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.506644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.506733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.506976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.506987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.507065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.507207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.507217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.004 [2024-12-16 14:34:14.507349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.507437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.004 [2024-12-16 14:34:14.507450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.004 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.507515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.507644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.507654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.507724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.507816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.507827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.507911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.508004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.508014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.508208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.508307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.508318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.508394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.508592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.508602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.508745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.508938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.508948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.509202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.509343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.509353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.509491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.509548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.509557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.509616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.509682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.509692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.509785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.509931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.509944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.510095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.510396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.510559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.510762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.510922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.510998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.511008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.511083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.511230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.511240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.511497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.511664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.511674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.511735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.511945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.511955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.512093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.512185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.512196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.512351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.512561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.512573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.512723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.512789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.512799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.512949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.513108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.513118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.513249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.513371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.513381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.513470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.513692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.513703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.513773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.513866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.513877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.513962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.514133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.514143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.514219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.514281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.514290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.514421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.514569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.514579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.514663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.514882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.005 [2024-12-16 14:34:14.514894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.005 qpair failed and we were unable to recover it. 00:30:00.005 [2024-12-16 14:34:14.515059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.515193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.515206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.515287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.515418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.515428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.515552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.515699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.515709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.515848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.515934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.515945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.516022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.516188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.516423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.516661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.516906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.516983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.517129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.517228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.517238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.517307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.517369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.517378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.517579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.517779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.517789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.517935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.517993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.518002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.518083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.518217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.518228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.518317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.518532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.518542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.518621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.518781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.518790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.518884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.519049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.519059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.519212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.519349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.519359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.519488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.519652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.519662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.519734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.519878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.519889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.520031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.520116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.520126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.520324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.520462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.520472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.520544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.520605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.520613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.520764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.520909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.520919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.520992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.521086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.521096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.521187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.521263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.521273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.521436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.521576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.521586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.006 qpair failed and we were unable to recover it. 00:30:00.006 [2024-12-16 14:34:14.521647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.521700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.006 [2024-12-16 14:34:14.521708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.521830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.521900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.521910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.521964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.522039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.522048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.522193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.522411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.522421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.522551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.522699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.522709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.522810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.522946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.522957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.523157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.523291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.523301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.523374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.523504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.523514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.523659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.523751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.523761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.523896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.523978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.523988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.524075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.524216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.524226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.524295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.524451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.524461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.524553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.524603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.524612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.524692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.524863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.524873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.525013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.525097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.525107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.525178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.525303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.525313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.525484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.525628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.525639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.525715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.525779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.525788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.525940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.526166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.526332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.526537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.526777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.526867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.526964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.527052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.527063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.527201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.527278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.527287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.007 qpair failed and we were unable to recover it. 00:30:00.007 [2024-12-16 14:34:14.527368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.527438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.007 [2024-12-16 14:34:14.527447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.527535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.527662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.527672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.527807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.527937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.527947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.528020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.528235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.528400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.528555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.528862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.528993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.529143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.529295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.529524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.529828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.529921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.530072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.530143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.530153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.530296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.530365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.530376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.530456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.530546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.530556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.530692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.530831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.530841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.530921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.531123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.531133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.531216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.531285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.531294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.531352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.531425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.531434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.531528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.531632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.531649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.531916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.532003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.532017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.532101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.532257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.532272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.532463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.532639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.532655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.532738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.532833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.532849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.532951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.533026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.533041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.533202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.533411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.533426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.533579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.533732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.533747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.533846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.534041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.534056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.534148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.534221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.534236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.008 qpair failed and we were unable to recover it. 00:30:00.008 [2024-12-16 14:34:14.534444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.534656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.008 [2024-12-16 14:34:14.534671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.534768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.534838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.534858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.535019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.535170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.535185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.535271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.535346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.535361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.535548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.535620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.535635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.535779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.535940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.535956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.536110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.536242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.536253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.536426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.536496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.536506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.536564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.536671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.536682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.536768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.536865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.536875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.537010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.537078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.537091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.537163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.537287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.537298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.009 [2024-12-16 14:34:14.537390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.537533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.009 [2024-12-16 14:34:14.537542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.009 qpair failed and we were unable to recover it. 00:30:00.289 [2024-12-16 14:34:14.537633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.289 [2024-12-16 14:34:14.537723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.289 [2024-12-16 14:34:14.537733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.289 qpair failed and we were unable to recover it. 00:30:00.289 [2024-12-16 14:34:14.537880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.289 [2024-12-16 14:34:14.538012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.289 [2024-12-16 14:34:14.538022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.289 qpair failed and we were unable to recover it. 00:30:00.289 [2024-12-16 14:34:14.538163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.289 [2024-12-16 14:34:14.538299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.538309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.538497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.538591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.538600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.538689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.538840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.538850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.539018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.539099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.539109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.539275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.539335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.539344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.539490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.539653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.539664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.539884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.540081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.540091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.540294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.540440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.540450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.540612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.540759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.540769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.540977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.541113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.541123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.541325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.541459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.541468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.541710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.541953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.541964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.542066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.542210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.542220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.542376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.542506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.542516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.542663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.542736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.542746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.542970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.543163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.543175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.543309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.543450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.543460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.543611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.543679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.543689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.543832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.543977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.543987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.544183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.544337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.544346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.544569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.544642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.544652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.544748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.544966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.544976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.545184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.545320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.545330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.545527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.545746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.545756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.545851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.546117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.546130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.546226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.546440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.546452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.546546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.546785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.546795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.546935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.547151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.547160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.547281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.547481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.547491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.290 qpair failed and we were unable to recover it. 00:30:00.290 [2024-12-16 14:34:14.547710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.290 [2024-12-16 14:34:14.547862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.547872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.548023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.548218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.548229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.548325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.548419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.548429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.548647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.548733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.548743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.548894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.549042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.549051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.549307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.549446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.549456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.549670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.549836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.549846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.550004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.550150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.550160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.550298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.550516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.550526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.550618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.550743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.550753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.550836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.550913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.550923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.551146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.551319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.551329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.551422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.551592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.551601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.551767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.551897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.551907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.552068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.552225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.552235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.552415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.552752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.552762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.552845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.552953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.552962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.553180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.553344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.553354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.553428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.553613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.553623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.553779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.554010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.554021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.554142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.554203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.554212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.554373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.554453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.554463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.554606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.554773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.554782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.554927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.555070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.555080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.555226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.555312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.555322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.555471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.555631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.555640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.555836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.555995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.291 [2024-12-16 14:34:14.556006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.291 qpair failed and we were unable to recover it. 00:30:00.291 [2024-12-16 14:34:14.556237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.556321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.556331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.556417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.556589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.556599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.556677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.556898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.556908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.557011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.557110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.557119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.557197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.557346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.557356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.557540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.557641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.557651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.557819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.557994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.558004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.558231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.558311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.558320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.558466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.558534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.558544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.558713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.558799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.558809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.558973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.559100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.559110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.559208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.559281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.559291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.559424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.559555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.559565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.559755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.559903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.559913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.560077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.560169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.560179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.560332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.560472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.560482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.560680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.560767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.560777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.560877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.561019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.561029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.561204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.561332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.561341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.561497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.561581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.561591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.561827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.561988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.561999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.562204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.562298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.562308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.562495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.562736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.562746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.562915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.563093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.563103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.563298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.563401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.563410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.563588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.563739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.563748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.292 [2024-12-16 14:34:14.563925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.564126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.292 [2024-12-16 14:34:14.564135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.292 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.564343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.564585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.564595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.564757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.564915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.564925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.565024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.565088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.565098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.565269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.565462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.565472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.565536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.565732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.565742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.565911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.566108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.566119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.566213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.566276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.566286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.566392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.566563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.566574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.566663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.566876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.566886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.567022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.567172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.567182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.567394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.567543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.567553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.567715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.567923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.567933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.568159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.568359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.568368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.568543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.568711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.568721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.568897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.568993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.569003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.569139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.569300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.569310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.569535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.569634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.569644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.569843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.570028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.570039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.570198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.570346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.570356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.570554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.570748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.570758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.570970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.571185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.571195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.571332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.571538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.571549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.571695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.571847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.571861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.572035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.572189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.572199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.572297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.572382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.572392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.572564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.572640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.572649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.572727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.572852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.572867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.572962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.573156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.573166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.293 [2024-12-16 14:34:14.573248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.573334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.293 [2024-12-16 14:34:14.573343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.293 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.573554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.573704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.573714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.573873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.574132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.574142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.574208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.574333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.574343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.574454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.574650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.574660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.574823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.574982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.574993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.575088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.575162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.575171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.575305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.575473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.575483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.575633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.575858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.575868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.576075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.576247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.576257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.576481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.576700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.576710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.576859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.577108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.577118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.577336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.577489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.577498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.577639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.577776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.577785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.577872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.578109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.578119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.578271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.578373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.578383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.578558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.578836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.578880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.579099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.579364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.579393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.579635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.579859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.579870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.580030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.580218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.580247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.580425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.580687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.580717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.580979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.581165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.581175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.581352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.581600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.294 [2024-12-16 14:34:14.581630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.294 qpair failed and we were unable to recover it. 00:30:00.294 [2024-12-16 14:34:14.581874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.582042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.582072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.582330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.582468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.582477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.582723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.582929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.582960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.583226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.583401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.583411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.583674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.583736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.583747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.583922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.584169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.584199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.584419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.584599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.584637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.584835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.585081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.585091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.585334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.585588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.585618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.585839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.586007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.586037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.586176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.586352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.586382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.586577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.586754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.586783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.586910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.587090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.587120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.587306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.587492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.587521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.587836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.588107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.588139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.588389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.588654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.588684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.588883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.589145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.589175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.589461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.589624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.589633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.589711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.589878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.589888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.589962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.590112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.590122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.590268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.590395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.590404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.590540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.590756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.590766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.590933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.591157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.591192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.591512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.591719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.591749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.592009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.592177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.592207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.592374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.592608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.592637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.592911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.593101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.295 [2024-12-16 14:34:14.593131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.295 qpair failed and we were unable to recover it. 00:30:00.295 [2024-12-16 14:34:14.593306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.593483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.593512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.593725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.593964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.593995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.594240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.594375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.594385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.594627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.594795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.594824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.595015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.595211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.595240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.595525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.595802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.595837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.596103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.596278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.596307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.596574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.596740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.596770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.596945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.597154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.597184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.597420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.597711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.597740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.597935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.598042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.598071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.598312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.598491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.598501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.598629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.598775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.598784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.598934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.599141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.599151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.599223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.599354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.599384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.599600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.599899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.599935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.600113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.600374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.600403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.600618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.600847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.600889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.601105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.601221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.601251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.601381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.601456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.601466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.601663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.601746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.601756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.601901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.602042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.602051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.602200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.602334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.602343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.602420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.602508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.602518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.602711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.602781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.602790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.602885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.603012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.603024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.603222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.603351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.603361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.603444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.603518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.603528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.603750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.603833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.603843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.296 qpair failed and we were unable to recover it. 00:30:00.296 [2024-12-16 14:34:14.603924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.296 [2024-12-16 14:34:14.604082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.604091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.604219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.604344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.604353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.604486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.604634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.604644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.604722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.604792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.604804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.604872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.605129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.605139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.605305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.605438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.605467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.605640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.605754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.605783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.605924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.606129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.606159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.606404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.606515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.606545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.606720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.606863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.606873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.606966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.607044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.607053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.607275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.607436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.607471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.607650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.607818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.607848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.607970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.608153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.608183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.608358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.608543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.608572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.608700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.608872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.608903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.609086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.609350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.609380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.609655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.609838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.609889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.610095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.610211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.610240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.610491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.610638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.610648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.610895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.611029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.611059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.611337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.611520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.611550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.611683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.611884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.611915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.612111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.612367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.612397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.612517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.612713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.612742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.612937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.613220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.613251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.613422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.613502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.613512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.297 qpair failed and we were unable to recover it. 00:30:00.297 [2024-12-16 14:34:14.613665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.613748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.297 [2024-12-16 14:34:14.613757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.613838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.613974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.613985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.614138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.614300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.614329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.614563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.614645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.614655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.614809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.614910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.614920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.615006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.615156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.615166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.615305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.615445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.615455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.615601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.615752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.615762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.615838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.615941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.615952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.616093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.616230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.616240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.616318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.616396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.616417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.616561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.616713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.616723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.616790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.616877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.616904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.616962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.617204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.617427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.617714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.617867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.617972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.618038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.618121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.618130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.618351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.618516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.618526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.618612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.618718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.618728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.618803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.618866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.618875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.618956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.619048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.619058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.619208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.619417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.619446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.619633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.619751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.619780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.619914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.620184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.620214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.620408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.620507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.620536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.298 [2024-12-16 14:34:14.620734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.620867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.298 [2024-12-16 14:34:14.620877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.298 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.621025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.621111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.621120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.621189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.621411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.621421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.621576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.621709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.621739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.621873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.622113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.622142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.622338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.622544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.622573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.622760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.622937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.622969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.623081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.623268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.623298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.623420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.623686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.623715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.623835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.624024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.624054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.624248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.624377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.624407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.624504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.624644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.624654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.624747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.624866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.624876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.625096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.625271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.625300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.625435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.625550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.625580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.625829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.625958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.625968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.626183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.626392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.626421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.626666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.626864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.626874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.627018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.627114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.627124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.627345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.627523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.627552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.627767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.627878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.627909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.628104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.628228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.628264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.628352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.628523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.628533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.628662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.628729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.628739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.299 qpair failed and we were unable to recover it. 00:30:00.299 [2024-12-16 14:34:14.628875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.299 [2024-12-16 14:34:14.629109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.629139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.629274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.629511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.629540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.629713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.629898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.629909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.630061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.630138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.630148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.630251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.630312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.630322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.630460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.630547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.630557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.630731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.630897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.630907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.631105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.631246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.631256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.631405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.631553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.631563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.631636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.631809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.631819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.631965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.632158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.632168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.632261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.632343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.632353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.632486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.632674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.632683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.632762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.632839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.632849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.632986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.633071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.633081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.633253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.633382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.633392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.633522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.633597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.633607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.633675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.633886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.633897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.634041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.634135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.634145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.634280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.634349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.634359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.634436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.634566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.634576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.634672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.634817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.634826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.635010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.635105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.635115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.635285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.635379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.635389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.635463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.635601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.635611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.635743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.635901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.635911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.300 qpair failed and we were unable to recover it. 00:30:00.300 [2024-12-16 14:34:14.636120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.300 [2024-12-16 14:34:14.636218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.636228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.636306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.636372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.636380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.636523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.636588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.636597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.636779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.636849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.636865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.636945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.637026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.637036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.637110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.637191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.637201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.637273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.637411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.637421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.637659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.637792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.637802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.637937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.638010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.638019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.638165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.638365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.638375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.638571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.638668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.638678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.638830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.638914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.638924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.639058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.639141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.639151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.639291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.639425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.639435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.639634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.639783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.639793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.639889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.640053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.640063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.640204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.640280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.640290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.640467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.640655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.640664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.640806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.640883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.640893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.641137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.641217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.641227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.641475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.641616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.641626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.641710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.641869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.641880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.641965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.642125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.642334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.642690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.642903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.642994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.643075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.643149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.643159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.643383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.643445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.643455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.301 [2024-12-16 14:34:14.643601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.643751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.301 [2024-12-16 14:34:14.643762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.301 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.643863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.643952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.643962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.644030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.644176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.644186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.644269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.644330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.644338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.644474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.644538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.644549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.644692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.644774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.644784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.644853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.645199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.645398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.645612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.645780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.645880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.646049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.646145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.646155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.646241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.646296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.646314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.646475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.646534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.646542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.646697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.646847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.646863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.647000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.647253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.647391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.647658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.647798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.647937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.648001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.648080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.648089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.648301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.648373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.648383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.648451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.648601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.648611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.648753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.648847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.648862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.649018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.649165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.649175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.649344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.649426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.649435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.649514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.649590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.649600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.649683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.649819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.649829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.650004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.650141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.650151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.302 [2024-12-16 14:34:14.650351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.650501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.302 [2024-12-16 14:34:14.650511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.302 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.650590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.650678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.650688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.650829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.650964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.650974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.651070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.651283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.651472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.651649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.651821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.651965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.652058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.652201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.652210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.652284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.652490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.652500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.652582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.652665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.652674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.652743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.652900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.652910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.652985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.653064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.653074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.653163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.653324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.653334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.653497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.653641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.653652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.653825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.653899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.653909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.654045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.654191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.654201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.654273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.654371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.654380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.654459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.654612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.654623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.654701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.654771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.654782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.654868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.655079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.655250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.655460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.655706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.655914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.656009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.656087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.656098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.656189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.656263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.656273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.303 qpair failed and we were unable to recover it. 00:30:00.303 [2024-12-16 14:34:14.656368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.656446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.303 [2024-12-16 14:34:14.656456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.656602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.656730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.656740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.656888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.656983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.656993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.657068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.657234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.657244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.657323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.657454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.657464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.657544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.657605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.657615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.657746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.657888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.657899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.657965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.658073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.658082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.658212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.658343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.658353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.658566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.658632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.658642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.658710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.658784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.658794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.658877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.659011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.659022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.659116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.659191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.659201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.659364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.659509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.659519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.659595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.659723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.659732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.659816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.660035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.660045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.660130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.660270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.660280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.660373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.660538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.660548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.660687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.660851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.660868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.661021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.661191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.661201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.661279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.661421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.661431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.661583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.661671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.661681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.661817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.661894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.661904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.661981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.662040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.662049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.662149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.662224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.662234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.662303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.662378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.662387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.662511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.662704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.662714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.662862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.663089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.304 [2024-12-16 14:34:14.663099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.304 qpair failed and we were unable to recover it. 00:30:00.304 [2024-12-16 14:34:14.663243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.663312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.663321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.663549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.663632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.663642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.663770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.663926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.663936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.664089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.664261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.664271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.664332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.664394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.664403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.664535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.664607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.664616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.664762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.664910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.664920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.665022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.665193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.665203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.665278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.665349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.665358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.665554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.665643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.665652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.665746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.665876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.665887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.665980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.666139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.666426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.666612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.666905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.666991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.667096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.667250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.667449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.667601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.667830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.667918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.668058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.668135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.668145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.668211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.668350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.668359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.668491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.668576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.668585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.668729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.668808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.668818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.668949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.669096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.669106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.669236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.669366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.669376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.669505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.669581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.669590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.669659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.669730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.669740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.305 qpair failed and we were unable to recover it. 00:30:00.305 [2024-12-16 14:34:14.669830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.305 [2024-12-16 14:34:14.670011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.670021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.670151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.670292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.670302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.670434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.670529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.670539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.670673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.670825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.670835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.671040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.671270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.671280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.671374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.671444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.671454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.671542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.671684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.671694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.671764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.671852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.671866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.671952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.672082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.672091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.672174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.672259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.672268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.672412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.672561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.672571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.672705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.672968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.672978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.673122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.673203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.673213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.673307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.673400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.673409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.673565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.673708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.673718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.673789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.673852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.673866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.674003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.674176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.674370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.674521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.674802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.674899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.674989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.675137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.675283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.675423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.675642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.675732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.675807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.676004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.676014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.676208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.676363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.676372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.676447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.676537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.676546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.306 qpair failed and we were unable to recover it. 00:30:00.306 [2024-12-16 14:34:14.676692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.676837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.306 [2024-12-16 14:34:14.676846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.677058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.677200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.677210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.677342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.677435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.677445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.677525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.677740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.677752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.677898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.677971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.677981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.678064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.678311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.678476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.678651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.678803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.678993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.679065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.679249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.679409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.679579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.679802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.679958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.680049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.680111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.680121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.680222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.680423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.680433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.680500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.680661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.680671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.680736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.680867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.680876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.681008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.681173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.681345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.681490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.681659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.681834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.681978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.682063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.682157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.682167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.682261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.682353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.682363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.682489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.682580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.682590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.682680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.682813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.682822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.307 [2024-12-16 14:34:14.682890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.683020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.307 [2024-12-16 14:34:14.683030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.307 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.683171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.683310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.683540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.683757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.683924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.683995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.684143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.684339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.684349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.684514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.684588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.684598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.684748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.684811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.684820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.684948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.685145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.685155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.685282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.685353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.685363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.685525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.685749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.685759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.685939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.686100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.686109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.686248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.686337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.686346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.686488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.686632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.686641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.686710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.686794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.686804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.686963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.687107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.687117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.687341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.687419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.687429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.687504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.687738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.687747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.687842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.688222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.688507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.688662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.688848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.308 [2024-12-16 14:34:14.688935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.308 qpair failed and we were unable to recover it. 00:30:00.308 [2024-12-16 14:34:14.689025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.689230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.689391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.689627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.689909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.689983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.690128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.690261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.690270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.690346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.690421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.690430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.690580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.690711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.690721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.690865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.691081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.691290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.691460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.691605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.691825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.691966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.692138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.692216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.692226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.692297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.692358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.692367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.692567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.692700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.692710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.692790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.692915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.692925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.692988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.693058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.693067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.693145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.693299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.693309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.693390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.693461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.693471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.693637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.693778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.693788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.693983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.694060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.694069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.694160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.694242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.694252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.694332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.694527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.694537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.694756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.694883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.694894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.695022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.695084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.695094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.695228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.695320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.695330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.695408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.695482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.309 [2024-12-16 14:34:14.695491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.309 qpair failed and we were unable to recover it. 00:30:00.309 [2024-12-16 14:34:14.695576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.695717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.695727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.695814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.696133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.696362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.696534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.696784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.696931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.697015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.697234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.697243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.697387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.697635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.697645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.697727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.697866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.697876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.698030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.698174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.698183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.698326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.698471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.698480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.698631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.698761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.698770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.698915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.699050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.699060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.699136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.699211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.699221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.699364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.699586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.699596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.699738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.699819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.699828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.699908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.700042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.700052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.700226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.700440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.700449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.700527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.700614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.700623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.700753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.700884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.700894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.701038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.701163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.701173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.701266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.701408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.701417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.701503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.701567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.701576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.701739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.701879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.701889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.702031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.702097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.702106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.702254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.702404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.702414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.702510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.702674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.702684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.702769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.702903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.702913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.703068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.703234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.703244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.310 qpair failed and we were unable to recover it. 00:30:00.310 [2024-12-16 14:34:14.703385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.310 [2024-12-16 14:34:14.703533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.703543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.703624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.703771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.703781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.703908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.703993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.704096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.704325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.704542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.704826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.704972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.705168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.705339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.705349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.705491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.705578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.705588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.705718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.705935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.705945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.706088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.706189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.706199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.706275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.706411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.706421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.706564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.706635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.706651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.706869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.707103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.707264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.707413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.707564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.707803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.707920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.708060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.708136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.708145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.708285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.708391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.708401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.708534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.708594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.708604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.708766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.708826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.708835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.709030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.709167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.709177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.709239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.709383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.709393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.709482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.709628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.709638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.709707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.709880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.709891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.710022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.710113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.710123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.311 qpair failed and we were unable to recover it. 00:30:00.311 [2024-12-16 14:34:14.710204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.311 [2024-12-16 14:34:14.710291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.710301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.710380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.710445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.710454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.710527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.710590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.710598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.710726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.710804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.710814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.710904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.711049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.711058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.711138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.711223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.711232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.711301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.711451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.711461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.711597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.711744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.711754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.711903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.712048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.712058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.712134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.712215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.712224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.712362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.712438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.712448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.712517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.712584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.712593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.712795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.713118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.713357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.713653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.713806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.713894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.713976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.714266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.714573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.714720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.714878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.714997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.715007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.715092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.715232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.715241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.715391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.715468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.715477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.715709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.715797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.715807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.715884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.716105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.716264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.716630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.312 qpair failed and we were unable to recover it. 00:30:00.312 [2024-12-16 14:34:14.716846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.312 [2024-12-16 14:34:14.716952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.717100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.717237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.717247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.717325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.717408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.717417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.717496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.717704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.717714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.717792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.717933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.717943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.718034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.718209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.718219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.718363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.718490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.718501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.718585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.718671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.718680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.718847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.718925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.718934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.719027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.719165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.719334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.719482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.719654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.719798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.719936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.720103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.720398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.720604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.720788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.720871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.720959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.721179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.721320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.721460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.313 [2024-12-16 14:34:14.721626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.313 [2024-12-16 14:34:14.721712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.313 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.721870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.721950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.721960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.722122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.722257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.722267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.722357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.722493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.722505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.722640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.722819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.722829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.722911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.722997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.723007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.723163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.723238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.723247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.723317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.723512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.723522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.723671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.723802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.723812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.723978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.724110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.724120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.724267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.724402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.724412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.724561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.724658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.724668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.724795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.724870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.724880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.725044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.725170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.725180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.725255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.725327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.725336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.725471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.725566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.725576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.725658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.725804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.725814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.725915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.726041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.726051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.726181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.726308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.726317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.726407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.726568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.726577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.726770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.726907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.726916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.727047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.727217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.727227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.727379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.727441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.727450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.727547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.727797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.727807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.727887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.728125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.728421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.728583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.314 [2024-12-16 14:34:14.728753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.314 [2024-12-16 14:34:14.728904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.314 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.729054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.729140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.729149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.729225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.729373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.729383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.729455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.729529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.729539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.729628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.729697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.729707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.729841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.730008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.730018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.730170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.730232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.730241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.730407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.730545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.730555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.730701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.730893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.730904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.731042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.731111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.731120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.731185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.731257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.731266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.731419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.731557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.731566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.731653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.731734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.731744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.731968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.732100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.732110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.732255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.732405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.732415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.732547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.732699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.732709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.732788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.732935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.732945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.733010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.733156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.733166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.733234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.733362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.733371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.733455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.733589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.733598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.733735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.733879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.733889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.733982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.734158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.734363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.734567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.734725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.734887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.734968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.735182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.735192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.735323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.735544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.735554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.735639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.735792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.735802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.735888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.735975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.735985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.315 qpair failed and we were unable to recover it. 00:30:00.315 [2024-12-16 14:34:14.736112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.315 [2024-12-16 14:34:14.736237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.736247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.736328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.736479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.736489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.736630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.736757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.736767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.736910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.737133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.737142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.737309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.737439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.737449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.737644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.737788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.737798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.737945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.738178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.738336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.738663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.738884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.738966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.739182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.739322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.739332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.739404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.739532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.739542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.739627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.739759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.739769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.739909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.740151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.740386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.740592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.740754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.740834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.740928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.741110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.741343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.741590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.741812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.741886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.741969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.742101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.742111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.742175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.742309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.742319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.742495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.742673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.742693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.316 qpair failed and we were unable to recover it. 00:30:00.316 [2024-12-16 14:34:14.742848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.316 [2024-12-16 14:34:14.743006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.743021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.743249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.743506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.743521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.743636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.743739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.743754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.743916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.744075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.744090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.744245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.744396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.744411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.744641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.744793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.744808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.744883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.745039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.745054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.745143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.745301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.745316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.745423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.745513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.745527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.745760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.745865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.745881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.746104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.746199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.746213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.746310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.746452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.746467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.746552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.746789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.746804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.746974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.747184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.747199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.747281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.747389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.747404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.747476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.747697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.747712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.747802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.747976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.747992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.748149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.748356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.748371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.748520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.748682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.748697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.748776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.748930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.748946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.749033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.749208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.749223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.749310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.749407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.749421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.749516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.749727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.749742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.749891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.750042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.317 [2024-12-16 14:34:14.750057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.317 qpair failed and we were unable to recover it. 00:30:00.317 [2024-12-16 14:34:14.750217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.750426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.750440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.750544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.750718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.750732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.750879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.751139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.751450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.751638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.751824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.751941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.752023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.752157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.752172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.752317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.752461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.752476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.752583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.752737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.752752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.752861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.753004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.753019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.753194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.753341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.753356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.753506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.753659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.753674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.753902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.754045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.754060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.754231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.754380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.754395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.754494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.754634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.754650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.754808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.754966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.754981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.755076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.755226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.755241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.755341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.755419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.755434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.755580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.755682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.755697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.755786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.755885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.755901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.755998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.756140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.756154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.756335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.756425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.756440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.756517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.756579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.756588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.756679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.756819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.756829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.756979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.757065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.757077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.757236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.757318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.757328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.757529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.757672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.318 [2024-12-16 14:34:14.757681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.318 qpair failed and we were unable to recover it. 00:30:00.318 [2024-12-16 14:34:14.757780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.757875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.757885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.758030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.758117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.758128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.758341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.758500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.758510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.758653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.758729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.758739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.758877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.758951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.758960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.759094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.759267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.759277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.759356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.759415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.759424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.759524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.759615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.759627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.759723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.759797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.759806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.759898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.760176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.760392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.760567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.760727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.760871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.760964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.761137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.761361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.761526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.761776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.761866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.761930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.762140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.762423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.762580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.762775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.762935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.763007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.763191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.763482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.763637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.763869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.319 [2024-12-16 14:34:14.763969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.319 qpair failed and we were unable to recover it. 00:30:00.319 [2024-12-16 14:34:14.764056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.764254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.764263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.764428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.764494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.764504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.764583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.764651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.764659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.764808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.764934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.764945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.765013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.765275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.765286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.765384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.765451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.765463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.765553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.765625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.765636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.765705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.765784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.765794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.765896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.766173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.766349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.766508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.766715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.766784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.766862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.767085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.767250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.767438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.767581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.767752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.767907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.767976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.768039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.768258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.768471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.768703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.768846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.768924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.768995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.769146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.769365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.769575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.320 qpair failed and we were unable to recover it. 00:30:00.320 [2024-12-16 14:34:14.769815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.320 [2024-12-16 14:34:14.769888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.769971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.770042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.770053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.770191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.770266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.770277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.770341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.770404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.770412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.770611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.770743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.770752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.770827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.771027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.771039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.771168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.771315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.771325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.771542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.771624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.771633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.771717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.771787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.771797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.771883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.772126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.772417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.772627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.772796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.772938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.773011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.773248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.773476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.773648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.773892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.773986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.774072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.774274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.774414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.774657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.774806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.774890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.775018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.775150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.775161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.775316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.775386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.775396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.775528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.775664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.775675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.321 [2024-12-16 14:34:14.775823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.775897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.321 [2024-12-16 14:34:14.775908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.321 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.776047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.776269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.776425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.776680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.776883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.776960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.777040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.777216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.777228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.777286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.777357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.777367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.777496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.777653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.777664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.777867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.778097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.778297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.778637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.778804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.778889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.778976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.779187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.779406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.779562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.779705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.779876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.779963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.780022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.780283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.780505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.780669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.780827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.780998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.322 [2024-12-16 14:34:14.781054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.781157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.322 [2024-12-16 14:34:14.781167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.322 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.781231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.781301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.781311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.781463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.781609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.781618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.781681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.781757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.781768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.781996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.782157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.782411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.782666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.782908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.782996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.783137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.783267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.783277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.783343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.783488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.783498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.783578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.783658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.783667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.783743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.783874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.783884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.783966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.784128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.784314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.784599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.784811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.784984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.785069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.785134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.785143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.785326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.785403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.785412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.785624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.785693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.785703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.785768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.785900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.785910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.785978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.786134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.786301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.786528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.786702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.786780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.786852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.787001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.787010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.323 qpair failed and we were unable to recover it. 00:30:00.323 [2024-12-16 14:34:14.787087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.323 [2024-12-16 14:34:14.787158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.787249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.787410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.787728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.787873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.787953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.788090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.788229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.788445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.788617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.788773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.788932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.789004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.789220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.789443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.789673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.789823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.789912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.789998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.790243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.790394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.790545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.790679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.790840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.790918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.791013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.791181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.791320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.791450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.791736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.791893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.791981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.792064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.792128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.792137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.792204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.792362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.792371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.324 qpair failed and we were unable to recover it. 00:30:00.324 [2024-12-16 14:34:14.792445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.324 [2024-12-16 14:34:14.792575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.792585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.792648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.792719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.792731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.792865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.792929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.792939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.793014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.793247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.793399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.793640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.793774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.793915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.793985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.794130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.794280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.794486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.794756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.794846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.794931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.795147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.795290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.795524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.795658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.795802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.795873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.796000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.796168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.796397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.796618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.796785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.796930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.796995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.797152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.797305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.797513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.797739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.797946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.325 qpair failed and we were unable to recover it. 00:30:00.325 [2024-12-16 14:34:14.798024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.798090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.325 [2024-12-16 14:34:14.798099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.798174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.798237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.798246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.798384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.798515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.798525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.798728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.798860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.798869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.798937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.799102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.799311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.799465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.799609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.799782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.799863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.800017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.800155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.800299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.800447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.800668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.800818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.800950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.801174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.801464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.801622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.801840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.801981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.802043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.802257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.802423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.802603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.802751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.802887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.326 qpair failed and we were unable to recover it. 00:30:00.326 [2024-12-16 14:34:14.802963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.803024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.326 [2024-12-16 14:34:14.803033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.803178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.803311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.803321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.803451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.803608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.803618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.803751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.803898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.803909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.804118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.804274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.804283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.804424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.804505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.804515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.804579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.804657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.804666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.804732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.804892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.804903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.805076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.805156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.805166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.805312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.805393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.805402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.805550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.805717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.805727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.805801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.805869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.805878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.806007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.806175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.806329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.806485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.806646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.806804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.806943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.807025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.807152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.807161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.807359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.807451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.807461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.807614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.807759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.807769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.807912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.807994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.808086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.808218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.808569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.808719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.808859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.808988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.809058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.809069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.809161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.809222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.809231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.327 [2024-12-16 14:34:14.809366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.809504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.327 [2024-12-16 14:34:14.809513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.327 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.809595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.809743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.809753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.809829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.809982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.809992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.810064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.810210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.810466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.810632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.810791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.810937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.810994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.811128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.811138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.811210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.811370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.811380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.811518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.811604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.811614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.811676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.811812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.811822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.811965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.812262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.812456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.812728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.812877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.812950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.813024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.813248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.813458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.813678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.813814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.813887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.814052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.814132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.814141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.814285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.814430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.814440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.814527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.814600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.814610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.814689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.814767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.814777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.814849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.815013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.815025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.815166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.815244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.815254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.328 qpair failed and we were unable to recover it. 00:30:00.328 [2024-12-16 14:34:14.815336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.815488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.328 [2024-12-16 14:34:14.815497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.815560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.815624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.815634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.815721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.815793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.815804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.815880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.816011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.816020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.816168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.816302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.816313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.816444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.816529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.816538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.816615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.816704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.816714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.816920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.817007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.817016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.817162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.817235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.817244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.817397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.817474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.817483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.817701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.817836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.817845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.817939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.818110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.818440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.818588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.818811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.818912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.818979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.819200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.819419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.819635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.819795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.819898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.820116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.820200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.820210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.820342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.820411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.820420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.820489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.820550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.820559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.820625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.820757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.820767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.820832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.821106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.821271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.821499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.329 qpair failed and we were unable to recover it. 00:30:00.329 [2024-12-16 14:34:14.821672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.329 [2024-12-16 14:34:14.821764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.821861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.821956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.821965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.822098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.822178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.822187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.822268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.822351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.822362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.822509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.822640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.822650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.822723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.822878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.822888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.822952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.823170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.823397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.823601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.823834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.823921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.824056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.824198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.824406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.824691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.824921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.824995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.825069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.825297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.825530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.825687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.825819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.825900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.825966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.826205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.826354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.826522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.826748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.826839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.330 [2024-12-16 14:34:14.826990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.827064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.330 [2024-12-16 14:34:14.827073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.330 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.827153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.827292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.827301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.827391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.827456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.827465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.827545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.827620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.827629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.827716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.827863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.827873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.827948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.828235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.828441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.828658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.828867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.828993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.829003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.829087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.829166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.829176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.829397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.829547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.829557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.829711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.829859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.829869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.830070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.830211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.830220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.830301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.830427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.830436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.830500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.830695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.830704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.830920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.831061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.831071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.831165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.831314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.831324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.831548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.831635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.831644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.831793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.832157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.832413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.832593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.832839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.832936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.331 qpair failed and we were unable to recover it. 00:30:00.331 [2024-12-16 14:34:14.833006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.833135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.331 [2024-12-16 14:34:14.833145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.833228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.833378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.833388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.833530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.833707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.833717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.833862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.833995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.834005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.834245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.834326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.834336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.834605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.834733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.834742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.834967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.835053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.835062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.835134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.835258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.835268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.835430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.835575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.835584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.835736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.835863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.835872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.835969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.836135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.836387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.836621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.836882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.836972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.837060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.837197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.837208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.837339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.837430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.837441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.837505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.837632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.837642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.837777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.837934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.837944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.838006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.838256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.838402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.838553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.838714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.838892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.838988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.839064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.839197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.839207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.839285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.839351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.839361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.839505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.839642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.839652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.839731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.839831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.839842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.839924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.840122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.332 [2024-12-16 14:34:14.840133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.332 qpair failed and we were unable to recover it. 00:30:00.332 [2024-12-16 14:34:14.840268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.333 [2024-12-16 14:34:14.840352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.333 [2024-12-16 14:34:14.840362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.333 qpair failed and we were unable to recover it. 00:30:00.333 [2024-12-16 14:34:14.840436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.333 [2024-12-16 14:34:14.840508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.333 [2024-12-16 14:34:14.840517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.333 qpair failed and we were unable to recover it. 00:30:00.333 [2024-12-16 14:34:14.840717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.333 [2024-12-16 14:34:14.840802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.333 [2024-12-16 14:34:14.840813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.333 qpair failed and we were unable to recover it. 00:30:00.333 [2024-12-16 14:34:14.840903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.333 [2024-12-16 14:34:14.841045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.333 [2024-12-16 14:34:14.841055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.333 qpair failed and we were unable to recover it. 00:30:00.333 [2024-12-16 14:34:14.841148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.841231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.841241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.841385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.841545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.841555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.841702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.841775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.841784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.841921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.841983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.841992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.842072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.842166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.842176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.842261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.842437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.842447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.842584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.842752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.842763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.842839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.842994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.843005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.843102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.843196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.843206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.843288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.843442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.843453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.843595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.843678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.843688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.843860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.843997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.844080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.844432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.844661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.844884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.844956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.845028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.845228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.845238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.845386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.845527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.845537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.845628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.845798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.845809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.845892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.846021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.846031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.846159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.846242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.846251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.613 qpair failed and we were unable to recover it. 00:30:00.613 [2024-12-16 14:34:14.846423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.613 [2024-12-16 14:34:14.846563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.846574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.846662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.846738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.846747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.846914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.846974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.846983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.847115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.847173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.847182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.847271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.847330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.847339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.847540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.847683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.847693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.847759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.848095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.848362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.848555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.848713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.848871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.849042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.849169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.849179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.849284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.849368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.849377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.849535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.849622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.849632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.849777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.849927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.849937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.850031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.850106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.850116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.850258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.850347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.850356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.850487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.850556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.850575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.850773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.850922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.850932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.851078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.851145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.851155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.851299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.851379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.851388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.851593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.851667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.851676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.851807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.851864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.851874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.851945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.852150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.852356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.852572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.852744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.852881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.853031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.853089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.853099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.614 [2024-12-16 14:34:14.853225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.853293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.614 [2024-12-16 14:34:14.853302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.614 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.853449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.853508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.853517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.853601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.853657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.853666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.853795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.853930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.853940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.854082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.854171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.854181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.854243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.854336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.854345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.854409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.854569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.854578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.854721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.854782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.854792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.854923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.855064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.855075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.855155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.855218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.855227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.855390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.855619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.855629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.855707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.855787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.855797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.855895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.856040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.856051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.856135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.856330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.856340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.856561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.856707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.856718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.856797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.856947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.856957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.857045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.857248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.857464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.857759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.857917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.857992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.858097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.858253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.858420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.858638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.858791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.858935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.859100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.859236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.859246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.859316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.859456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.859465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.615 [2024-12-16 14:34:14.859543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.859622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.615 [2024-12-16 14:34:14.859632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.615 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.859722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.859881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.859891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.860031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.860118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.860129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.860276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.860437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.860447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.860612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.860772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.860781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.860860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.860995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.861170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.861334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.861559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.861776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.861933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.862067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.862156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.862170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.862260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.862350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.862359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.862498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.862720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.862732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.862872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.863027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.863037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.863168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.863259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.863270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.863337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.863550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.863560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.863697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.863843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.863865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.864001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.864092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.864103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.864274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.864338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.864348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.864431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.864501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.864510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.864662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.864759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.864768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.864916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.865143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.865353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.865514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.865757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.865917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.866009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.866173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.866183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.866252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.866398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.866408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.866546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.866611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.866620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.616 [2024-12-16 14:34:14.866712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.866846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.616 [2024-12-16 14:34:14.866860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.616 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.866992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.867225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.867401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.867545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.867745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.867867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.867947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.868083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.868092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.868168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.868330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.868340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.868472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.868616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.868625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.868783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.868917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.868927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.869022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.869083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.869092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.869236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.869322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.869331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.869478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.869562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.869572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.869719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.869923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.869933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.870068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.870143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.870152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.870312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.870445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.870455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.870528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.870667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.870676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.870765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.870837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.870846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.870946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.871080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.871090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.871156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.871236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.871245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.871378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.871444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.871454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.871535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.871686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.871695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.871832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.872027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.872038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.617 [2024-12-16 14:34:14.872113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.872253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.617 [2024-12-16 14:34:14.872262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.617 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.872416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.872493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.872503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.872575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.872788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.872798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.872862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.873035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.873044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.873140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.873273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.873282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.873408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.873482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.873491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.873664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.873886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.873896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.873989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.874307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.874462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.874626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.874869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.874952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.875018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.875091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.875101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.875174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.875361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.875371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.875523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.875652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.875662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.875810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.875889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.875899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.876070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.876200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.876209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.876411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.876503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.876513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.876588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.876737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.876747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.876827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.877100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.877387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.877701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.877876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.877961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.878041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.878107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.878117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.878316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.878443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.878453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.878528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.878612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.878622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.878705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.878801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.878810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.878896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.879025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.879034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.879193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.879284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.618 [2024-12-16 14:34:14.879294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.618 qpair failed and we were unable to recover it. 00:30:00.618 [2024-12-16 14:34:14.879372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.879433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.879443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.879514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.879650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.879660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.879740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.879820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.879829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.879902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.880114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.880282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.880515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.880658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.880818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.880962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.881027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.881098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.881107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.881278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.881417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.881426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.881518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.881679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.881688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.881752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.881887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.881897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.881966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.882190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.882509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.882740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.882905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.882984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.883062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.883210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.883219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.883306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.883521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.883530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.883598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.883742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.883752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.883818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.883890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.883900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.883990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.884139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.884149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.884212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.884286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.884295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.884425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.884551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.884560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.884643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.884768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.884777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.884862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.885063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.885073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.885269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.885438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.885447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.885605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.885693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.619 [2024-12-16 14:34:14.885702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.619 qpair failed and we were unable to recover it. 00:30:00.619 [2024-12-16 14:34:14.885919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.886073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.886102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.886289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.886419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.886449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.886621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.886874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.886905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.887033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.887148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.887157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.887248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.887340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.887349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.887544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.887769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.887799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.888058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.888201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.888230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.888512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.888683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.888711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.888891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.889074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.889103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.889239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.889427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.889437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.889602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.889885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.889917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.890148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.890315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.890324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.890484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.890629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.890659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.890846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.890970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.890999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.891258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.891404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.891413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.891491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.891560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.891570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.891637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.891708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.891717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.891885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.891940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.891949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.892017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.892213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.892223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.892299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.892369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.892379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.892577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.892665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.892674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.892805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.892936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.892946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.893030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.893172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.893181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.893310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.893479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.893509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.893680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.893847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.893971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.894097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.894286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.894315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.894456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.894589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.894618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.620 [2024-12-16 14:34:14.894734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.894921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.620 [2024-12-16 14:34:14.894952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.620 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.895194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.895366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.895376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.895439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.895584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.895593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.895682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.895909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.895928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.896077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.896292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.896302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.896450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.896513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.896522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.896598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.896726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.896735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.896806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.897186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.897500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.897661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.897820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.897907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.898052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.898221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.898230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.898348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.898534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.898563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.898693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.898909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.898941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.899057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.899194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.899229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.899438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.899717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.899747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.899938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.900178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.900208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.900423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.900657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.900686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.900808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.901004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.901036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.901226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.901418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.901447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.901693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.901884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.901927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.902129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.902274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.902285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.902417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.902608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.902637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.902830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.903066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.903099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.903290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.903413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.903425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.903504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.903642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.903671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.621 [2024-12-16 14:34:14.903886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.903999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.621 [2024-12-16 14:34:14.904027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.621 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.904298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.904418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.904446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.904691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.904928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.904960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.905152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.905270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.905299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.905414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.905669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.905699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.905819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.905955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.905987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.906182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.906412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.906422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.906491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.906649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.906659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.906787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.906874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.906886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.907102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.907227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.907255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.907447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.907572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.907601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.907737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.907902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.907935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.908060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.908247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.908257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.908384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.908462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.908472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.908547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.908626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.908636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.908751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.908888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.908899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.908995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.909147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.909157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.909229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.909311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.909320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.909454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.909580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.909592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.909678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.909806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.909817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.910032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.910156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.910185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.910295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.910535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.910565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.910759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.910904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.910935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.911127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.911229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.911239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.911427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.911517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.911526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.622 [2024-12-16 14:34:14.911657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.911795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.622 [2024-12-16 14:34:14.911805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.622 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.912013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.912223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.912252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.912430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.912622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.912651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.912791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.912976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.913008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.913150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.913305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.913315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.913477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.913702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.913712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.913783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.913938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.913948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.914085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.914156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.914176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.914256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.914451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.914461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.914652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.914757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.914786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.915066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.915191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.915220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.915353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.915454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.915464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.915626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.915776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.915786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.915869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.915955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.915964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.916191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.916341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.916370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.916563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.916747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.916776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.917018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.917283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.917313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.917558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.917724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.917754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.917907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.918046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.918055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.918275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.918476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.918505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.918628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.918796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.918825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.918984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.919237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.919266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.919512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.919658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.919667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.919747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.919895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.919906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.920075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.920213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.920223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.920308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.920386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.920396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.920486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.920618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.920628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.920696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.920851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.920865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.623 qpair failed and we were unable to recover it. 00:30:00.623 [2024-12-16 14:34:14.920943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.921069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.623 [2024-12-16 14:34:14.921078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.921215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.921369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.921379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.921468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.921603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.921612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.921828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.922015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.922046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.922292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.922475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.922484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.922683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.922768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.922777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.922907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.923034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.923043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.923114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.923251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.923261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.923406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.923546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.923556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.923715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.923848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.923863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.924012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.924096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.924105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.924268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.924431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.924441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.924634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.924815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.924824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.924981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.925163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.925173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.925312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.925401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.925411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.925475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.925595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.925605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.925782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.925861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.925871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.926012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.926226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.926236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.926314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.926384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.926394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.926533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.926605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.926615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.926770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.926911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.926921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.927063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.927210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.927370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.927541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.927725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.927805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.927895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.928028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.928037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.928169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.928309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.624 [2024-12-16 14:34:14.928318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.624 qpair failed and we were unable to recover it. 00:30:00.624 [2024-12-16 14:34:14.928383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.928551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.928561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.928697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.928774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.928783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.928979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.929178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.929207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.929385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.929555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.929584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.929701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.929831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.929869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.930114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.930234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.930262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.930451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.930550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.930578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.930758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.930938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.930970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.931195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.931373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.931411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.931600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.931700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.931730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.931870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.931998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.932029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.932237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.932405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.932436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.932622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.932884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.932916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.933054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.933327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.933342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.933447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.933536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.933551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.933705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.933866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.933881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.934088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.934249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.934278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.934472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.934598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.934628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.934804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.935056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.935088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.935338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.935516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.935546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.935735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.935851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.935890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.936137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.936314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.936329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.936561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.936715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.936745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.936888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.937013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.937043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.937166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.937292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.937307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.937404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.937544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.937559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.937757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.937951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.937983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.938172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.938353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.938367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.625 qpair failed and we were unable to recover it. 00:30:00.625 [2024-12-16 14:34:14.938454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.938684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.625 [2024-12-16 14:34:14.938702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.938848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.938957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.938972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.939124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.939263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.939278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.939434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.939588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.939603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.939691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.939793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.939808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.939906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.940047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.940062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.940281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.940529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.940559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.940685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.940814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.940845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.941073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.941295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.941325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.941591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.941825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.941863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.942064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.942168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.942203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.942322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.942424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.942439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.942556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.942704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.942719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.942827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.942972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.942988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.943081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.943220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.943235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.943399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.943533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.943564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.943785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.943974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.944006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.944189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.944301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.944332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.944449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.944537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.944551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.944709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.944920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.944937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.945124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.945262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.945277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.945526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.945697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.945712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.945876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.946030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.946046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.946232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.946365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.946383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.946549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.946629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.946644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.946820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.946904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.946919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.947019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.947177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.947192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.947350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.947445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.947460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.626 [2024-12-16 14:34:14.947562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.947662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.626 [2024-12-16 14:34:14.947677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.626 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.947886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.948040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.948056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.948227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.948377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.948409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.948545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.948727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.948757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.948932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.949118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.949133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.949231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.949319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.949334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.949491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.949648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.949663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.949811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.949971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.949987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.950098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.950250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.950265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.950354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.950433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.950447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.950603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.950744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.950759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.950928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.951238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.951268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.951374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.951583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.951599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.951798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.951938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.951972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.952151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.952362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.952392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.952618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.952701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.952716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.952878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.953223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.953443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.953626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.953889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.953994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.954148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.954244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.954259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.954358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.954576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.954606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.954796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.955069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.955111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.955200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.955274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.955288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.955503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.955757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.955786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.627 qpair failed and we were unable to recover it. 00:30:00.627 [2024-12-16 14:34:14.955929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.627 [2024-12-16 14:34:14.956048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.956079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.956281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.956436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.956467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.956590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.956802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.956832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.957035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.957248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.957263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.957519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.957613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.957628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.957769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.957918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.957934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.958075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.958311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.958341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.958528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.958765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.958800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.958920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.959110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.959140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.959333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.959507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.959537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.959734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.959866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.959899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.960115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.960236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.960265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.960533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.960652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.960681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.960904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.961030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.961060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.961184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.961345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.961360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.961598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.961868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.961900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.962079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.962324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.962339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.962500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.962667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.962700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.962921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.963108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.963137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.963405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.963534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.963564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.963701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.963875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.963905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.964047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.964175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.964204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.964407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.964521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.964550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.964681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.964906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.964939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.965128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.965250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.965265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.965435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.965606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.965635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.965808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.965924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.965955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.966247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.966427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.966457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.628 [2024-12-16 14:34:14.966652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.966877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.628 [2024-12-16 14:34:14.966909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.628 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.967090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.967269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.967298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.967478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.967636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.967668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.967792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.967989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.968020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.968155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.968339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.968355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.968510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.968656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.968671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.968808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.968986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.969002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.969158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.969228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.969243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.969337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.969417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.969432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.969571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.969795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.969825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.969979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.970142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.970171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.970340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.970483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.970498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.970657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.970757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.970772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.970941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.971042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.971057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.971264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.971429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.971459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.971597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.971791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.971821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.971954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.972139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.972169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.972356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.972548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.972578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.972774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.972900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.972931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.973122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.973308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.973337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.973520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.973686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.973719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.973905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.974094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.974124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.974258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.974431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.974461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.974664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.974931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.974962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.975227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.975317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.975332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.975443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.975695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.975711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.975878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.976046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.976061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.976201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.976272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.976286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.629 [2024-12-16 14:34:14.976480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.976644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.629 [2024-12-16 14:34:14.976675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.629 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.976892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.977014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.977045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.977287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.977456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.977498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.977665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.977915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.977946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.978119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.978305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.978335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.978478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.978718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.978733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.978900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.979069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.979098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.979304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.979430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.979465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.979616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.979721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.979736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.979812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.979964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.979979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.980122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.980275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.980290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.980443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.980606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.980637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.980756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.980934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.980966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.981269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.981482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.981497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.981684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.981830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.981846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.982010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.982186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.982200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.982362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.982514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.982529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.982675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.982900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.982933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.983111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.983231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.983261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.983373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.983483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.983513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.983696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.983795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.983810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.984040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.984188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.984218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.984410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.984528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.984559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.984743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.984867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.984898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.985024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.985202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.985233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.985362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.985624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.985654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.985865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.986069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.986100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.986274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.986476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.986505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.986720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.986958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.986990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.630 qpair failed and we were unable to recover it. 00:30:00.630 [2024-12-16 14:34:14.987130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.630 [2024-12-16 14:34:14.987234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.987264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.987444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.987680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.987695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.987837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.987923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.987940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.988098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.988340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.988370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.988586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.988690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.988721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.988905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.989096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.989127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.989377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.989512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.989542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.989666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.989757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.989773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.989924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.990083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.990099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.990279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.990378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.990393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.990635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.990764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.990796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.990942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.991127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.991159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.991283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.991375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.991391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.991570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.991745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.991775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.991882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.992009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.992039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.992254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.992494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.992524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.992699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.992873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.992905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.993102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.993241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.993256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.993337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.993430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.993444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.993543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.993762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.993793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.993933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.994108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.994138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.994320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.994441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.994470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.994708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.994935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.994967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.995174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.995423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.995458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.995655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.995812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.995831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.631 qpair failed and we were unable to recover it. 00:30:00.631 [2024-12-16 14:34:14.996080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.631 [2024-12-16 14:34:14.996231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.996247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.996414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.996571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.996587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.996742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.996896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.996929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.997064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.997240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.997269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.997382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.997565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.997580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.997835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.998017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.998033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.998175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.998317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.998332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.998424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.998570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.998585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.998731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.998909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.998924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.999008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.999098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.999116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.999278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.999430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.999446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:14.999596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.999815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:14.999846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.000005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.000177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.000208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.000406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.000512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.000527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.000629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.000834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.000849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.001012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.001185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.001214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.001418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.001524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.001554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.001797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.001995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.002027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.002272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.002443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.002473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.002724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.002909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.002940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.003131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.003258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.003273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.003350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.003422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.003437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.003532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.003630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.003645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.003876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.004077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.004106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.004218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.004386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.004417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.004613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.004703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.004718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.004818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.004961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.004977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.005068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.005214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.005229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.005379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.005458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.005473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.632 qpair failed and we were unable to recover it. 00:30:00.632 [2024-12-16 14:34:15.005633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.632 [2024-12-16 14:34:15.005780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.005795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.005949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.006110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.006125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.006283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.006374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.006389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.006528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.006622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.006637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.006794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.006966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.007005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.007122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.007315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.007345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.007539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.007703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.007718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.007879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.007964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.007979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.008091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.008225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.008240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.008374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.008566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.008581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.008734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.008985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.009001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.009182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.009371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.009401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.009583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.009764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.009794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.009987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.010118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.010148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.010360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.010554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.010584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.010694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.010810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.010841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.011056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.011261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.011291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.011550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.011691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.011721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.011875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.012155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.012186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.012388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.012550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.012565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.012729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.012828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.012843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.012967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.013110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.013128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.013277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.013364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.013378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.013531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.013618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.013633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.013732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.013942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.013958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.014058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.014148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.014163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.014302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.014402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.014417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.633 [2024-12-16 14:34:15.014572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.014651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.633 [2024-12-16 14:34:15.014666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.633 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.014751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.014830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.014845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.015023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.015170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.015185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.015393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.015479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.015494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.015647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.015740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.015758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.015839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.016003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.016035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.016213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.016332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.016362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.016636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.016897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.016930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.017126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.017298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.017328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.017450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.017712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.017742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.017965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.018097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.018127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.018307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.018440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.018470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.018661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.018916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.018947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.019169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.019296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.019326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.019448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.019556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.019571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.019742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.019894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.019910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.020012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.020171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.020186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.020308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.020411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.020426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.020536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.020621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.020636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.020790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.020940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.020956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.021110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.021197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.021211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.021388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.021475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.021490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.021594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.021736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.021751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.021868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.022043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.022058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.022217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.022307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.022322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.022484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.022557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.022572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.022710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.022944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.022975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.023099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.023221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.023250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.023435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.023599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.023613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.023830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.023935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.023951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.634 qpair failed and we were unable to recover it. 00:30:00.634 [2024-12-16 14:34:15.024183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.024267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.634 [2024-12-16 14:34:15.024282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.024363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.024550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.024580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.024776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.024895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.024926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.025136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.025378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.025408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.025607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.025775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.025804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.025936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.026125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.026155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.026354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.026520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.026549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.026812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.027018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.027034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.027191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.027398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.027413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.027518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.027687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.027717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.027892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.028073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.028102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.028220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.028370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.028385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.028484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.028692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.028707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.028801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.028964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.028979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.029121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.029258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.029272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.029371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.029528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.029543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.029768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.029868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.029884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.030052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.030151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.030165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.030258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.030523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.030552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.030731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.030849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.030889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.031162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.031376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.031405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.031531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.031650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.031665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.031823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.032022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.032038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.032248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.032356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.032370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.032511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.032665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.032680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.032869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.033032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.033050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.033209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.033355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.033370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.033459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.033607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.033622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.635 [2024-12-16 14:34:15.033765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.033846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.635 [2024-12-16 14:34:15.033868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.635 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.034023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.034183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.034199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.034352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.034527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.034557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.034795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.034975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.035007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.035189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.035298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.035328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.035453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.035633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.035663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.035845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.036036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.036065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.036207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.036399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.036413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.036557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.036707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.036722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.036964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.037064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.037079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.037163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.037373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.037388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.037546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.037779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.037794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.037884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.037987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.038002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.038144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.038250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.038264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.038446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.038617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.038647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.038847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.039043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.039073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.039263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.039466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.039495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.039690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.039873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.039905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.040095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.040286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.040316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.040497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.040635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.040649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.040762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.040987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.041002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.041145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.041232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.041247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.041463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.041626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.041662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.636 qpair failed and we were unable to recover it. 00:30:00.636 [2024-12-16 14:34:15.041851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.636 [2024-12-16 14:34:15.042057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.042087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.042210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.042443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.042472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.042692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.042878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.042893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.043101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.043256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.043285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.043401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.043587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.043618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.043805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.043989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.044020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.044158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.044395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.044424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.044648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.044825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.044865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.045003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.045224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.045254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.045393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.045555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.045571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.045755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.045964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.045980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.046139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.046290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.046305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.046460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.046646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.046661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.046757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.046870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.046887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.047040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.047186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.047201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.047431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.047600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.047615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.047695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.047879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.047895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.048109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.048253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.048269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.048424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.048567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.048582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.048688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.048840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.048867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.049021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.049094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.049109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.049263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.049351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.049366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.049520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.049607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.049622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.049833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.050000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.050033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.050159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.050282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.050312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.050487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.050620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.050638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.050791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.050997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.051013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.051157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.051369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.051385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.051544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.051750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.051766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.637 qpair failed and we were unable to recover it. 00:30:00.637 [2024-12-16 14:34:15.051866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.051975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.637 [2024-12-16 14:34:15.051990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.052157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.052325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.052339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.052490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.052644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.052660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.052813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.052905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.052921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.053064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.053221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.053236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.053352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.053441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.053456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.053542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.053716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.053746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.053888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.054009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.054039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.054221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.054419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.054449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.054576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.054656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.054671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.054950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.055040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.055057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.055169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.055266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.055281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.055372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.055470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.055485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.055665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.055772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.055803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.056005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.056184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.056214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.056335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.056436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.056451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.056603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.056691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.056706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.056804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.056964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.056980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.057054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.057216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.057231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.057380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.057530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.057545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.057621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.057773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.057788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.057936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.058015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.058030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.058125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.058262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.058277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.058441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.058511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.058526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.058681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.058823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.058838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.058995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.059068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.059083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.059170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.059237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.059252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.059352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.059503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.059519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.059666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.059746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.059761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.059850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.060071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.638 [2024-12-16 14:34:15.060086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.638 qpair failed and we were unable to recover it. 00:30:00.638 [2024-12-16 14:34:15.060247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.060402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.060433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.060626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.060795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.060824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.061028] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15b3900 is same with the state(5) to be set 00:30:00.639 [2024-12-16 14:34:15.061323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.061549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.061588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.061792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.061936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.061955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.062166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.062340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.062355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.062506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.062653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.062669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.062838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.062915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.062932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.063059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.063204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.063219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.063408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.063501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.063516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.063615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.063763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.063779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.063869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.063945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.063961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.064117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.064206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.064221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.064412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.064571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.064586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.064668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.064767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.064783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.064870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.064943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.064958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.065185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.065263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.065279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.065426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.065516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.065532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.065614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.065693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.065709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.065805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.065881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.065898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.065971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.066221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.066451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.066700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.066887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.066997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.067068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.067147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.067163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.067235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.067317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.067332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.067422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.067594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.067609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.067755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.067861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.639 [2024-12-16 14:34:15.067877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.639 qpair failed and we were unable to recover it. 00:30:00.639 [2024-12-16 14:34:15.067969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.068136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.068396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.068592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.068900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.068999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.069092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.069188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.069204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.069376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.069478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.069494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.069585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.069687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.069702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.069850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.069932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.069947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.070046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.070186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.070202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.070293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.070474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.070504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.070688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.070876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.070909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.071173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.071279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.071311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.071421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.071517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.071547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.071813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.071951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.071967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.072180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.072370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.072401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.072670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.072783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.072814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.072957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.073128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.073159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.073346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.073452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.073482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.073634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.073756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.073787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.074036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.074150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.074180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.074320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.074457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.074473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.074560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.074640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.074655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.074739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.074828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.074843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.075115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.075256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.075287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.075424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.075604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.075634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.640 qpair failed and we were unable to recover it. 00:30:00.640 [2024-12-16 14:34:15.075754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.075904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.640 [2024-12-16 14:34:15.075920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.076025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.076232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.076265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.076396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.076675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.076705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.076843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.076951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.076966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.077067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.077266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.077281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.077375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.077527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.077542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.077630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.077736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.077750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.077839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.077938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.077954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.078092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.078195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.078210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.078389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.078492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.078506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.078597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.078747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.078762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.078868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.079124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.079329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.079705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.079892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.079976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.080233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.080354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.080368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.080511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.080668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.080683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.080760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.080936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.080951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.081109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.081217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.081232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.081381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.081464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.081479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.081570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.081716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.081731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.081817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.081987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.082003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.082151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.082236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.082254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.082418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.082676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.082706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.082831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.082945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.082976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.641 [2024-12-16 14:34:15.083098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.083224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.641 [2024-12-16 14:34:15.083253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.641 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.083428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.083575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.083605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.083730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.083931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.083963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.084108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.084298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.084328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.084509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.084696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.084725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.084830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.085052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.085082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.085273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.085394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.085409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.085514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.085623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.085638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.085794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.085958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.085975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.086053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.086239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.086417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.086665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.086846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.086993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.087009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.087099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.087185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.087200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.087314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.087397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.087413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.087558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.087768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.087783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.087923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.088012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.088027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.088118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.088276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.088291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.088384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.088522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.088538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.088747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.088969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.089001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.089185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.089286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.089316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.089425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.089522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.089552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.089792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.089885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.089901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.090049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.090328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.090510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.090701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.090883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.090976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.091079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.091218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.091232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.642 qpair failed and we were unable to recover it. 00:30:00.642 [2024-12-16 14:34:15.091305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.091457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.642 [2024-12-16 14:34:15.091473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.091710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.091804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.091820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.091899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.091986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.092002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.092108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.092193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.092208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.092440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.092673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.092688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.092779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.092930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.092946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.093032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.093185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.093200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.093290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.093446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.093461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.093548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.093631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.093646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.093793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.093954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.093971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.094049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.094279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.094454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.094708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.094882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.094974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.095044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.095142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.095157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.095310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.095388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.095404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.095477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.095719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.095735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.095815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.095899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.095920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.096132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.096295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.096311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.096387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.096564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.096579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.096661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.096867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.096882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.097036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.097109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.097123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.097220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.097304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.097319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.097479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.097623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.097638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.097727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.097831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.097845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.098005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.098082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.098097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.643 [2024-12-16 14:34:15.098245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.098346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.643 [2024-12-16 14:34:15.098361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.643 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.098436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.098598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.098613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.098695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.098787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.098802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.098945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.099091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.099106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.099184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.099408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.099439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.099679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.099896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.099928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.100125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.100304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.100334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.100524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.100773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.100789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.100882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.100966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.100981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.101122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.101202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.101217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.101308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.101412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.101427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.101622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.101865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.101898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.102027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.102150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.102179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.102316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.102456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.102485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.102660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.102774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.102804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.103012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.103128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.103157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.103353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.103458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.103487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.103694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.103796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.103811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.103891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.104065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.104080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.104164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.104262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.104277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.104430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.104529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.104544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.104624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.104862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.104878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.104976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.105229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.105455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.105675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.105837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.105924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.106081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.106154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.106164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.106244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.106313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.106323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.106458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.106517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.106526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.644 qpair failed and we were unable to recover it. 00:30:00.644 [2024-12-16 14:34:15.106591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.644 [2024-12-16 14:34:15.106650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.106660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.106749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.106882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.106893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.106975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.107152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.107290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.107575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.107751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.107948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.108059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.108188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.108217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.108336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.108668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.108697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.108892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.109076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.109106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.109294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.109407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.109437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.109681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.109861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.109872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.110019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.110267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.110445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.110647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.110804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.110890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.111032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.111180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.111401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.111547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.111709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.111865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.111943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.112006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.112130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.112140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.112267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.112345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.112354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.645 [2024-12-16 14:34:15.112440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.112684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.645 [2024-12-16 14:34:15.112694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.645 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.112779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.112877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.112887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.112967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.113118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.113258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.113485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.113658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.113801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.113890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.113958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.114155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.114363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.114507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.114694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.114782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.114918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.115119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.115343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.115506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.115724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.115890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.115986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.116049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.116200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.116342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.116625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.116781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.116860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.116935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.117101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.117257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.117407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.646 qpair failed and we were unable to recover it. 00:30:00.646 [2024-12-16 14:34:15.117564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.646 [2024-12-16 14:34:15.117640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.117649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.117721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.117791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.117800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.117892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.117960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.117970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.118100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.118245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.118390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.118534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.118675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.118756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.118888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.119109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.119344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.119557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.119717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.119876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.119976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.120044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.120203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.120350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.120505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.120715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.120896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.120981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.121089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.121249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.121402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.121548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.121683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.121888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.121960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.122023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.122104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.122114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.647 qpair failed and we were unable to recover it. 00:30:00.647 [2024-12-16 14:34:15.122178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.647 [2024-12-16 14:34:15.122260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.122270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.122395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.122458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.122468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.122597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.122726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.122736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.122798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.122965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.122996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.123191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.123289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.123318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.123510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.123599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.123609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.123774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.123835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.123845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.123967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.124070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.124088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.124281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.124485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.124516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.124639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.124769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.124799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.124924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.125088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.125103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.125256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.125399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.125413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.125580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.125750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.125780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.125917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.126036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.126065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.126179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.126363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.126394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.126520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.126688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.126718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.126836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.127124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.127332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.127581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.127776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.127882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.128035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.128111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.128126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.128224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.128411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.128440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.128558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.128671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.128701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.128925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.129044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.129059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.129134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.129222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.129237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.129393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.129463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.129478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.129637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.129802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.129833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.129956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.130061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.130091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.648 [2024-12-16 14:34:15.130233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.130353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.648 [2024-12-16 14:34:15.130382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.648 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.130498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.130619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.130634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.130809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.131001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.131032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.131146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.131255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.131285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.131540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.131664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.131695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.131876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.132053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.132068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.132227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.132320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.132335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.132496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.132597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.132612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.132701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.132771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.132786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.132994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.133240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.133488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.133695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.133901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.133993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.134083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.134286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.134539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.134717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.134879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.134955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.135108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.135122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.135216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.135285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.135299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.135393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.135482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.135497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.135632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.135805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.135821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.135915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.136221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.136484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.136680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.136874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.136994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.137147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.137232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.137242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.649 qpair failed and we were unable to recover it. 00:30:00.649 [2024-12-16 14:34:15.137322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.649 [2024-12-16 14:34:15.137412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.137422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.137494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.137619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.137629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.137698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.137920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.137931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.138014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.138252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.138410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.138565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.138719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.138931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.138998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.139075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.139231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.139386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.139619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.139899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.139980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.140054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.140211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.140365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.140526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.140744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.140825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.140970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.141047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.141057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.141117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.141258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.141267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.650 qpair failed and we were unable to recover it. 00:30:00.650 [2024-12-16 14:34:15.141328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.650 [2024-12-16 14:34:15.141389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.141398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.141463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.141552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.141562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.141650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.141711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.141720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.141794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.141858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.141868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.141959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.142169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.142334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.142497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.142710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.142926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.142997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.143141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.143283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.143503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.143751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.143922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.143998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.144074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.144361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.144516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.144660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.144801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.144874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.145011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.145157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.145455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.145610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.145778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.145877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.145945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.146005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.651 [2024-12-16 14:34:15.146014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.651 qpair failed and we were unable to recover it. 00:30:00.651 [2024-12-16 14:34:15.146095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.146315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.146476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.146628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.146785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.146878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.146950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.147094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.147302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.147457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.147607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.147754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.147917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.147990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.148052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.148211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.148371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.148528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.148751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.148880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.148955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.149024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.149172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.149395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.149618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.149783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.149942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.150024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.150097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.150107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.150168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.150230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.150241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.150328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.150402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.150411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.652 qpair failed and we were unable to recover it. 00:30:00.652 [2024-12-16 14:34:15.150479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.652 [2024-12-16 14:34:15.150547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.150557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.150621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.150688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.150697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.150776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.150845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.150858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.150995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.151055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.151064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.151315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.151441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.151460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.151547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.151633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.151649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.151723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.151800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.151816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.152002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.152179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.152381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.152566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.152740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.152914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.152997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.153086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.153190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.153205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.153346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.153491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.153506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.153597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.153667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.153682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.153777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.153864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.153880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.153970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.154153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.154324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.154501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.154696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.154879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.154959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.155024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.155157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.155307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.155590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.653 qpair failed and we were unable to recover it. 00:30:00.653 [2024-12-16 14:34:15.155738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.653 [2024-12-16 14:34:15.155827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.155836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.155899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.155957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.155967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.156096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.156236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.156367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.156500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.156702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.156783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.156919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.157142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.157350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.157585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.157757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.157902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.157975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.158099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.158253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.158405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.158561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.158719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.158873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.158951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.159017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.159236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.159465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.159617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.159784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.159936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.160070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.160144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.160153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.160214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.160272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.160281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.654 qpair failed and we were unable to recover it. 00:30:00.654 [2024-12-16 14:34:15.160358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.654 [2024-12-16 14:34:15.160416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.160425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.160558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.160617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.160629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.160723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.160783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.160793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.160945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.161166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.161327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.161496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.161655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.161880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.161973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.162064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.162276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.162452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.162595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.162765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.162837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.162992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.163234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.163554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.163729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.163875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.163964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.164090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.164155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.164164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.164233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.164303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.164313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.655 [2024-12-16 14:34:15.164495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.164565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.655 [2024-12-16 14:34:15.164577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.655 qpair failed and we were unable to recover it. 00:30:00.656 [2024-12-16 14:34:15.164642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.656 [2024-12-16 14:34:15.164711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.656 [2024-12-16 14:34:15.164720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.656 qpair failed and we were unable to recover it. 00:30:00.656 [2024-12-16 14:34:15.164924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.165011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.165021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.941 qpair failed and we were unable to recover it. 00:30:00.941 [2024-12-16 14:34:15.165147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.165290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.165300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.941 qpair failed and we were unable to recover it. 00:30:00.941 [2024-12-16 14:34:15.165390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.165580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.165591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.941 qpair failed and we were unable to recover it. 00:30:00.941 [2024-12-16 14:34:15.165741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.165806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.165816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.941 qpair failed and we were unable to recover it. 00:30:00.941 [2024-12-16 14:34:15.165948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.166081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.166091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.941 qpair failed and we were unable to recover it. 00:30:00.941 [2024-12-16 14:34:15.166167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.166237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.166246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.941 qpair failed and we were unable to recover it. 00:30:00.941 [2024-12-16 14:34:15.166396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.166462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.166471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.941 qpair failed and we were unable to recover it. 00:30:00.941 [2024-12-16 14:34:15.166626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.166770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.941 [2024-12-16 14:34:15.166780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.941 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.166915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.166995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.167090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.167230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.167392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.167605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.167826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.167928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.168083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.168250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.168405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.168548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.168693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.168829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.168895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.169176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.169325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.169538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.169695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.169834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.169951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.170030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.170230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.170373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.170617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.170786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.170875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.170940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.171078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.171301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.171452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.171603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.171838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.171993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.172004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.942 [2024-12-16 14:34:15.172064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.172137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.942 [2024-12-16 14:34:15.172147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.942 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.172222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.172407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.172417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.172572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.172643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.172652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.172733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.172908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.172918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.172999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.173237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.173467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.173665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.173817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.173894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.173973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.174183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.174431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.174572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.174827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.174929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.175005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.175161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.175445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.175607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.175821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.175980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.176050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.176218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.176361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.176505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.176723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.176881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.176954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.177095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.177237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.177473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.177640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.177882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.177976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.943 qpair failed and we were unable to recover it. 00:30:00.943 [2024-12-16 14:34:15.178069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.943 [2024-12-16 14:34:15.178140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.178279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.178421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.178652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.178800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.178881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.178944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.179154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.179379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.179513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.179672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.179820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.179895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.179964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.180098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.180108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.180177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.180254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.180264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.180442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.180550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.180569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.180724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.180805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.180820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.180924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.181091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.181106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.181271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.181411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.181426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.181509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.181596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.181610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.181689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.181758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.181773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.181990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.182072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.182087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.182176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.182249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.182264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.182405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.182479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.182494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.182649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.182736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.182750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.182851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.183190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.183459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.183627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.183797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.183964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.184053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.184126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.184136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.184281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.184351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.944 [2024-12-16 14:34:15.184361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.944 qpair failed and we were unable to recover it. 00:30:00.944 [2024-12-16 14:34:15.184423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.184570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.184580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.184780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.184908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.184919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.184996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.185159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.185390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.185556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.185737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.185902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.185975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.186042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.186213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.186383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.186649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.186810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.186899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.186976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.187119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.187265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.187474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.187639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.187910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.187987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.188121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.188365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.188375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.188453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.188610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.188620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.188697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.188761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.188770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.188846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.188935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.188946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.189028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.189187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.189344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.189501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.189651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.189864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.189934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.945 qpair failed and we were unable to recover it. 00:30:00.945 [2024-12-16 14:34:15.190011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.190083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.945 [2024-12-16 14:34:15.190092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.190153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.190304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.190463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.190596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.190791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.190888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.191036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.191182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.191384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.191591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.191741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.191880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.191972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.192125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.192263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.192414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.192581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.192815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.192951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.193016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.193149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.193301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.193527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.193751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.193834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.193915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.194090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.194243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.194462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.946 qpair failed and we were unable to recover it. 00:30:00.946 [2024-12-16 14:34:15.194617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.946 [2024-12-16 14:34:15.194763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.194773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.194921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.194993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.195164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.195409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.195562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.195709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.195912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.195991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.196057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.196197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.196353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.196568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.196708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.196865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.196965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.197122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.197357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.197582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.197757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.197832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.197904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.198123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.198332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.198489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.198757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.198904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.198983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.199059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.199287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.199427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.199590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.199757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.199895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.947 [2024-12-16 14:34:15.199969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.947 qpair failed and we were unable to recover it. 00:30:00.947 [2024-12-16 14:34:15.200055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.200116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.200125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.200255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.200326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.200335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.200446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.200592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.200601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.200685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.200812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.200821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.200967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.201127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.201289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.201559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.201780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.201858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.201943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.202116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.202336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.202556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.202765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.202920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.202998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.203068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.203252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.203433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.203590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.203748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.203829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.203908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.204145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.204156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.204245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.204316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.204326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.204401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.204601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.204611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.204678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.204747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.204757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.204895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.205141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.205371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.205533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.205814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.205889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.948 qpair failed and we were unable to recover it. 00:30:00.948 [2024-12-16 14:34:15.205957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.948 [2024-12-16 14:34:15.206022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.206168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.206312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.206569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.206745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.206910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.206984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.207072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.207082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.207284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.207364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.207373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.207470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.207607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.207616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.207683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.207746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.207756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.207956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.208099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.208109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.208261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.208412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.208421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.208557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.208619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.208628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.208705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.208781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.208791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.208880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.209084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.209313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.209540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.209819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.209913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.209992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.210212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.210360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.210527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.210802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.210872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.210938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.211161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.211376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.211593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.211831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.211921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.212000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.212068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.212078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.949 [2024-12-16 14:34:15.212150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.212274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.949 [2024-12-16 14:34:15.212283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.949 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.212374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.212448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.212458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.212539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.212665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.212674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.212749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.212891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.212901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.213035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.213194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.213414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.213619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.213845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.213939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.214082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.214154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.214163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.214315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.214456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.214466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.214550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.214614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.214624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.214757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.214844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.214859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.214987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.215154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.215366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.215520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.215664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.215801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.215883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.215949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.216218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.216451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.216617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.216827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.216916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.217044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.217187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.217197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.217262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.217405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.217415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.217492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.217565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.950 [2024-12-16 14:34:15.217574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.950 qpair failed and we were unable to recover it. 00:30:00.950 [2024-12-16 14:34:15.217644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.217707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.217716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.217780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.217926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.217936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.218001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.218217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.218430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.218686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.218868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.218955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.219042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.219206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.219366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.219531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.219661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.219791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.219932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.220011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.220214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.220368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.220540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.220745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.220816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.220884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.221105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.221424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.221592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.221738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.221818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.221949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.222117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.222258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.222478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.222635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.222869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.222943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.951 qpair failed and we were unable to recover it. 00:30:00.951 [2024-12-16 14:34:15.223008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.951 [2024-12-16 14:34:15.223067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.223148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.223310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.223576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.223746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.223909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.223987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.224053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.224334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.224495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.224709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.224863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.224938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.225066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.225247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.225390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.225601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.225810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.225904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.225969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.226221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.226399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.226565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.226724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.226869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.226944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.227034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.227285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.227482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.227633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.227769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.227840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.227933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.228002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.228012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.228078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.228145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.228154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.952 [2024-12-16 14:34:15.228222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.228291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.952 [2024-12-16 14:34:15.228301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.952 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.228376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.228457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.228467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.228605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.228740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.228750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.228891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.228952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.228962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.229026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.229295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.229508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.229713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.229880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.229961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.230030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.230198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.230441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.230594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.230742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.230811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.230884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.231090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.231247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.231429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.231653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.231808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.231897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.231960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.232153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.232304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.232577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.232824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.232896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.232967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.233143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.233316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.233472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.233716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.233889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.953 qpair failed and we were unable to recover it. 00:30:00.953 [2024-12-16 14:34:15.233968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.953 [2024-12-16 14:34:15.234043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.234127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.234273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.234492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.234643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.234795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.234877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.235110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.235217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.235227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.235299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.235370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.235380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.235470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.235545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.235554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.235623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.235841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.235851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.235939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.236077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.236238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.236471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.236720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.236903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.236968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.237099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.237109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.237191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.237325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.237334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.237506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.237675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.237685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.237821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.237894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.237904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.238031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.238205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.238435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.238667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.238811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.238900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.238967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.239138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.239367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.239601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.954 qpair failed and we were unable to recover it. 00:30:00.954 [2024-12-16 14:34:15.239774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.954 [2024-12-16 14:34:15.239875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.239955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.240119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.240275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.240508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.240674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.240802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.240885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.240953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.241202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.241331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.241481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.241633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.241778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.241864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.242037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.242189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.242325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.242470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.242610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.242759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.242826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.242897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.243177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.243325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.243468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.243601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.243824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.243915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.243984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.244060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.244069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.244161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.244293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.244303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.244370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.244447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.244457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.955 qpair failed and we were unable to recover it. 00:30:00.955 [2024-12-16 14:34:15.244550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.955 [2024-12-16 14:34:15.244676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.244686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.244757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.244821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.244831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.244908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.244970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.244979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.245046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.245328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.245498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.245668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.245817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.245900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.245972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.246215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.246472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.246634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.246842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.246979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.247057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.247286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.247430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.247649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.247887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.247975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.248056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.248205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.248347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.248577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.248827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.248905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.249045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.249254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.249444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.249588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.249729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.249892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.249961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.250111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.956 [2024-12-16 14:34:15.250121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.956 qpair failed and we were unable to recover it. 00:30:00.956 [2024-12-16 14:34:15.250181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.250353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.250527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.250672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.250867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.250936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.250999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.251248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.251418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.251668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.251901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.251971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.252104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.252180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.252190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.252263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.252346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.252355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.252567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.252647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.252657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.252800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.252879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.252892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.252974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.253116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.253321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.253481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.253649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.253796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.253883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.253948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.254223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.254440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.254589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.254747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.254892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.254956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.255110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.255338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.255501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.957 qpair failed and we were unable to recover it. 00:30:00.957 [2024-12-16 14:34:15.255727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.957 [2024-12-16 14:34:15.255870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.255983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.256145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.256305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.256531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.256694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.256787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.256930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.257145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.257275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.257418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.257630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.257783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.257863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.257999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.258152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.258289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.258476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.258614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.258833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.258917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.259063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.259294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.259472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.259629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.259776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.259850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.259947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.260097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.260256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.260523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.260744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.260878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.260955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.958 qpair failed and we were unable to recover it. 00:30:00.958 [2024-12-16 14:34:15.261084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.261163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.958 [2024-12-16 14:34:15.261173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.261257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.261406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.261551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.261688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.261836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.261916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.261984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.262134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.262276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.262490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.262633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.262864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.262943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.263089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.263166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.263175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.263248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.263340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.263350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.263553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.263637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.263647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.263727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.263872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.263882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.264029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.264188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.264474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.264623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.264778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.264879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.265014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.265176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.265406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.265554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.265879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.265967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.959 qpair failed and we were unable to recover it. 00:30:00.959 [2024-12-16 14:34:15.266036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.959 [2024-12-16 14:34:15.266100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.266183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.266339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.266523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.266730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.266878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.266948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.267014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.267148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.267158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.267293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.267372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.267381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.267446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.267510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.267520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.267584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.267656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.267665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.267736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.270075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.270354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.270627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.270801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.270891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.270968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.271184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.271356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.271504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.271677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.271840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.271914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.272048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.272226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.272382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.272583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.272724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.272879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.272944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.273011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.273021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.273103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.273166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.273176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.273371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.273476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.273485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.273549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.273614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.960 [2024-12-16 14:34:15.273623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.960 qpair failed and we were unable to recover it. 00:30:00.960 [2024-12-16 14:34:15.273730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.273832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.273851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.274026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.274232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.274501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.274674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.274871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.274965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.275040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.275228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.275456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.275637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.275801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.275886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.275969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.276136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.276298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.276472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.276631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.276872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.276955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.277029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.277190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.277352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.277577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.277730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.277821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.277885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.278189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.278324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.278457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.278604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.278824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.278902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.278989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.279052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.279062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.961 qpair failed and we were unable to recover it. 00:30:00.961 [2024-12-16 14:34:15.279124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.961 [2024-12-16 14:34:15.279250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.279341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.279503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.279662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.279818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.279898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.279967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.280108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.280244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.280444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.280587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.280811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.280886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.280952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.281093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.281261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.281475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.281625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.281760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.281897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.281961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.282165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.282316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.282535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.282691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.282822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.282903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.282978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.283191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.283389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.283545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.283774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.283887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.283968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.284038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.284047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.284138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.284203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.962 [2024-12-16 14:34:15.284213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.962 qpair failed and we were unable to recover it. 00:30:00.962 [2024-12-16 14:34:15.284342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.284407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.284423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.284504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.284571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.284583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.284648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.284717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.284727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.284787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.284864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.284874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.284951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.285105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.285266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.285419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.285631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.285844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.285928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.286010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.286157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.286301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.286445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.286594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.286810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.286975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.287057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.287278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.287480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.287626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.287790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.287894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.287971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.288116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.288360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.288573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.288847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.288994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.289071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.289136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.289145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.963 [2024-12-16 14:34:15.289362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.289430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.963 [2024-12-16 14:34:15.289439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.963 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.289520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.289581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.289591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.289738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.289814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.289824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.290030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.290106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.290115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.290275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.290404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.290414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.290491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.290632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.290642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.290794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.290866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.290876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.290955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.291171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.291343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.291482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.291628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.291836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.291913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.291999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.292221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.292439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.292651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.292823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.292910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.292985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.293143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.293314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.293469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.293614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.293791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.293964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.294125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.294283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.294439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.294643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.294812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.294899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.294968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.295033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.295043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.295118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.295250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.295259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.295329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.295410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.295419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.964 qpair failed and we were unable to recover it. 00:30:00.964 [2024-12-16 14:34:15.295515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.295579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.964 [2024-12-16 14:34:15.295588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.295659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.295741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.295751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.295903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.295967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.295976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.296122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.296278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.296453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.296591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.296828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.296904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.296993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.297224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.297393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.297626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.297784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.297871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.297972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.298123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.298337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.298477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.298686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.298761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.298832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.299104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.299336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.299559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.299708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.299875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.299963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.300027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.300214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.300389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.300601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.300824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.300977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.301057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.301128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.301137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.301213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.301353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.301363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.301440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.301515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.301525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.965 qpair failed and we were unable to recover it. 00:30:00.965 [2024-12-16 14:34:15.301594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.965 [2024-12-16 14:34:15.301663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.301673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.301765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.301920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.301939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.302102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.302239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.302255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.302399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.302488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.302504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.302578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.302665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.302680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.302758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.302849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.302869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.303012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.303254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.303477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.303738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.303878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.303955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.304087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.304247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.304459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.304626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.304861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.304952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.305088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.305250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.305482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.305627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.305789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.305880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.305957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.306188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.306338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.306625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.306784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.306867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.306943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.307086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.307237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.307392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.307594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.307737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.307827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.307969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.308028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.308038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.308165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.308234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.308243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.966 qpair failed and we were unable to recover it. 00:30:00.966 [2024-12-16 14:34:15.308324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.966 [2024-12-16 14:34:15.308389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.308399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.308461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.308596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.308606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.308691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.308782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.308791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.308869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.308935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.308944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.309017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.309222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.309396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.309560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.309778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.309934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.309994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.310133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.310304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.310460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.310602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.310817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.310905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.311041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.311214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.311418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.311583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.311822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.311899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.311967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.312131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.312364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.312513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.312648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.312795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.312885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.313040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.313208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.313428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.313594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.313795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.313881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.967 [2024-12-16 14:34:15.313962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.314022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.967 [2024-12-16 14:34:15.314032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.967 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.314103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.314175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.314184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.314327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.314469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.314479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.314561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.314632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.314641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.314706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.314840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.314850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.314934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.315080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.315237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.315386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.315526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.315765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.315845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.315936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.316089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.316236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.316376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.316538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.316745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.316820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.316899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.317151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.317376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.317558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.317717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.317851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.317937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.318071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.318304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.318521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.318687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.318829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.318977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.319109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.319350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.319517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.319737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.319875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.319953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.320031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.320101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.320110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.320186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.320262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.968 [2024-12-16 14:34:15.320272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.968 qpair failed and we were unable to recover it. 00:30:00.968 [2024-12-16 14:34:15.320335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.320480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.320489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.320572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.320662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.320672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.320757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.320887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.320897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.320964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.321137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.321357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.321506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.321689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.321829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.321926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.322152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.322386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.322535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.322738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.322913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.322994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.323063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.323215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.323389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.323563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.323706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.323773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.323906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.324048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.324058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.324139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.324210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.324220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.324296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.324497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.324507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.324575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.324707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.324717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.324871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.325158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.325396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.325555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.325801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.325885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.325952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.326086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.326324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.326490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.326650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.326882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.326978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.327131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.327212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.327222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.969 [2024-12-16 14:34:15.327283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.327415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.969 [2024-12-16 14:34:15.327424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.969 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.327493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.327579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.327589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.327672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.327803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.327813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.327876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.327952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.327961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.328044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.328327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.328477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.328614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.328756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.328916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.329002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.329159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.329374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.329520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.329675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.329746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.329836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.330096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.330232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.330416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.330708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.330907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.330987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.331082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.331292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.331528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.331709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.331874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.331967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.332108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.332244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.332413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.332561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.332789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.332934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.332993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.333071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.333232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.333460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.333589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.333800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.333890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.334091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.334217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.334226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.970 qpair failed and we were unable to recover it. 00:30:00.970 [2024-12-16 14:34:15.334294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.334365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.970 [2024-12-16 14:34:15.334375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.334454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.334517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.334526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.334595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.334763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.334773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.334859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.334929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.334938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.335015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.335182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.335453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.335584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.335731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.335802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.335886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.336110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.336240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.336465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.336616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.336772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.336918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.337050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.337212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.337426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.337561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.337718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.337874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.338003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.338173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.338427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.338677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.338825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.338970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.339044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.339197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.339366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.339575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.339701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.339844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.339995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.340119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.340316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.340326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.340400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.340473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.340483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.340549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.340630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.340639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.971 qpair failed and we were unable to recover it. 00:30:00.971 [2024-12-16 14:34:15.340716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.971 [2024-12-16 14:34:15.340774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.340784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.340917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.340999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.341084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.341235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.341381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.341518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.341669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.341830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.341913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.341994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.342148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.342287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.342439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.342574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.342734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.342887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.342963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.343039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.343305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.343460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.343669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.343809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.343888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.344039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.344331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.344489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.344685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.344894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.344989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.345055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.345191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.345343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.345606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.345763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.345846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.345932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.346087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.346257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.346415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.346626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.346780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.346874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.972 qpair failed and we were unable to recover it. 00:30:00.972 [2024-12-16 14:34:15.346953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.347017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.972 [2024-12-16 14:34:15.347026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.347091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.347309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.347481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.347615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.347827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.347919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.347995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.348150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.348301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.348466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.348669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.348810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.348886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.348956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.349226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.349390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.349555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.349752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.349900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.349977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.350188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.350412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.350570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.350714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.350928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.350995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.351069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.351275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.351415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.351621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.351760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.351877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.351940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.352011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.352020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.352243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.352383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.352393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.352466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.352552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.352561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.352711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.352850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.352866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.973 qpair failed and we were unable to recover it. 00:30:00.973 [2024-12-16 14:34:15.352943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.973 [2024-12-16 14:34:15.353004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.353086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.353304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.353474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.353676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.353839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.353930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.353999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.354129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.354270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.354490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.354625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.354793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.354901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.354985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.355130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.355342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.355551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.355712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.355874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.355950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.356034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.356185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.356329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.356538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.356719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.356867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.356965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.357033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.357180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.357189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.357324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.357399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.357409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.357497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.357623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.357633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.357779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.357839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.357848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.357999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.358068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.358078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.358162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.358260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.358275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.358357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.358434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.358449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.358553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.358636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.974 [2024-12-16 14:34:15.358651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.974 qpair failed and we were unable to recover it. 00:30:00.974 [2024-12-16 14:34:15.358744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.358819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.358834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.358996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.359073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.359088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.359325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.359462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.359477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.359626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.359762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.359776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.359865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.359954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.359968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.360059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.360161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.360176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.360329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.360487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.360501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.360598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.360750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.360767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.360872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.360952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.360968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.361053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.361148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.361163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.361276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.361367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.361383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.361481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.361671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.361686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.361850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.361934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.361949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.362036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.362274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.362500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.362675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.362869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.362986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.363067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.363251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.363443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.363700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.363885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.363994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.364068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.364162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.364176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.364265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.364341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.364356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.364500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.364575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.364590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.364730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.364802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.364817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.364915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.365048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.365060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.365230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.365383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.365392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.365525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.365589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.365599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.365777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.365862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.365872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.365949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.366090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.366099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.975 qpair failed and we were unable to recover it. 00:30:00.975 [2024-12-16 14:34:15.366160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.975 [2024-12-16 14:34:15.366297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.366306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.366371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.366518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.366529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.366619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.366732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.366742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.366817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.366959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.366969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.367045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.367265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.367275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.367349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.367429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.367441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.367673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.367743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.367752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.367829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.367966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.367977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.368069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.368275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.368495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.368715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.368927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.368996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.369079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.369294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.369460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.369771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.369916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.369990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.370133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.370351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.370500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.370705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.370806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.370953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.371122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.371267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.371410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.371632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.371795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.371880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.371946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.372091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.372239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.372389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.372641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.372810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.372878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.372954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.373021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.373031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.976 qpair failed and we were unable to recover it. 00:30:00.976 [2024-12-16 14:34:15.373092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.976 [2024-12-16 14:34:15.373151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.373234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.373388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.373535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.373696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.373780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.373921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.374097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.374307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.374513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.374748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.374826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.374963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.375182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.375351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.375508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.375791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.375998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.376075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.376208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.376217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.376288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.376484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.376494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.376585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.376658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.376667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.376811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.376961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.376972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.377106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.377272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.377438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.377577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.377793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.377876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.377952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.378097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.378309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.378574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.378874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.378951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.379039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.379274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.379440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.379667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.977 qpair failed and we were unable to recover it. 00:30:00.977 [2024-12-16 14:34:15.379834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.977 [2024-12-16 14:34:15.379903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.379913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.380061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.380203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.380360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.380532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.380817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.380908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.380984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.381128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.381137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.381275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.381424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.381433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.381568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.381649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.381659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.381795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.381863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.381873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.381945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.382036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.382045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.382246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.382396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.382405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.382481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.382571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.382580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.382642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.382839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.382849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.382927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.383089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.383232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.383405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.383579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.383817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.383917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.384063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.384222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.384237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.384378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.384463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.384472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.384541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.384709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.384719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.384800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.384882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.384892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.384977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.385204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.385436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.385623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.385775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.385871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.385946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.386169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.386378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.386532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.386764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.386852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.386922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.387002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.387012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.978 [2024-12-16 14:34:15.387082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.387147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.978 [2024-12-16 14:34:15.387157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.978 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.387238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.387397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.387406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.387486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.387569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.387579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.387648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.387723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.387733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.387880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.387964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.387974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.388049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.388216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.388384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.388548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.388834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.388975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.389110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.389367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.389519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.389667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.389829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.389910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.390040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.390103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.390113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.390243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.390373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.390382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.390455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.390591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.390600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.390695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.390772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.390781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.390864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.391064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.391074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.391143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.391213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.391223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.391322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.391458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.391468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.391600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.391742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.391752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.391948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.392130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.392343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.392501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.392642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.392849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.392943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.393024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.393170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.393314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.393482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.393651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.393817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.393890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.394027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.394101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.394110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.394194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.394263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.394273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.979 qpair failed and we were unable to recover it. 00:30:00.979 [2024-12-16 14:34:15.394405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.979 [2024-12-16 14:34:15.394559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.394569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.394638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.394700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.394709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.394899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.394979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.394988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.395055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.395206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.395333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.395456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.395660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.395877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.395963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.396103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.396251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.396402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.396548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.396710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.396875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.396952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.397084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.397289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.397529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.397697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.397837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.397913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.397980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.398130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.398272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.398438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.398679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.398829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.398916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.399055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.399268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.399409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.399555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.399862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.399937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.400012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.400090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.400101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.400162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.400230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.400240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.400303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.400430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.400440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.980 qpair failed and we were unable to recover it. 00:30:00.980 [2024-12-16 14:34:15.400494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.400625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.980 [2024-12-16 14:34:15.400634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.400711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.400850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.400867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.400946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.401116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.401343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.401505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.401652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.401805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.401888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.401962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.402125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.402350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.402511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.402675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.402880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.402968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.403032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.403177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.403397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.403542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.403692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.403919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.403992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.404062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.404248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.404402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.404611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.404827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.404916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.404996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.405196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.405337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.405486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.405701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.405860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.405953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.406087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.406235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.406451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.406605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.406760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.406920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.406998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.407074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.407226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.407372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.981 [2024-12-16 14:34:15.407503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.981 [2024-12-16 14:34:15.407645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.981 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.407708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.407767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.407777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.407838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.407922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.407933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.408017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.408081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.408090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.408162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.408296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.408306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.408438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.408502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.408512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.408648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.408789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.408798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.408947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.409236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.409466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.409684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.409841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.409927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.409990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.410218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.410380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.410521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.410682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.410826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.410970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.411039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.411174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.411313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.411477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.411620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.411914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.411996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.412083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.412292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.412441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.412747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.412894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.412965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.413103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.413254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.413392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.413543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.413689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.982 qpair failed and we were unable to recover it. 00:30:00.982 [2024-12-16 14:34:15.413892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.982 [2024-12-16 14:34:15.413957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.413966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.414117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.414175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.414185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.414264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.414332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.414340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.414414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.414497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.414507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.414579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.414713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.414723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.414892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.415108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.415267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.415485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.415692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.415844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.415955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.416121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.416276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.416433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.416658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.416816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.416888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.416955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.417097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.417316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.417532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.417770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.417913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.417997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.418065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.418134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.418143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.418283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.418346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.418354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.983 qpair failed and we were unable to recover it. 00:30:00.983 [2024-12-16 14:34:15.418432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.983 [2024-12-16 14:34:15.418495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.418504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.418572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.418713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.418722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.418781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.418860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.418870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.418945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.419174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.419332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.419592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.419798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.419889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.419963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.420111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.420329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.420554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.420708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.420863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.420962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.421029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.421196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.421436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.421600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.421739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.421883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.421966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.422104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.422247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.422410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.422617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.422842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.422933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.423012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.423238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.423452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.423626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.984 qpair failed and we were unable to recover it. 00:30:00.984 [2024-12-16 14:34:15.423858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.984 [2024-12-16 14:34:15.423952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.424018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.424186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.424345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.424563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.424705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.424877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.424956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.425019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.425232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.425375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.425591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.425754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.425910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.425977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.426138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.426291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.426501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.426709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.426864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.426994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.427080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.427249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.427485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.427654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.427796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.427947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.428088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.428259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.428418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.428649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.428869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.428953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.429026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.429106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.429115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.429176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.429249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.985 [2024-12-16 14:34:15.429259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.985 qpair failed and we were unable to recover it. 00:30:00.985 [2024-12-16 14:34:15.429330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.429401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.429410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.429473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.429552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.429562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.429626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.429709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.429719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.429850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.429932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.429942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.430009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.430162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.430312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.430467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.430634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.430781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.430859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.430925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.431128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.431348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.431506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.431660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.431796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.431874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.431938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.432153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.432316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.432544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.432688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.432838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.432924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.433004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.433154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.433306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.433576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.433723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.986 qpair failed and we were unable to recover it. 00:30:00.986 [2024-12-16 14:34:15.433878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.986 [2024-12-16 14:34:15.433944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.433955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.434083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.434222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.434365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.434496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.434720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.434875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.434945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.435007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.435159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.435361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.435578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.435727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.435865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.435936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.435998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.436160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.436314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.436468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.436701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.436921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.436991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.437075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.437250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.437412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.437557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.437734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.437811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.437891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.438040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.438050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.438111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.438181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.438190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.438271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.438362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.438371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.987 qpair failed and we were unable to recover it. 00:30:00.987 [2024-12-16 14:34:15.438443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.987 [2024-12-16 14:34:15.438522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.438532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.438693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.438829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.438839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.438914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.438979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.438988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.439133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.439281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.439488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.439647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.439810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.439909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.439976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.440148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.440295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.440524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.440748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.440826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.440921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.441129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.441293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.441454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.441643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.441807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.441915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.442001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.442237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.442387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.442599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.442732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.442868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.442942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.443017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.443170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.443391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.443533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.988 [2024-12-16 14:34:15.443795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.988 [2024-12-16 14:34:15.443879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.988 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.443973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.444118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.444264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.444399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.444555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.444711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.444849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.444929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.445010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.445168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.445311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.445487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.445692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.445918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.445991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.446082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.446305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.446442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.446591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.446807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.446883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.446957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.447116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.447329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.447584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.447786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.447929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.448004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.448154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.448372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.448512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.448722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.448812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.448884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.449091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.449101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.989 qpair failed and we were unable to recover it. 00:30:00.989 [2024-12-16 14:34:15.449168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.989 [2024-12-16 14:34:15.449276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.449285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.449416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.449545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.449555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.449685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.449764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.449773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.449910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.449981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.449990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.450056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.450199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.450209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.450277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.450385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.450395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.450475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.450542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.450551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.450634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.450832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.450843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.450937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.451109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.451326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.451537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.451771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.451877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.452023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.452240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.452455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.452588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.452744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.452906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.452981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.453268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.453486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.453643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.453781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.453918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.454003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.454204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.454416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.454568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.454816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.454964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.455033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.455178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.455188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.990 [2024-12-16 14:34:15.455374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.455434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.990 [2024-12-16 14:34:15.455443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.990 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.455517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.455593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.455603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.455691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.455816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.455826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.455970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.456209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.456354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.456514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.456786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.456887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.457046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.457123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.457133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.457196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.457335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.457344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.457481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.457558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.457567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.457701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.457776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.457785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.457945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.458178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.458336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.458491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.458665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.458848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.458925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.459013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.459248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.459404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.459564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.459782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.459925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.460010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.460143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.460153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.460229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.460293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.460303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.460438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.460502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.991 [2024-12-16 14:34:15.460511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.991 qpair failed and we were unable to recover it. 00:30:00.991 [2024-12-16 14:34:15.460600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.460727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.460737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.460869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.460956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.460966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.461033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.461167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.461176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.461241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.461303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.461312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.461396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.461551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.461561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.461644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.461726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.461736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.461883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.462024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.462034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.462183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.462269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.462278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.462358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.462488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.462498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.462632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.462768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.462778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.462936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.463177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.463396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.463547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.463709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.463850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.463944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.464078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.464385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.464542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.464710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.464881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.464968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.465043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.465212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.465506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.465661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.465809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.465991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.466067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.466128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.466139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.466222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.466302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.466311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.466443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.466587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.466597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.992 qpair failed and we were unable to recover it. 00:30:00.992 [2024-12-16 14:34:15.466668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.992 [2024-12-16 14:34:15.466744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.466753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.466832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.466910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.466921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.467082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.467293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.467441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.467621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.467763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.467910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.467984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.468186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.468346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.468590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.468754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.468832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.468917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.469204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.469352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.469506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.469777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.469862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.470009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.470209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.470219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.470301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.470435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.470444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.470537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.470600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.470609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.470684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.470827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.470838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.470976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.471198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.471344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.471562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.471786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.471940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.472022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.472090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.472100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.472177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.472250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.472259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.472326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.472399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.472409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.472542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.472672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.993 [2024-12-16 14:34:15.472683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.993 qpair failed and we were unable to recover it. 00:30:00.993 [2024-12-16 14:34:15.472839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.472926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.472936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.473004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.473135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.473301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.473436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.473581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.473737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.473902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.473988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.474051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.474189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.474389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.474648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.474799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.474874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.475010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.475228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.475441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.475663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.475885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.475961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.476030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.476106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.476115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.476279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.476352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.476362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.476428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.476552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.476562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.476678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.476829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.476839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.476934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.477006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.477015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.477248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.477312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.477321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.477386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.477516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.477526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.477676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.477817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.477827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.477911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.478125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.478136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.478221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.478292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.478302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.478434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.478570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.478580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.994 qpair failed and we were unable to recover it. 00:30:00.994 [2024-12-16 14:34:15.478658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.994 [2024-12-16 14:34:15.478731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.478741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.478877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.479114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.479330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.479510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.479718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.479882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.480016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.480143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.480154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.480250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.480326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.480336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.480535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.480663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.480673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.480822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.480898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.480908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.481002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.481225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.481497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.481734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.481903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.481975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.482047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.482183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.482352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.482617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.482836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.482937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.483017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.483181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.483331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.483491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.483633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.483807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.483949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.995 [2024-12-16 14:34:15.484023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.484107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.995 [2024-12-16 14:34:15.484116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.995 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.484199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.484280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.484291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.484368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.484440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.484449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.484526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.484668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.484678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.484738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.484893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.484904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.484988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.485198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.485442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.485601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.485817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.485994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.486079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.486228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.486457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.486633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.486869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.486949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.487013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.487154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.487361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.487578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.487789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.487875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.488008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.488152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.488161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:00.996 [2024-12-16 14:34:15.488235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.488305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:00.996 [2024-12-16 14:34:15.488314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:00.996 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.488383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.488512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.488522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.488604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.488739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.488749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.488814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.488886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.488896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.488969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.489180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.489331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.489457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.489603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.489862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.489941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.490087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.490246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.490452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.286 qpair failed and we were unable to recover it. 00:30:01.286 [2024-12-16 14:34:15.490600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.286 [2024-12-16 14:34:15.490687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.490743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.490801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.490810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.490941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.491136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.491146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.491214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.491274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.491283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.491358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.491486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.491495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.491636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.491765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.491775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.491973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.492128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.492295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.492514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.492748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.492894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.492959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.493084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.493093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.493174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.493254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.493264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.493418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.493479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.493488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.493627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.493792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.493802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.493930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.494225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.494393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.494565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.494775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.494937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.495015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.495230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.495444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.495686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.495832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.495978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.496107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.496185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.496195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.496342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.496404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.496413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.496613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.496685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.496694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.496765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.496822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.496831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.496985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.497046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.287 [2024-12-16 14:34:15.497056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.287 qpair failed and we were unable to recover it. 00:30:01.287 [2024-12-16 14:34:15.497228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.497307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.497316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.497388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.497546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.497556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.497788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.497937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.497947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.498091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.498312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.498477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.498631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.498864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.498935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.499085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.499151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.499160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.499302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.499452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.499461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.499538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.499626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.499636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.499806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.499961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.499971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.500109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.500390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.500537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.500743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.500892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.500975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.501041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.501264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.501274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.501342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.501492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.501501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.501586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.501666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.501675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.501852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.501930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.501940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.502004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.502087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.502096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.502224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.502374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.502384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.502540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.502677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.502686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.502831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.502914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.502924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.503079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.503213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.503223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.503377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.503521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.503531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.503611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.503697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.503706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.503874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.503948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.503959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.288 qpair failed and we were unable to recover it. 00:30:01.288 [2024-12-16 14:34:15.504043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.504174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.288 [2024-12-16 14:34:15.504184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.504335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.504420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.504430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.504504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.504628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.504639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.504723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.504877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.504888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.504964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.505112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.505121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.505320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.505457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.505466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.505535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.505679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.505689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.505754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.505968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.505979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.506051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.506195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.506205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.506282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.506371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.506381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.506536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.506600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.506610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.506680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.506753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.506763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.506972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.507168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.507441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.507592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.507820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.507913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.508039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.508180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.508189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.508389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.508529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.508539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.508624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.508768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.508778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.508866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.508952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.508962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.509044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.509245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.509255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.509327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.509416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.509425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.509504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.509631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.509641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.509722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.509790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.509800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.509929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.510059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.510070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.510225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.510375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.510386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.510454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.510594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.510604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.510751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.510904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.510914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.511008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.511155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.289 [2024-12-16 14:34:15.511164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.289 qpair failed and we were unable to recover it. 00:30:01.289 [2024-12-16 14:34:15.511301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.511370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.511379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.511523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.511673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.511683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.511812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.511960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.511971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.512069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.512131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.512140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.512213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.512359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.512369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.512524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.512668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.512678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.512760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.512890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.512900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.513032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.513213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.513453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.513608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.513755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.513840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.513994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.514067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.514077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.514156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.514404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.514413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.514556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.514704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.514714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.514792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.514852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.514867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.514967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.515112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.515121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.515183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.515266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.515275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.515412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.515559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.515569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.515748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.515819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.515828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.515961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.516089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.516099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.516176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.516261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.516270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.516411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.516567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.516577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.516710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.516875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.516886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.516985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.517067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.517076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.517222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.517321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.517331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.290 qpair failed and we were unable to recover it. 00:30:01.290 [2024-12-16 14:34:15.517471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.290 [2024-12-16 14:34:15.517539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.517550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.517633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.517758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.517767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.517863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.517993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.518148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.518392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.518608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.518851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.518966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.519125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.519275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.519284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.519352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.519427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.519438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.519507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.519581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.519591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.519658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.519813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.519822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.519960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.520214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.520354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.520572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.520739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.520955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.521029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.521168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.521177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.521240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.521309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.521318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.521454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.521592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.521602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.521752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.521825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.521835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.521910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.522109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.522118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.522252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.522339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.522348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.522414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.522554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.522563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.522719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.522896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.522906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.522971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.523050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.523059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.523130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.523270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.523280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.523424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.523566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.523576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.523641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.523767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.523777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.291 qpair failed and we were unable to recover it. 00:30:01.291 [2024-12-16 14:34:15.523878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.291 [2024-12-16 14:34:15.524006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.524153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.524368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.524669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.524829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.524980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.525054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.525143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.525153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.525330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.525528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.525538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.525671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.525736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.525746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.525818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.525955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.525965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.526107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.526200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.526209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.526305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.526383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.526394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.526525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.526605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.526614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.526774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.526844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.526857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.526935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.527001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.527012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.527079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.527207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.527216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.527288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.527538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.527548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.527679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.527809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.527819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.527893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.528019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.528028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.528174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.528259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.528269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.528401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.528486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.528495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.528573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.528701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.528710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.528851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.529049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.529059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.529118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.529261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.529270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.529422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.529571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.529580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.529655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.529800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.529809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.529910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.530056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.530065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.530139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.530227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.530237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.530463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.530597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.530607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.530700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.530840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.530849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.530995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.531140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.292 [2024-12-16 14:34:15.531149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.292 qpair failed and we were unable to recover it. 00:30:01.292 [2024-12-16 14:34:15.531227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.531295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.531305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.531445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.531533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.531543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.531727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.531796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.531806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.531874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.532082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.532093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.532259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.532407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.532417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.532564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.532651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.532660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.532793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.532991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.533089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.533392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.533553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.533774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.533949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.534008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.534083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.534092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.534181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.534325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.534334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.534488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.534635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.534645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.534732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.534962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.534973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.535052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.535123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.535133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.535329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.535473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.535483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.535625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.535699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.535709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.535802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.536053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.536064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.536140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.536279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.536289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.536437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.536589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.536599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.536821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.536904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.536914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.537004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.537128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.537138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.537282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.537417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.537426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.537569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.537732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.537742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.537884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.537944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.537954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.538044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.538131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.538140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.538304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.538372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.538382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.538529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.538591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.538601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.293 qpair failed and we were unable to recover it. 00:30:01.293 [2024-12-16 14:34:15.538735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.293 [2024-12-16 14:34:15.538814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.538823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.538975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.539211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.539379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.539609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.539784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.539921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.540001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.540067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.540076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.540158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.540289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.540298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.540374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.540574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.540584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.540670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.540800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.540810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.540885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.541101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.541328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.541494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.541681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.541891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.541967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.542055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.542064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.542201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.542380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.542390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.542533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.542595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.542604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.542760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.542927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.542937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.543063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.543197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.543208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.543299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.543445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.543454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.543645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.543737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.543747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.543882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.544022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.544032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.544108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.544168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.544177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.544263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.544420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.544430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.544598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.544671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.544681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.544905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.545076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.545086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.545215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.545296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.545306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.545453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.545611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.545621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.545761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.545964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.294 [2024-12-16 14:34:15.545974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.294 qpair failed and we were unable to recover it. 00:30:01.294 [2024-12-16 14:34:15.546103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.546230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.546239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.546316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.546456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.546466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.546621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.546692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.546701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.546785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.546864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.546874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.546933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.547004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.547013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.547159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.547307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.547316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.547385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.547456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.547466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.547606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.547742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.547752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.547826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.548102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.548386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.548601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.548810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.548951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.549081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.549219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.549228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.549318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.549450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.549460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.549600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.549741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.549751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.549880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.550093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.550103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.550246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.550333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.550342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.550427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.550513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.550523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.550667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.550797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.550809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.550981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.551126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.551135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.551232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.551367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.551377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.551527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.551672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.551682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.551840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.551912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.551923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.552055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.552139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.552148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.552344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.552491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.295 [2024-12-16 14:34:15.552500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.295 qpair failed and we were unable to recover it. 00:30:01.295 [2024-12-16 14:34:15.552635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.552728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.552738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.552811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.552939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.552948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.553032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.553271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.553281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.553502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.553630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.553640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.553741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.553803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.553813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.553911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.554139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.554389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.554585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.554758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.554848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.554932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.555149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.555458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.555613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.555841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.555992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.556105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.556253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.556567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.556794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.556886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.557026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.557245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.557256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.557402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.557544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.557554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.557700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.557789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.557799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.557969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.558171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.558387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.558596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.558739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.558886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.559084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.559169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.559178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.559387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.559462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.559472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.296 qpair failed and we were unable to recover it. 00:30:01.296 [2024-12-16 14:34:15.559542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.559621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.296 [2024-12-16 14:34:15.559631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.559713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.559794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.559805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.559892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.559971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.559981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.560224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.560303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.560315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.560448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.560517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.560527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.560670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.560737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.560746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.560821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.560920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.560930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.561011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.561097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.561110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.561242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.561439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.561448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.561544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.561610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.561620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.561683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.561845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.561860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.561942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.562180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.562316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.562546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.562712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.562798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.562919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.563133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.563299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.563528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.563736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.563817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.563962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.564122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.564329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.564552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.564753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.564824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.564922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.565219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.565377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.565544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.297 qpair failed and we were unable to recover it. 00:30:01.297 [2024-12-16 14:34:15.565746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.297 [2024-12-16 14:34:15.565825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.565835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.565906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.566049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.566060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.566197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.566419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.566428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.566507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.566583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.566592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.566759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.566841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.566851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.566988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.567059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.567069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.567208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.567406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.567416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.567566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.567650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.567660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.567738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.567932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.567942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.568024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.568095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.568104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.568238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.568370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.568380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.568632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.568724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.568735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.568909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.568970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.568979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.569044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.569194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.569481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.569615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.569802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.569880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.570079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.570213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.570223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.570356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.570484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.570493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.570641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.570736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.570746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.570894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.570979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.570989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.571057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.571128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.571137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.571270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.571411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.571420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.571513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.571673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.571683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.571769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.571832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.571842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.571926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.572000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.572009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.572151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.572300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.572310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.572388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.572533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.572543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.298 [2024-12-16 14:34:15.572632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.572698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.298 [2024-12-16 14:34:15.572707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.298 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.572838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.572989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.573079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.573237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.573376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.573614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.573827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.573915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.574148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.574319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.574540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.574805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.574892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.574959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.575114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.575337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.575646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.575831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.575920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.576048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.576216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.576226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.576307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.576447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.576456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.576538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.576693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.576704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.576782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.576862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.576872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.576941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.577169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.577358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.577526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.577785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.577863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.577932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.578100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.578110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.578185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.578257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.299 [2024-12-16 14:34:15.578266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.299 qpair failed and we were unable to recover it. 00:30:01.299 [2024-12-16 14:34:15.578402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.578475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.578485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.578547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.578690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.578700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.578777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.578860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.578871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.579000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.579203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.579342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.579490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.579763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.579866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.580003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.580145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.580154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.580219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.580376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.580385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.580522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.580671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.580681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.580738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.580807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.580816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.580957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.581017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.581027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.581103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.581243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.581253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.581453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.581526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.581536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.581670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.581820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.581830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.581908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.582136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.582477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.582641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.582861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.582950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.583092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.583172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.583181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.583333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.583467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.583477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.583537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.583623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.583633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.583709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.583840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.583850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.583952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.584120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.584312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.584542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.300 qpair failed and we were unable to recover it. 00:30:01.300 [2024-12-16 14:34:15.584822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.300 [2024-12-16 14:34:15.584965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.585036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.585113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.585124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.585272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.585474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.585484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.585635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.585699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.585708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.585781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.585933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.585944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.586085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.586159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.586168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.586320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.586406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.586415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.586627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.586689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.586698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.586851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.587099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.587356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.587502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.587826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.587920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.587995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.588148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.588346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.588590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.588813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.588893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.589030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.589240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.589250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.589345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.589431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.589442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.589513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.589582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.589592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.589664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.589882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.589892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.589958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.590124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.590134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.590210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.590355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.590365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.590510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.590593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.590603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.590747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.590946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.590957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.591034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.591114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.591124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.591220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.591365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.591374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.591444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.591643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.591653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.591784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.591997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.301 [2024-12-16 14:34:15.592008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.301 qpair failed and we were unable to recover it. 00:30:01.301 [2024-12-16 14:34:15.592153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.592239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.592249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.592391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.592613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.592623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.592766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.592907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.592918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.593049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.593220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.593394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.593620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.593766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.593938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.594013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.594098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.594107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.594201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.594342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.594352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.594417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.594514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.594524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.594656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.594876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.594886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.594965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.595022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.595032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.595239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.595310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.595322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.595532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.595671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.595681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.595891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.595972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.595981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.596109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.596180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.596190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.596247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.596315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.596324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.596400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.596543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.596553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.596715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.596799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.596808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.596936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.597153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.597390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.597611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.597824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.597916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.598070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.598222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.598232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.598293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.598381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.598390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.598530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.598661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.598671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.598825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.598971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.598982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.302 [2024-12-16 14:34:15.599129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.599207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.302 [2024-12-16 14:34:15.599217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.302 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.599419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.599504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.599513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.599712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.599786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.599795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.599924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.600092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.600101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.600170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.600315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.600327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.600539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.600690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.600699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.600840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.601183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.601421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.601589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.601731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.601814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.602046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.602117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.602126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.602325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.602388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.602397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.602460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.602537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.602546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.602638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.602778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.602788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.602869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.603043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.603052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.603186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.603279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.603289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.603372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.603554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.603565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.603639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.603771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.603781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.603925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.604130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.604267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.604505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.604757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.604842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.604922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.605221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.605365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.605524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.605745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.605833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.605896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.606046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.606055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.303 qpair failed and we were unable to recover it. 00:30:01.303 [2024-12-16 14:34:15.606143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.303 [2024-12-16 14:34:15.606292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.606302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.606468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.606623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.606632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.606875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.607111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.607260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.607560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.607805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.607889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.607946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.608252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.608417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.608550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.608751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.608931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.608999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.609148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.609391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.609622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.609830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.609990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.610131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.610286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.610446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.610663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.610890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.610964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.611103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.611248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.611257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.611335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.611472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.611482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.611643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.611721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.611731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.611802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.611939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.611949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.304 qpair failed and we were unable to recover it. 00:30:01.304 [2024-12-16 14:34:15.612025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.304 [2024-12-16 14:34:15.612096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.612105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.612180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.612343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.612353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.612489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.612558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.612568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.612715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.612786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.612795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.612863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.613026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.613036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.613177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.613237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.613246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.613519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.613591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.613602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.613664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.613802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.613811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.613959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.614156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.614428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.614618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.614830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.614976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.615121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.615210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.615219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.615292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.615444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.615454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.615605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.615756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.615766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.615844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.615924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.615934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.616013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.616165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.616175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.616370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.616445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.616455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.616571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.616705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.616715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.616790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.616927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.616936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.617082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.617221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.617231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.617309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.617452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.617462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.617705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.617795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.617805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.617964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.618038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.618049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.618184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.618265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.618275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.618467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.618639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.618649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.618730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.618806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.618816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.618899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.619026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.619036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.305 [2024-12-16 14:34:15.619134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.619286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.305 [2024-12-16 14:34:15.619302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.305 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.619403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.619570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.619585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.619660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.619838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.619852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.620014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.620124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.620138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.620225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.620318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.620332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.620416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.620519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.620533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.620699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.620843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.620858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.620959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.621040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.621049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.621131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.621269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.621279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.621461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.621559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.621568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.621734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.621934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.621944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.622016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.622239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.622409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.622565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.622721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.622862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.622929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.623092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.623296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.623508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.623674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.623816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.623973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.624175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.624454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.624632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.624810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.624884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.625015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.625224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.625386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.625572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.306 qpair failed and we were unable to recover it. 00:30:01.306 [2024-12-16 14:34:15.625840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.306 [2024-12-16 14:34:15.625932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.625942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.626082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.626155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.626165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.626245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.626321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.626330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.626489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.626719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.626729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.626806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.626889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.626900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.627100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.627303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.627313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.627454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.627596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.627606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.627690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.627757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.627767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.627911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.628227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.628468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.628719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.628879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.628970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.629050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.629342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.629522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.629667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.629826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.629915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.630070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.630285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.630502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.630650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.630813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.630916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.630988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.631140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.631276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.631487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.631640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.631885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.631959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.307 [2024-12-16 14:34:15.632124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.632289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.307 [2024-12-16 14:34:15.632298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.307 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.632366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.632512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.632523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.632667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.632734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.632744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.632896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.632974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.632983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.633179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.633258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.633267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.633345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.633488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.633497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.633666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.633743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.633752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.633841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.633930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.633941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.634022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.634247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.634453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.634605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.634882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.634969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.635114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.635267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.635277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.635414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.635492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.635502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.635606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.635669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.635678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.635753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.635889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.635899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.635968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.636146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.636316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.636469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.636812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.636905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.636970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.637129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.637361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.637510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.637816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.637899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.308 qpair failed and we were unable to recover it. 00:30:01.308 [2024-12-16 14:34:15.637979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.308 [2024-12-16 14:34:15.638072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.638170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.638502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.638717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.638881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.638978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.639061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.639274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.639284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.639365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.639430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.639440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.639594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.639653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.639662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.639730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.639789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.639799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.639925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.640064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.640074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.640219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.640290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.640299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.640374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.640447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.640456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.640673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.640767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.640777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.640938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.641111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.641249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.641474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.641680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.641829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.641980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.642050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.642220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.642388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.642679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.642829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.642914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.642998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.643139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.643316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.643559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.643791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.643943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.309 [2024-12-16 14:34:15.644086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.644251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.309 [2024-12-16 14:34:15.644261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.309 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.644332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.644397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.644406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.644468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.644589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.644598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.644677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.644746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.644756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.645009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.645159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.645169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.645231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.645299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.645309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.645440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.645508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.645518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.645645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.645725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.645735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.645878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.646113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.646336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.646492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.646773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.646845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.646936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.647230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.647455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.647747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.647916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.647997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.648172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.648269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.648280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.648350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.648507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.648516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.648660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.648817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.648826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.648897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.649180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.649190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.649321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.649396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.649407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.649480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.649551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.649560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.649691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.649906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.649916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.649992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.650066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.650075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.650169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.650314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.650323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.650472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.650634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.650643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.650776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.650859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.650869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.650966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.651107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.651116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.310 qpair failed and we were unable to recover it. 00:30:01.310 [2024-12-16 14:34:15.651200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.310 [2024-12-16 14:34:15.651365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.651374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.651511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.651657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.651667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.651750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.651911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.651921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.652003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.652133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.652142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.652220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.652303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.652313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.652468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.652546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.652555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.652648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.652727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.652744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.652828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.653002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.653018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.653102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.653247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.653262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.653449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.653523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.653538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.653680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.653846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.653867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.653961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.654230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.654491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.654666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.654918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.654993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.655012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.655119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.655290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.655309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.655480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.655641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.655657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.655869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.655956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.655970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.656045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.656141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.656156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.656260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.656406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.656421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.656639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.656724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.656738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.656815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.656899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.656909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.657045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.657183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.657386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.657589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.657729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.657819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.657956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.658048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.658057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.658192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.658283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.311 [2024-12-16 14:34:15.658292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.311 qpair failed and we were unable to recover it. 00:30:01.311 [2024-12-16 14:34:15.658433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.658525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.658535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.658703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.658791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.658800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.658870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.659079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.659384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.659575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.659746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.659885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.660103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.660240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.660249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.660417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.660492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.660502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.660578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.660651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.660661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.660881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.660950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.660960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.661037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.661098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.661107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.661188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.661316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.661325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.661397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.661474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.661483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.661617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.661765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.661775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.661923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.662152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.662357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.662494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.662660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.662800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.662939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.663094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.663103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.663327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.663456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.663467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.663583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.663673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.663683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.663826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.663916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.663927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.664068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.664149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.664159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.664220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.664287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.664296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.664427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.664568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.664579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.664710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.664845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.664859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.664935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.665001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.665010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.312 qpair failed and we were unable to recover it. 00:30:01.312 [2024-12-16 14:34:15.665166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.312 [2024-12-16 14:34:15.665295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.665304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.665434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.665563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.665572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.665811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.665884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.665895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.665979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.666126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.666136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.666210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.666289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.666298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.666398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.666605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.666614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.666837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.666917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.666927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.667053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.667201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.667213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.667375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.667465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.667474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.667562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.667635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.667644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.667797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.667890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.667900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.668040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.668128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.668138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.668269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.668355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.668364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.668434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.668500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.668509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.668642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.668879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.668889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.668969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.669173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.669183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.669263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.669403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.669412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.669499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.669630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.669641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.669781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.669927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.669937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.670079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.670248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.670409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.670557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.670801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.670888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.670953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.671036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.671045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.671118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.671200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.313 [2024-12-16 14:34:15.671210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.313 qpair failed and we were unable to recover it. 00:30:01.313 [2024-12-16 14:34:15.671285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.671359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.671368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.671525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.671691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.671701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.671788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.671938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.671948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.672155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.672231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.672240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.672393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.672478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.672487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.672651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.672792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.672801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.672864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.673128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.673308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.673467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.673683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.673835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.673934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.674064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.674074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.674153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.674281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.674291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.674439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.674535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.674545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.674684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.674821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.674831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.674964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.675102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.675112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.675258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.675354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.675364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.675495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.675627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.675637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.675768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.675926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.675937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.676083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.676216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.676225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.676304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.676450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.676460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.676536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.676664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.676674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.676824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.676886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.676896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.676969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.677114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.677124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.677210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.677341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.677350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.677485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.677695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.677704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.677858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.677920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.677930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.678022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.678092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.678102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.678271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.678332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.678349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.314 qpair failed and we were unable to recover it. 00:30:01.314 [2024-12-16 14:34:15.678456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.678614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.314 [2024-12-16 14:34:15.678624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.678696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.678779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.678788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.678879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.678962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.678971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.679053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.679236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.679245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.679328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.679491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.679500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.679720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.679863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.679873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.680017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.680236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.680246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.680388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.680454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.680464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.680569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.680793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.680803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.680940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.681130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.681354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.681578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.681743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.681832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.681924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.682213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.682493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.682678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.682821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.682964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.683129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.683302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.683312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.683397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.683468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.683477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.683613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.683694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.683704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.683794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.683880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.683889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.683981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.684049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.684058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.684217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.684415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.684425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.684626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.684709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.684719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.684794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.684880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.684890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.685039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.685104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.685113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.685256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.685384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.685394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.315 [2024-12-16 14:34:15.685544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.685614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.315 [2024-12-16 14:34:15.685624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.315 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.685754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.685825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.685834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.685921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.685996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.686142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.686297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.686577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.686835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.686930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.687172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.687268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.687277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.687351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.687431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.687441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.687596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.687681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.687691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.687829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.687972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.687982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.688055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.688192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.688202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.688273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.688347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.688356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.688430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.688510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.688520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.688617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.688783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.688800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.688990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.689191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.689446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.689692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.689876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.689960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.690032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.690257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.690405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.690552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.690809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.690992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.691069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.691197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.691206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.691298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.691362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.691372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.691571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.691653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.691662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.691761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.691838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.691848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.691926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.692003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.692013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.316 qpair failed and we were unable to recover it. 00:30:01.316 [2024-12-16 14:34:15.692180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.316 [2024-12-16 14:34:15.692333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.692342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.692538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.692623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.692633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.692700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.692777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.692787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.692921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.693055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.693065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.693260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.693340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.693350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.693489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.693553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.693563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.693709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.693875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.693886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.693970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.694122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.694277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.694471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.694791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.694930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.695065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.695159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.695169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.695295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.695509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.695519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.695661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.695795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.695805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.695939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.696132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.696437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.696676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.696906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.696987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.697079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.697152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.697162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.697376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.697466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.697476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.697628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.697704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.697715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.697879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.697957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.697967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.698044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.698235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.698247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.698465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.698545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.698555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.698633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.698771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.317 [2024-12-16 14:34:15.698780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.317 qpair failed and we were unable to recover it. 00:30:01.317 [2024-12-16 14:34:15.698982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.699061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.699072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.699144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.699284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.699294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.699442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.699533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.699543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.699619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.699784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.699793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.699995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.700215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.700225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.700307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.700400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.700410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.700583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.700647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.700657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.700805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.701033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.701045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.701134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.701345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.701355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.701437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.701507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.701517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.701593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.701734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.701744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.701972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.702118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.702129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.702282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.702357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.702367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.702439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.702572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.702583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.702780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.702912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.702922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.703012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.703119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.703128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.703345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.703483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.703493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.703576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.703769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.703780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.703888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.704035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.704045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.704124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.704207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.704217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.704416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.704587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.704597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.704754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.704845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.704859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.704942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.705080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.705283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.705502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.705692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.705845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.706083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.706246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.706257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.706403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.706544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.706554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.318 qpair failed and we were unable to recover it. 00:30:01.318 [2024-12-16 14:34:15.706706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.318 [2024-12-16 14:34:15.706783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.706793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.706871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.707221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.707444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.707669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.707888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.707970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.708046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.708135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.708145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.708281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.708370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.708380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.708461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.708601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.708610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.708701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.708764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.708774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.708923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.709015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.709024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.709107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.709231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.709241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.709380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.709463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.709473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.709618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.709776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.709786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.709944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.710102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.710112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.710190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.710268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.710278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.710425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.710510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.710520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.710683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.710832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.710842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.711017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.711190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.711476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.711638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.711861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.711935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.712026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.712219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.712228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.712311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.712446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.712456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.712608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.712687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.712697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.712924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.712992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.713002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.713100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.713252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.713262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.713344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.713470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.713480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.713578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.713656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.319 [2024-12-16 14:34:15.713666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.319 qpair failed and we were unable to recover it. 00:30:01.319 [2024-12-16 14:34:15.713802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.713936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.713947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.714031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.714318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.714496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.714644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.714794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.714927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.715077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.715280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.715290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.715464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.715549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.715559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.715716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.715861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.715871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.716045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.716157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.716167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.716341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.716515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.716525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.716623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.716758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.716768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.716846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.716919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.716929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.717080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.717296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.717306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.717390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.717462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.717472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.717673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.717874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.717885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.717995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.718197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.718207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.718378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.718436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.718446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.718536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.718674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.718683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.718778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.718924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.718935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.719028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.719222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.719231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.719306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.719474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.719483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.719578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.719711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.719720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.719792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.719980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.719990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.720074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.720165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.720175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.720312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.720458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.720468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.720602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.720729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.720740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.720933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.721078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.721088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.721160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.721374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.721383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.320 qpair failed and we were unable to recover it. 00:30:01.320 [2024-12-16 14:34:15.721572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.721773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.320 [2024-12-16 14:34:15.721782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.722010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.722142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.722152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.722348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.722438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.722448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.722615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.722815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.722825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.722969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.723046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.723056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.723112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.723271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.723280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.723507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.723729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.723739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.723815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.723896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.723906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.724131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.724280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.724290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.724367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.724442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.724451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.724585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.724667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.724677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.724748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.724817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.724826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.724974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.725195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.725206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.725282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.725430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.725440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.725520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.725713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.725722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.725886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.725980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.725990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.726070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.726167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.726177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.726257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.726344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.726354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.726439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.726591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.726601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.726722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.726865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.726875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.726985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.727166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.727181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.727345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.727449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.727464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.727668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.727840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.727861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.727948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.728082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.728092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.728169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.728302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.728312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.728395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.728484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.728494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.321 [2024-12-16 14:34:15.728634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.728763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.321 [2024-12-16 14:34:15.728772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.321 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.728917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.729025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.729035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.729170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.729373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.729383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.729517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.729605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.729615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.729747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.729826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.729836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.730009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.730088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.730098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.730231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.730384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.730394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.730472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.730606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.730616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.730686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.730845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.730860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.731030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.731184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.731194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.731327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.731473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.731483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.731575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.731649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.731659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.731768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.731916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.731927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.732000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.732078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.732087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.732240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.732338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.732348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.732547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.732685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.732695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.732837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.732976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.732987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.733077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.733227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.733237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.733322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.733404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.733413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.733616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.733752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.733762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.733957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.734036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.734046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.734120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.734353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.734363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.734552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.734639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.734648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.734794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.734870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.734881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.735044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.735120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.735130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.735265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.735488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.735498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.735578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.735710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.735720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.735876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.736002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.736011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.736159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.736305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.736315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.736506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.736636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.736645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.322 qpair failed and we were unable to recover it. 00:30:01.322 [2024-12-16 14:34:15.736721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.322 [2024-12-16 14:34:15.736864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.736874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.737082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.737155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.737165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.737324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.737405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.737415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.737566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.737639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.737649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.737729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.737823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.737833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.738024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.738099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.738108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.738260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.738334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.738343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.738417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.738613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.738622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.738704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.738787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.738797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.738868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.739248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.739407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.739679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.739835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.739968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.740111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.740197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.740208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.740350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.740484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.740494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.740564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.740655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.740665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.740751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.740819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.740828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.740988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.741213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.741377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.741558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.741837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.741993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.742136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.742277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.742287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.742423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.742561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.742573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.742772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.742921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.742931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.743011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.743150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.743160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.743242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.743310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.743319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.743518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.743663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.743673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.323 [2024-12-16 14:34:15.743812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.743964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.323 [2024-12-16 14:34:15.743974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.323 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.744048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.744196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.744206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.744349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.744411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.744421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.744567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.744641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.744650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.744779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.744863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.744873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.744953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.745153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.745165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.745255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.745399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.745409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.745581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.745663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.745672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.745757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.745830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.745839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.745971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.746142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.746314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.746602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.746757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.746840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.747052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.747189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.747199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.747261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.747402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.747414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.747544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.747606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.747616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.747752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.747933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.747943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.748024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.748159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.748168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.748319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.748485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.748494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.748675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.748767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.748777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.748952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.749083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.749243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.749569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.749908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.749998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.750088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.750341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.750541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.750828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.750986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.324 qpair failed and we were unable to recover it. 00:30:01.324 [2024-12-16 14:34:15.751155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.324 [2024-12-16 14:34:15.751218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.751228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.751308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.751438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.751449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.751532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.751677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.751687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.751758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.751899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.751909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.752044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.752241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.752251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.752391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.752474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.752484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.752614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.752691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.752701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.752776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.752851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.752866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.752997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.753065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.753075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.753277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.753432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.753441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.753534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.753630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.753640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.753742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.753877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.753886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.754094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.754295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.754305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.754442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.754591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.754602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.754748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.754830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.754840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.754933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.755135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.755315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.755661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.755811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.755951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.756029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.756106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.756115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.756261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.756358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.756367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.756448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.756577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.756587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.756663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.756790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.756799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.756865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.757158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.757404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.757631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.757872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.757939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.757992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.758060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.325 [2024-12-16 14:34:15.758070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.325 qpair failed and we were unable to recover it. 00:30:01.325 [2024-12-16 14:34:15.758140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.758223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.758233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.758314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.758447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.758457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.758535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.758622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.758632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.758779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.758928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.758939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.759014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.759072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.759080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.759205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.759281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.759290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.759487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.759568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.759578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.759796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.759878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.759888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.759970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.760106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.760115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.760255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.760450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.760461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.760646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.760776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.760786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.760928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.761058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.761067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.761235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.761358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.761368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.761564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.761732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.761742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.761877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.762160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.762408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.762616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.762851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.762999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.763088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.763161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.763170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.763320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.763484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.763494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.763662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.763739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.763749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.763844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.763926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.763935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.764014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.764212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.764221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.764314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.764445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.764454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.326 [2024-12-16 14:34:15.764590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.764668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.326 [2024-12-16 14:34:15.764677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.326 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.764813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.764960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.764976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.765055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.765160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.765175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.765274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.765370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.765385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.765525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.765682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.765697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.765800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.765974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.765990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.766079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.766264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.766279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.766365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.766469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.766483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.766559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.766635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.766650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.766795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.767002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.767018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.767163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.767337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.767347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.767435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.767628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.767646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.767813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.767902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.767917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.768007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.768105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.768120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.768267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.768362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.768372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.768571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.768642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.768652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.768784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.768848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.768862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.769005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.769195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.769425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.769646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.769810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.769898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.769982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.770122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.770131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.770212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.770279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.770289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.770486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.770574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.770583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.770737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.770812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.770821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.770904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.771143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.771358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.771674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.327 qpair failed and we were unable to recover it. 00:30:01.327 [2024-12-16 14:34:15.771836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.327 [2024-12-16 14:34:15.771977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.771988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.772052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.772248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.772258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.772341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.772420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.772430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.772599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.772737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.772746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.772823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.772881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.772890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.773023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.773166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.773176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.773321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.773484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.773494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.773635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.773768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.773778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.773990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.774242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.774252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.774428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.774596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.774605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.774737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.774806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.774815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.774898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.775066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.775076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.775152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.775294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.775304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.775385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.775523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.775533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.775617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.775750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.775760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.775906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.776043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.776053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.776119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.776269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.776279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.776424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.776588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.776597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.776794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.776938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.776949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.777079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.777157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.777167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.777239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.777373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.777382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.777538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.777628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.777638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.777710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.777797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.777806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.777879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.778155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.778393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.778632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.778861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.778956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.779023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.779085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.779093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.779263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.779328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.328 [2024-12-16 14:34:15.779337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.328 qpair failed and we were unable to recover it. 00:30:01.328 [2024-12-16 14:34:15.779473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.779548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.779557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.779621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.779767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.779779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.779928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.780224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.780388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.780611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.780888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.780977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.781120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.781202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.781212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.781281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.781409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.781418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.781553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.781697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.781706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.781852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.781927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.781936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.782013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.782167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.782178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.782260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.782319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.782328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.782390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.782549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.782558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.782700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.782862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.782873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.782941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.783068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.783078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.783257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.783421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.783430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.783569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.783654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.783664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.783749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.783822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.783832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.784055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.784228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.784238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.784314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.784381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.784391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.784486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.784640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.784653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.784729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.784865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.784876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.785028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.785173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.785341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.785638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.785863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.785996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.786005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.786142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.786209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.786219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.329 qpair failed and we were unable to recover it. 00:30:01.329 [2024-12-16 14:34:15.786290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.786363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.329 [2024-12-16 14:34:15.786373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.786453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.786621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.786631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.786716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.786803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.786813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.786885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.787243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.787481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.787641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.787828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.787969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.788043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.788306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.788454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.788695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.788848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.788993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.789160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.789320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.789330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.789407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.789540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.789550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.789683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.789747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.789757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.789820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.789903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.789913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.790063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.790212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.790222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.790300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.790375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.790384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.790448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.790577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.790586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.790736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.790907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.790916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.791049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.791259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.791422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.791579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.791735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.791810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.330 qpair failed and we were unable to recover it. 00:30:01.330 [2024-12-16 14:34:15.791967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.330 [2024-12-16 14:34:15.792044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.792053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.792277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.792351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.792361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.792431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.792640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.792650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.792780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.792852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.792867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.793038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.793116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.793125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.793388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.793541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.793557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.793690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.793819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.793828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.794049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.794190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.794200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.794284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.794350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.794359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.794503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.794661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.794670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.794751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.794952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.794962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.795056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.795308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.795527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.795692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.795897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.795966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.796044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.796177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.796188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.796334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.796396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.796405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.796552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.796622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.796632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.796688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.796845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.796859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.796933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.797016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.797026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.331 qpair failed and we were unable to recover it. 00:30:01.331 [2024-12-16 14:34:15.797151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.331 [2024-12-16 14:34:15.797229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.797238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.797411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.797482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.797492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.797690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.797825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.797835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.797928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.798171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.798421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.798595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.798763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.798923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.799006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.799175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.799359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.799563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.799730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.799880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.799977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.800045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.800217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.800405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.800583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.800726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.800862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.800943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.801002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.801070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.801079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.801214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.801282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.801292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.801520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.801648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.801658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.801720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.801806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.801816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.801920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.802205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.802355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.802555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.802757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.802831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.802918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.803149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.803388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.803543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.803717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.803807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.332 qpair failed and we were unable to recover it. 00:30:01.332 [2024-12-16 14:34:15.803936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.332 [2024-12-16 14:34:15.804004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.804150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.804336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.804558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.804792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.804870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.804934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.805100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.805266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.805418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.805567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.805797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.805882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.805965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.806267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.806429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.806583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.806748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.806895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.806973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.807264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.807437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.807566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.807795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.807884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.807968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.808142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.808290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.808519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.808754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.808902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.808995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.809134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.809350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.809509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.809657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.809809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.809888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.809982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.810052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.810061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.810194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.810334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.810344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.333 qpair failed and we were unable to recover it. 00:30:01.333 [2024-12-16 14:34:15.810415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.810613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.333 [2024-12-16 14:34:15.810623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.810751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.810818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.810828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.810898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.810962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.810971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.811050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.811214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.811355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.811506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.811787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.811873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.812014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.812239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.812450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.812607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.812870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.812965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.813101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.813259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.813402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.813616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.813825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.813908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.814040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.814284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.814435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.814569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.814720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.814864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.814946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.815065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.815138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.815148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.815303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.815401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.815411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.815501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.815578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.815588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.815667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.815798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.815808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.815946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.816115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.816340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.816529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.334 qpair failed and we were unable to recover it. 00:30:01.334 [2024-12-16 14:34:15.816728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.334 [2024-12-16 14:34:15.816798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.816927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.816996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.817082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.817219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.817385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.817670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.817840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.817990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.818065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.818203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.818213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.818410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.818477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.818487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.818627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.818687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.818697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.818839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.818919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.818929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.819008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.819221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.819362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.819502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.819712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.819789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.819863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.820189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.820348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.820499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.820712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.820863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.820948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.821096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.821260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.821395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.821630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.821830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.821972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.822050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.822195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.822357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.822650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.822857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.822950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.335 [2024-12-16 14:34:15.823116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.823183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.335 [2024-12-16 14:34:15.823193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.335 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.823319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.823388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.823397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.823492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.823558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.823568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.823636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.823695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.823704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.823792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.823880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.823891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.823990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.824292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.824456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.824612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.824767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.824877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.824960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.825124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.825385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.825547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.825778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.825864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.826024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.826163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.826173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.826263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.826331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.826341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.826477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.826571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.826581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.826732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.826806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.826815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.826911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.827137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.827388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.827540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.827712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.827874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.827953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.828021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.828089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.828100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.828211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.828290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.336 [2024-12-16 14:34:15.828300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.336 qpair failed and we were unable to recover it. 00:30:01.336 [2024-12-16 14:34:15.828371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.619 [2024-12-16 14:34:15.828441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.619 [2024-12-16 14:34:15.828452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.619 qpair failed and we were unable to recover it. 00:30:01.619 [2024-12-16 14:34:15.828518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.619 [2024-12-16 14:34:15.828588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.619 [2024-12-16 14:34:15.828598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.619 qpair failed and we were unable to recover it. 00:30:01.619 [2024-12-16 14:34:15.828664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.619 [2024-12-16 14:34:15.828756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.828766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.828910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.829155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.829442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.829681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.829846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.829923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.829991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.830150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.830160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.830226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.830376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.830386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.830475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.830602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.830612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.830672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.830895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.830906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.831099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.831241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.831252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.831404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.831489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.831499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.831631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.831707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.831717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.831782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.831975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.831985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.832188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.832265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.832275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.832355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.832500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.832510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.832590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.832650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.832659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.832758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.832829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.832839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.832938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.833194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.833373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.833537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.833704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.833787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.833864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.834172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.834314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.834447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.834658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.834734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.834878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.835032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.835042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.620 qpair failed and we were unable to recover it. 00:30:01.620 [2024-12-16 14:34:15.835108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.620 [2024-12-16 14:34:15.835190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.835278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.835426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.835558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.835722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.835794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.835946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.836103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.836347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.836633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.836766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.836926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.836997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.837203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.837350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.837611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.837899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.837982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.838062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.838191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.838201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.838334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.838415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.838425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.838568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.838637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.838647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.838796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.838874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.838884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.839019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.839188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.839361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.839580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.839770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.839910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.840055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.840137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.840147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.840275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.840416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.840425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.840590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.840652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.840661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.840806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.840932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.840943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.841157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.841299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.841309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.621 [2024-12-16 14:34:15.841530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.841593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.621 [2024-12-16 14:34:15.841603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.621 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.841677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.841767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.841777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.841980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.842163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.842407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.842641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.842863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.842957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.843032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.843237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.843247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.843313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.843457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.843467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.843615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.843695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.843705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.843770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.843861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.843872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.843956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.844113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.844124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.844290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.844437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.844446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.844539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.844666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.844676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.844763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.844921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.844932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.845009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.845212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.845431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.845642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.845814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.845904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.846070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.846149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.846158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.846309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.846455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.846464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.846549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.846687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.846697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.846783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.846863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.846874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.847044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.847106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.847115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.847205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.847343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.847353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.847487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.847626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.847636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.847776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.847839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.847848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.847934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.848071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.848083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.848160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.848289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.848299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.622 qpair failed and we were unable to recover it. 00:30:01.622 [2024-12-16 14:34:15.848432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.622 [2024-12-16 14:34:15.848585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.848595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.848686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.848784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.848794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.848934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.849018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.849028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.849200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.849274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.849283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.849495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.849651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.849661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.849809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.849908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.849918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.850067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.850195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.850205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.850275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.850354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.850364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.850455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.850541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.850553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.850683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.850758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.850767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.850910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.851162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.851310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.851570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.851800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.851902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.851993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.852148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.852157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.852245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.852386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.852396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.852461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.852607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.852617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.852841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.852929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.852942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.853017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.853142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.853152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.853301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.853364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.853374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.853465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.853597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.853606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.853681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.853821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.853831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.853967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.854110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.854120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.854251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.854328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.854338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.854423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.854691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.854701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.854783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.854913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.854923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.855016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.855147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.855157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.855299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.855383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.855393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.623 [2024-12-16 14:34:15.855490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.855684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.623 [2024-12-16 14:34:15.855694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.623 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.855769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.855845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.855859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.856003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.856081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.856091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.856231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.856298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.856308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.856393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.856522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.856532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.856662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.856817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.856828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.856895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.857049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.857059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.857227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.857440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.857450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.857582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.857674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.857684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.857815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.857892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.857903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.858054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.858131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.858141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.858293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.858504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.858514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.858594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.858728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.858737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.858910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.859126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.859258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.859623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.859845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.859921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.860124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.860260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.860270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.860414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.860498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.860508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.860595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.860738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.860748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.860883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.861176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.861327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.861493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.861653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.624 [2024-12-16 14:34:15.861790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.624 qpair failed and we were unable to recover it. 00:30:01.624 [2024-12-16 14:34:15.861880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.861942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.861952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.862083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.862245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.862254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.862332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.862493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.862502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.862559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.862764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.862774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.862903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.863121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.863300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.863459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.863631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.863779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.863909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.864166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.864327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.864643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.864796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.864893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.864983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.865166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.865429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.865648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.865824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.865895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.865963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.866056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.866065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.866192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.866275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.866285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.866432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.866586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.866596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.866671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.866798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.866807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.866890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.867084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.867094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.867279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.867346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.867355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.867520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.867644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.867654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.867729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.867871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.867882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.867975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.868054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.868063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.868212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.868303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.868314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.625 qpair failed and we were unable to recover it. 00:30:01.625 [2024-12-16 14:34:15.868569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.625 [2024-12-16 14:34:15.868655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.868664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.868754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.868892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.868902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.869034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.869163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.869173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.869302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.869395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.869405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.869485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.869552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.869562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.869702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.869773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.869783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.869934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.870082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.870092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.870171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.870313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.870323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.870459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.870530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.870540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.870603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.870691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.870700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.870831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.871095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.871268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.871446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.871730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.871884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.871985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.872123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.872195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.872205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.872346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.872479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.872489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.872629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.872717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.872726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.872864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.872994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.873003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.873059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.873284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.873294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.873427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.873498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.873507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.873656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.873798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.873808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.873890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.874115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.874353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.874610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.874873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.874965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.875063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.875140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.875150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.875226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.875423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.626 [2024-12-16 14:34:15.875433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.626 qpair failed and we were unable to recover it. 00:30:01.626 [2024-12-16 14:34:15.875511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.875586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.875596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.875737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.875871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.875882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.876079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.876151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.876161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 553391 Killed "${NVMF_APP[@]}" "$@" 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.876393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.876498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.876515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.876605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.876701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.876717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 14:34:15 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:01.627 [2024-12-16 14:34:15.876935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.877025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.877041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.877146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 14:34:15 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:01.627 [2024-12-16 14:34:15.877326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.877342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.877455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 14:34:15 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:01.627 [2024-12-16 14:34:15.877614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.877630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.877723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 14:34:15 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:01.627 [2024-12-16 14:34:15.877809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.877825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.877985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 14:34:15 -- common/autotest_common.sh@10 -- # set +x 00:30:01.627 [2024-12-16 14:34:15.878063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.878073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.878215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.878347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.878357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.878493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.878640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.878651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.878784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.878913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.878924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.879020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.879084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.879095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.879241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.879372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.879382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.879524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.879600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.879611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.879681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.879883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.879893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.879981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.880144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.880403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.880562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.880758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.880909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.881068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.881205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.881215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.881276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.881360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.881368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.881442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.881574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.881583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.881645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.881792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.881802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.881946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.882093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.882102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.882184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.882329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.627 [2024-12-16 14:34:15.882339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.627 qpair failed and we were unable to recover it. 00:30:01.627 [2024-12-16 14:34:15.882485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.882562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.882572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.882639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.882722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.882733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.882880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.883113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.883282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.883442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.883684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.883839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.883935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.884083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.884166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.884177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 14:34:15 -- nvmf/common.sh@469 -- # nvmfpid=554265 00:30:01.628 [2024-12-16 14:34:15.884262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.884500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.884511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 14:34:15 -- nvmf/common.sh@470 -- # waitforlisten 554265 00:30:01.628 [2024-12-16 14:34:15.884705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 14:34:15 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:01.628 [2024-12-16 14:34:15.884793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.884805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 14:34:15 -- common/autotest_common.sh@829 -- # '[' -z 554265 ']' 00:30:01.628 [2024-12-16 14:34:15.885029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.885178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.885188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 14:34:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:01.628 [2024-12-16 14:34:15.885281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 14:34:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:01.628 [2024-12-16 14:34:15.885495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.885506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.885636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 14:34:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:01.628 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:01.628 [2024-12-16 14:34:15.885818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.885829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.885912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 14:34:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:01.628 [2024-12-16 14:34:15.886042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.886055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.886190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 14:34:15 -- common/autotest_common.sh@10 -- # set +x 00:30:01.628 [2024-12-16 14:34:15.886362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.886373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.886469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.886621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.886632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.886716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.886819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.886830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.887056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.887203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.887213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.887301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.887447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.887456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.887545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.887740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.887750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.887829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.887915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.887925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.888174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.888249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.888260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.628 [2024-12-16 14:34:15.888493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.888658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.628 [2024-12-16 14:34:15.888668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.628 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.888934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.889163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.889174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.889398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.889495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.889505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.889682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.889821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.889830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.889921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.890124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.890135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.890285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.890400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.890410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.890664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.890902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.890915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.891057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.891219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.891230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.891373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.891524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.891535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.891627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.891847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.891862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.892086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.892305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.892315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.892474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.892543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.892556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.892778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.892998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.893010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.893179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.893322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.893333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.893481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.893623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.893634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.893781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.893869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.893880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.894132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.894286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.894296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.894473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.894575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.894586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.894665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.894810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.894820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.894940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.895105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.895114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.895268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.895435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.895446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.895586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.895755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.895768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.895925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.896145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.896155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.896321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.896517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.896527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.896674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.896924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.896935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.897080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.897265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.897276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.897470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.897629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.897639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.897888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.897978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.897989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.898110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.898264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.898274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.898334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.898531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.898541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.629 qpair failed and we were unable to recover it. 00:30:01.629 [2024-12-16 14:34:15.898668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.629 [2024-12-16 14:34:15.898827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.898837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.898977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.899118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.899130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.899272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.899414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.899425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.899568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.899641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.899651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.899797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.899875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.899885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.899971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.900055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.900065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.900206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.900365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.900375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.900449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.900669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.900679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.900836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.900986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.900998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.901088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.901236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.901246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.901391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.901467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.901477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.901569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.901765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.901777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.901871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.902166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.902442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.902635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.902872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.902994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.903003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.903090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.903321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.903331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.903474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.903610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.903620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.903761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.903845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.903860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.903938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.904010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.904020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.904152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.904247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.904256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.904489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.904628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.904638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.904790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.904956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.904967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.905112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.905268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.905279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.905357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.905503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.905514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.905614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.905686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.905697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.905925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.906091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.906101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.906252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.906480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.906490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.630 [2024-12-16 14:34:15.906657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.906785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.630 [2024-12-16 14:34:15.906795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.630 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.907032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.907235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.907246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.907402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.907599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.907609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.907746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.907969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.907979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.908146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.908287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.908298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.908442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.908533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.908543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.908685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.908822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.908833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.908982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.909145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.909347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.909581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.909826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.909964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.910110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.910187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.910196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.910271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.910341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.910351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.910428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.910592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.910602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.910761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.910959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.910970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.911055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.911199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.911210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.911293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.911480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.911491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.911562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.911714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.911725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.911858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.911927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.911937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.912110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.912184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.912194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.912321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.912407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.912418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.912569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.912711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.912722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.912865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.912960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.912971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.913042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.913221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.913231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.913396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.913481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.913491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.913566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.913671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.913680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.913806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.913902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.913911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.914158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.914308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.914319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.914527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.914603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.914614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.631 qpair failed and we were unable to recover it. 00:30:01.631 [2024-12-16 14:34:15.914712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.631 [2024-12-16 14:34:15.914797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.914807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.914980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.915160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.915171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.915242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.915370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.915380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.915476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.915561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.915571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.915707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.915867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.915878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.916010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.916144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.916155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.916237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.916455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.916466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.916567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.916713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.916724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.916809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.916954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.916964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.917099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.917225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.917235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.917393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.917590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.917599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.917735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.917956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.917966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.918031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.918228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.918238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.918322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.918411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.918421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.918643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.918722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.918733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.918883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.918974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.918984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.919051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.919195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.919205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.919294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.919364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.919374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.919441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.919638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.919648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.919780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.919871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.919881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.919966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.920110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.920119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.920356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.920506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.920517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.920605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.920668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.920677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.920877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.921020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.921030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.921106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.921307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.921317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.921396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.921459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.921468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.921561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.921692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.921702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.921887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.922106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.922117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.922248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.922322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.922332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.632 [2024-12-16 14:34:15.922420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.922553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.632 [2024-12-16 14:34:15.922563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.632 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.922656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.922749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.922758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.922836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.922933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.922943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.923073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.923156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.923165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.923266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.923497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.923517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.923601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.923810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.923826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.923930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.924025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.924040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.924196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.924350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.924364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.924510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.924662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.924678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.924815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.924987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.925004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.925149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.925298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.925313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.925380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.925452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.925467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.925546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.925779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.925795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.925953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.926085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.926095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.926340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.926553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.926564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.926741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.926889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.926900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.926964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.927057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.927066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.927142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.927361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.927372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.927508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.927645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.927655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.927752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.927838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.927848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.928018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.928175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.928185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.928277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.928421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.928432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.928524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.928686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.928697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.928779] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:01.633 [2024-12-16 14:34:15.928829] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:01.633 [2024-12-16 14:34:15.928839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.929007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.929018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.929148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.929303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.929312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.929448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.929580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.929593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.633 qpair failed and we were unable to recover it. 00:30:01.633 [2024-12-16 14:34:15.929724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.929814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.633 [2024-12-16 14:34:15.929824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.929897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.930066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.930077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.930176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.930314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.930326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.930390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.930544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.930555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.930707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.930778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.930789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.930867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.931062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.931073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.931211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.931290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.931301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.931440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.931634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.931647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.931822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.931965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.931977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.932141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.932353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.932364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.932435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.932580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.932591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.932721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.932875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.932886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.932967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.933175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.933187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.933256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.933432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.933443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.933567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.933728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.933738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.933826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.933959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.933969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.934060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.934135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.934144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.934214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.934339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.934349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.934429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.934507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.934518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.934652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.934802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.934812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.934975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.935104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.935113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.935265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.935350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.935360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.935443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.935535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.935546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.935622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.935764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.935775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.935912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.936111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.936285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.936514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.936803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.936893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.937061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.937156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.634 [2024-12-16 14:34:15.937165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.634 qpair failed and we were unable to recover it. 00:30:01.634 [2024-12-16 14:34:15.937236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.937369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.937380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.937458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.937622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.937632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.937699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.937788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.937798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.937967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.938048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.938058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.938191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.938355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.938365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.938455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.938614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.938625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.938756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.938831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.938842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.938988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.939199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.939435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.939663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.939901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.939982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.940128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.940205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.940215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.940345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.940413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.940424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.940622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.940683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.940694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.940789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.940945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.940956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.941090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.941239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.941250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.941307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.941394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.941404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.941483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.941699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.941710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.941782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.941863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.941875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.942079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.942149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.942159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.942289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.942374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.942385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.942485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.942558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.942567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.942745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.942917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.942928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.943007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.943094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.943105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.943233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.943374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.943385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.943451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.943533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.943543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.943773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.943935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.943946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.944034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.944197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.944207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.635 qpair failed and we were unable to recover it. 00:30:01.635 [2024-12-16 14:34:15.944349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.944416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.635 [2024-12-16 14:34:15.944426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.944497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.944589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.944599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.944682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.944755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.944765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.944962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.945040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.945051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.945192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.945264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.945274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.945441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.945589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.945599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.945759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.945863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.945874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.945952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.946024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.946034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.946168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.946302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.946312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.946390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.946535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.946545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.946676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.946843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.946859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.946987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.947264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.947444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.947608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.947906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.947987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.948123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.948269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.948279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.948434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.948509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.948520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.948665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.948824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.948834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.949005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.949092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.949103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.949270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.949435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.949445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.949621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.949853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.949868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.950032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.950181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.950191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.950339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.950419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.950430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.950574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.950664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.950674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.950823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.950897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.950907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.950990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.951209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.951404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.951721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.636 qpair failed and we were unable to recover it. 00:30:01.636 [2024-12-16 14:34:15.951896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.636 [2024-12-16 14:34:15.951968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.951978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.952043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.952195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.952432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.952697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.952865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.952951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.953020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.953081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.953091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.953320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.953398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.953408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.953500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.953628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.953638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.953721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.953799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.953809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.953938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.954026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.954036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.954190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.954389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.954399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.954474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.954621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.954639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.954805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.954972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.954982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.955153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.955294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.955305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.955385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.955526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.955537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.955734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.955809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.955819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.955963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.956049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.956060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.956156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.956371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.956381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.956585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.956809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.956820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.956977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.957085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.957095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.957262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.957509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.957519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.957591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.957731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.957741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.957881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.957934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.957944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.958075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.958242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.958252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.958330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.958478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.958488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.637 qpair failed and we were unable to recover it. 00:30:01.637 [2024-12-16 14:34:15.958585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.637 [2024-12-16 14:34:15.958686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.958697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.958845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.958909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.958920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.959007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.959155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.959166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.959242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.959391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.959401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.959483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.959626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.959636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.959759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.959898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.959909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.960075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.960224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.960234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.960332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.960546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.960555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.960693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.960890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.960900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.960973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.961054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.961064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.961148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.961246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.961256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.961390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.961534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.961544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 EAL: No free 2048 kB hugepages reported on node 1 00:30:01.638 [2024-12-16 14:34:15.961702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.961843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.961852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.961957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.962113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.962124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.962207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.962343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.962353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.962490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.962621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.962631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.962800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.962944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.962954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.963088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.963164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.963175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.963336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.963500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.963514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.963645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.963707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.963717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.963885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.964145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.964288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.964521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.964745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.964891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.965107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.965252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.965262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.965340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.965406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.965416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.965555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.965682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.965692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.965765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.965909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.965920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.638 [2024-12-16 14:34:15.966070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.966198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.638 [2024-12-16 14:34:15.966209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.638 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.966285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.966482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.966492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.966558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.966685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.966695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.966779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.966925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.966936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.967026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.967171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.967180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.967399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.967619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.967628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.967786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.967926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.967937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.968020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.968104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.968113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.968286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.968365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.968375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.968453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.968593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.968603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.968729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.968996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.969007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.969094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.969234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.969244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.969313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.969404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.969414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.969495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.969729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.969740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.969998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.970148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.970159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.970380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.970573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.970583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.970780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.971007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.971018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.971167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.971298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.971309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.971375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.971597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.971607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.971761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.971845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.971860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.972026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.972206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.972216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.972348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.972543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.972554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.972754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.972920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.972932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.973080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.973142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.973152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.973333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.973408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.973420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.973571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.973713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.973723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.973872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.974030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.974041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.974264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.974465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.974475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.974623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.974834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.974844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.975016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.975250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.975260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.639 qpair failed and we were unable to recover it. 00:30:01.639 [2024-12-16 14:34:15.975451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.639 [2024-12-16 14:34:15.975591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.975601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.975748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.975942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.975952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.976151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.976385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.976396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.976597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.976743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.976753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.976973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.977114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.977126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.977202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.977295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.977305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.977526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.977741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.977751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.977993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.978211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.978221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.978371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.978565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.978575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.978716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.978878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.978888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.979089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.979295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.979304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.979462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.979545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.979555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.979780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.979979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.979989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.980145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.980360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.980370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.980570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.980774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.980786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.980927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.981145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.981154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.981314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.981406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.981416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.981589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.981725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.981735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.981934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.982108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.982118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.982314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.982505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.982515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.982728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.982890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.982901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.983041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.983258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.983268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.983411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.983670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.983680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.983835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.984045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.984057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.984504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.984633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.984644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.984845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.984983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.984993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.985198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.985347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.985358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.985537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.985728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.985738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.985822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.986025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.986037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.640 [2024-12-16 14:34:15.986171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.986301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.640 [2024-12-16 14:34:15.986311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.640 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.986516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.986762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.986773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.986911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.987059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.987069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.987265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.987392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.987402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.987548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.987771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.987781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.987927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.988161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.988172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.988415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.988570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.988580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.988813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.989045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.989055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.989307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.989447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.989457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.989604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.989822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.989832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.990079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.990257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.990267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.990416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.990650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.990660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.990862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.991088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.991098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.991262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.991357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.991367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.991634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.991776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.991786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.991994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.992191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.992201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.992347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.992578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.992588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.992660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.992802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.992812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.992974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.993072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.993082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.993281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.993432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.993442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.993614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.993749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.993759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.993893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.993990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.994000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.994224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.994315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.994325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.994475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.994540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.994550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.994692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.994843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.994857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.995002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.995163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.995173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.995371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.995622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.995632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.995897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.996057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.996067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.996275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.996489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.996498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.996708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.996850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.641 [2024-12-16 14:34:15.996871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.641 qpair failed and we were unable to recover it. 00:30:01.641 [2024-12-16 14:34:15.997073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.997241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.997251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:15.997504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.997681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.997691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:15.997907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.998154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.998164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:15.998362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.998569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.998580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:15.998781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.998953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.998963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:15.999039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.999243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.999253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:15.999455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.999630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.999640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:15.999734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.999862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:15.999873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.000033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.000227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.000237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.000482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.000678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.000688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.000831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.000908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.000918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.001067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.001211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.001221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.001370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.001573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.001583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.001747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.001892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.001903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.001998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.002221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.002231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.002483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.002651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.002661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.002909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.003111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.003121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.003381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.003540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.003550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.003769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.003862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.003873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.004119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.004261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.004271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.004426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.004646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.004656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.004851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.004947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.004957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.005098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.005299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.005309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.005397] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:01.642 [2024-12-16 14:34:16.005533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.005694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.005704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.005849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.006087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.006099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.006320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.006474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.642 [2024-12-16 14:34:16.006484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.642 qpair failed and we were unable to recover it. 00:30:01.642 [2024-12-16 14:34:16.006553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.006702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.006713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.006942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.007175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.007186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.007438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.007518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.007528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.007675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.007843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.007856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.008056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.008132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.008143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.008287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.008523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.008534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.008760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.008917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.008928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.009150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.009377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.009387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.009620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.009818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.009829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.010045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.010194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.010205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.010310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.010479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.010490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.010691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.010823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.010834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.011056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.011252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.011262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.011464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.011702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.011713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.011860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.012093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.012103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.012276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.012367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.012378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.012461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.012612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.012623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.012847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.012947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.012958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.013221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.013362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.013373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.013601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.013843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.013858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.014091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.014160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.014170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.014322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.014427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.014438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.014521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.014740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.014752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.014853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.015181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.015193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.015344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.015579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.015590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.015809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.015890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.015901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.016138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.016281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.016292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.016461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.016604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.016614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.016707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.016908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.016920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.643 [2024-12-16 14:34:16.017053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.017147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.643 [2024-12-16 14:34:16.017157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.643 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.017357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.017581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.017591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.017808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.018009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.018020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.018230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.018437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.018448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.018604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.018771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.018782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.018930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.019065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.019075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.019255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.019317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.019327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.019548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.019752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.019762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.019895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.020114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.020125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.020287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.020431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.020441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.020589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.020762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.020772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.020923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.021069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.021080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.021177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.021322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.021332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.021434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.021574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.021584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.021679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.021842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.021852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.022018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.022165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.022175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.022244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.022389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.022399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.022539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.022777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.022787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.023013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.023288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.023298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.023439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.023641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.023651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.023821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.023963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.023974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.024172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.024395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.024406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.024489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.024638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.024648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.024741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.024983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.024993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.025219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.025380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.025391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.025536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.025730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.025739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.025989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.026207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.026217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.026463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.026692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.026702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.026862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.026994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.027004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.027209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.027343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.027353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.644 qpair failed and we were unable to recover it. 00:30:01.644 [2024-12-16 14:34:16.027571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.644 [2024-12-16 14:34:16.027791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.027801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.027934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.028134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.028144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.028297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.028438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.028448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.028599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.028795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.028806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.028946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.029144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.029154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.029240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.029407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.029418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.029498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.029589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.029599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.029819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.029966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.029977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.030209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.030334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.030344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.030585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.030782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.030793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.030920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.031052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.031062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.031210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.031366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.031377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.031507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.031636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.031646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.031859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.032011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.032020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.032189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.032276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.032287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.032503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.032711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.032720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.032933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.033079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.033089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.033333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.033562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.033572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.033807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.034004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.034015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.034216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.034435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.034446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.034620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.034779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.034789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.035011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.035210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.035221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.035437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.035640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.035650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.035828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.035959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.035969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.036174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.036392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.036402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.036622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.036797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.036807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.037022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.037092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.037101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.037234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.037443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.037452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.037546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.037627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.037637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.645 [2024-12-16 14:34:16.037773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.037995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.645 [2024-12-16 14:34:16.038006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.645 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.038242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.038460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.038470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.038610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.038825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.038838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.038960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.039223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.039234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.039452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.039714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.039725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.039951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.040081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.040091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.040292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.040464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.040474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.040694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.040913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.040924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.041141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.041290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.041300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.041362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.041581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.041594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.041674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.041859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.041873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.041940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.042071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.042082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.042254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.042451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.042466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.042595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.042839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.042851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.043118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.043330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.043342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.043487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.043620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.043631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.043780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.043931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.043942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.044080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.044291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.044301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.044396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.044536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.044547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.044775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.045013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.045025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.045224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.045367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.045378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.045535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.045685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.045695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.045850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.046083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.046100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.046303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.046477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.046487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.046652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.046849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.046882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.047045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.047276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.047286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.047434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.047663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.646 [2024-12-16 14:34:16.047674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.646 qpair failed and we were unable to recover it. 00:30:01.646 [2024-12-16 14:34:16.047804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.047936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.047947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.048085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.048306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.048317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.048458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.048568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.048579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.048777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.048993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.049005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.049151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.049376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.049388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.049563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.049780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.049794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.049991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.050180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.050191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.050329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.050524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.050534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.050631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.050802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.050813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.050984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.051206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.051218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.051415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.051612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.051622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.051775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.051904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.051915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.051989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.052153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.052163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.052315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.052486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.052497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.052749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.052905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.052915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.053136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.053360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.053370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.053591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.053748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.053758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.053985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.054078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.054088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.054220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.054380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.054390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.054478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.054705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.054715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.054948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.055190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.055200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.055443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.055589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.055598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.055836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.056070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.056081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.056286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.056510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.056519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.056675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.056871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.056882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.057082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.057216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.057226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.057360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.057505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.057515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.057663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.057807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.057817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.058030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.058275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.058284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.647 qpair failed and we were unable to recover it. 00:30:01.647 [2024-12-16 14:34:16.058540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.647 [2024-12-16 14:34:16.058690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.058700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.058893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.059067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.059076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.059290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.059440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.059449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.059541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.059694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.059704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.059768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.059936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.059946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.060095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.060188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.060198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.060278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.060424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.060434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.060609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.060859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.060869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.061010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.061209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.061219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.061436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.061636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.061646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.061797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.061958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.061969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.062173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.062345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.062355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.062525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.062616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.062625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.062848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.063030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.063040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.063240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.063417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.063427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.063489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.063710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.063721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.063928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.064149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.064159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.064389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.064529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.064539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.064713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.064961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.064972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.065216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.065422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.065432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.065644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.065868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.065879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.066075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.066220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.066231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.066441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.066640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.066650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.066864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.067066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.067076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.067209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.067407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.067416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.067612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.067817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.067826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.067991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.068151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.068161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.068310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.068500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.068510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.068697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.068862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.068873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.648 [2024-12-16 14:34:16.069097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.069323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.648 [2024-12-16 14:34:16.069333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.648 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.069530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.069750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.069760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.069906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.070067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.070078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.070254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.070332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.070342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.070567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.070725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.070735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.070906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.070984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.070994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.071171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.071296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.071306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.071536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.071661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.071672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.071849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.072019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.072029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.072290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.072497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.072507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.072654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.072826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.072836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.073064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.073204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.073214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.073354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.073514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.073524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.073744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.073824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.073834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.073982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.074181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.074191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.074339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.074538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.074548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.074691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.074940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.074950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.075109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.075318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.075328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.075466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.075640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.075650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.076020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.076190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.076200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.076365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.076532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.076542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.076761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.076922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.076932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.077162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.077313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.077323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.077460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.077682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.077692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.077903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.078068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.078078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.078145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.078301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.078311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.078475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.078637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.078647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.078869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.079008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.079019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.079261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.079394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.079404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.649 [2024-12-16 14:34:16.079615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.079705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.649 [2024-12-16 14:34:16.079716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.649 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.079803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.079955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.079966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.080111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.080239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.080250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.080521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.080571] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:01.650 [2024-12-16 14:34:16.080677] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:01.650 [2024-12-16 14:34:16.080679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.080686] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:01.650 [2024-12-16 14:34:16.080688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 [2024-12-16 14:34:16.080693] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.080888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.080808] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:01.650 [2024-12-16 14:34:16.080920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:01.650 [2024-12-16 14:34:16.080919] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:01.650 [2024-12-16 14:34:16.081037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.081047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.080831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:01.650 [2024-12-16 14:34:16.081177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.081306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.081315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.081540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.081747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.081757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.081896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.082097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.082108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.082330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.082556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.082566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.082698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.082830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.082841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.082996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.083230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.083241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.083468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.083720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.083730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.083971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.084126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.084136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.084346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.084490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.084500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.084578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.084708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.084717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.084914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.085049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.085058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.085225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.085423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.085432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.085589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.085738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.085748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.085882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.086078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.086088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.086221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.086441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.086451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.086671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.086821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.086831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.087069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.087217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.087227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.087375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.087516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.087526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.087656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.087869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.087880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.088051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.088194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.650 [2024-12-16 14:34:16.088205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.650 qpair failed and we were unable to recover it. 00:30:01.650 [2024-12-16 14:34:16.088418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.088566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.088576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.088844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.088956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.088967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.089130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.089279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.089289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.089517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.089714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.089725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.089904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.090054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.090065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.090213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.090436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.090446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.090644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.090865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.090877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.091044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.091188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.091198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.091351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.091578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.091590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.091794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.091944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.091955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.092151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.092279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.092290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.092386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.092529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.092540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.092696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.092947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.092960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.093106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.093325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.093336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.093562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.093750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.093761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.094004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.094162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.094174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.094379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.094597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.094609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.094844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.095108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.095119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.095344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.095560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.095572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.095769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.095932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.095943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.096022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.096244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.096255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.096476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.096643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.096655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.096876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.097110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.097121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.097349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.097569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.097579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.097656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.097790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.097801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.098001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.098226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.098237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.098461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.098686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.098697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.098761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.098930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.098943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.099166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.099343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.099354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.651 qpair failed and we were unable to recover it. 00:30:01.651 [2024-12-16 14:34:16.099443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.651 [2024-12-16 14:34:16.099669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.099680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.099899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.100122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.100132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.100330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.100474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.100485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.100579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.100726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.100738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.100971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.101229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.101240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.101405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.101606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.101616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.101775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.102045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.102058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.102285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.102456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.102467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.102674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.102911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.102922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.103054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.103196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.103207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.103421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.103590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.103600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.103741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.103914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.103925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.104132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.104285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.104295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.104542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.104760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.104775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.104941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.105102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.105113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.105270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.105427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.105438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.105644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.105846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.105860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.106087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.106218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.106228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.106323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.106584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.106594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.106724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.106971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.106982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.107207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.107359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.107370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.107434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.107659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.107670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.107799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.107955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.107966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.108110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.108264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.108279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.108432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.108580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.108590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.108812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.109061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.109074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.109242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.109383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.109394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.109475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.109716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.109727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.109923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.110050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.110061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.110287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.110532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.652 [2024-12-16 14:34:16.110542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.652 qpair failed and we were unable to recover it. 00:30:01.652 [2024-12-16 14:34:16.110713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.110921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.110932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.111080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.111251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.111262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.111398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.111540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.111550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.111700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.111837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.111851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.112088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.112295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.112305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.112401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.112551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.112561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.112758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.112827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.112836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.113014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.113213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.113223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.113379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.113584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.113595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.113792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.114009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.114020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.114150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.114295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.114305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.114456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.114609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.114619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.114779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.114920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.114930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.115160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.115309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.115323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.115546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.115803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.115815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.115909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.116061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.116072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.116206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.116427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.116437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.116605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.116795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.116807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.116955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.117101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.117112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.117241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.117463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.117474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.117622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.117864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.117875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.118156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.118355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.118365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.118445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.118508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.118518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.118676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.118900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.118911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.119065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.119235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.119245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.119442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.119583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.119592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.119809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.119939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.119949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.120104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.120235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.120244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.120390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.120478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.120488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.653 qpair failed and we were unable to recover it. 00:30:01.653 [2024-12-16 14:34:16.120633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.120711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.653 [2024-12-16 14:34:16.120721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.120976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.121145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.121155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.121313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.121452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.121462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.121669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.121863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.121873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.121953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.122090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.122101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.122325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.122538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.122549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.122696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.122940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.122951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.123099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.123267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.123277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.123425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.123551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.123561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.123822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.124011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.124022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.124241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.124395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.124405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.124604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.124757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.124767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.124897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.124992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.125003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.125246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.125495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.125506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.125708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.125860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.125871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.126035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.126178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.126190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.126357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.126593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.126605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.126746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.126985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.126997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.127222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.127500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.127511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.127735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.127889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.127900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.128122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.128285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.128296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.128426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.128566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.128577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.128773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.129017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.129028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.129250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.129400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.129411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.129645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.129710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.129719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.129904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.130103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.130113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.130196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.130428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.130439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.130659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.130743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.130753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.130935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.131076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.131087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.131247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.131473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.654 [2024-12-16 14:34:16.131484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.654 qpair failed and we were unable to recover it. 00:30:01.654 [2024-12-16 14:34:16.131625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.131759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.131769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.131985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.132137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.132148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.132313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.132513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.132524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.132663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.132866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.132876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.133024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.133177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.133187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.133402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.133645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.133655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.133864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.134054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.134064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.134166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.134311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.134322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.134450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.134593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.134603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.134772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.134967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.134978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.135187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.135336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.135346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.135592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.135743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.135753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.135882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.136036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.136047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.136128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.136268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.136278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.136449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.136533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.136543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.136795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.137042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.137052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.137289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.137423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.137433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.137654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.137812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.137821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.137960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.138100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.138110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.138279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.138486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.138496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.138712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.138801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.138810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.138978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.139044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.139054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.139237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.139367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.139377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.139463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.139530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.139540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.139687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.139902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.139912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.140057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.140324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.140334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.655 qpair failed and we were unable to recover it. 00:30:01.655 [2024-12-16 14:34:16.140479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.655 [2024-12-16 14:34:16.140689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.140699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.140904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.141108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.141118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.141288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.141526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.141536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.141744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.141916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.141927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.142090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.142302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.142311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.142509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.142711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.142720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.142932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.143085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.143095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.143242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.143396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.143406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.143563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.143778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.143788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.143853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.144055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.144066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.144213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.144393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.144403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.144617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.144758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.144769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.144932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.145082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.145093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.145300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.145426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.145436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.145608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.145736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.145746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.145969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.146117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.146127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.146196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.146420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.146430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.146596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.146735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.146744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.146985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.147210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.147220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.147385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.147581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.147591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.147828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.147967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.147978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.148204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.148391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.148401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.148620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.148767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.148777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.148924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.149020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.149030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.149248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.149466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.149476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.149706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.149768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.149778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.149863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.150089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.150099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.150262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.150363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.150373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.150544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.150631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.150641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.656 [2024-12-16 14:34:16.150883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.151121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.656 [2024-12-16 14:34:16.151131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.656 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.151369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.151511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.151521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.151750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.151949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.151959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.152180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.152328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.152337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.152560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.152732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.152742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.152870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.153073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.153083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.153304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.153404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.153414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.153564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.153699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.153708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.153871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.154129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.154139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.154366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.154582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.154592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.154676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.154806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.154816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.154906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.155000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.155010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.155107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.155233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.155243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.155426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.155577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.155587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.155736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.155885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.155895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.155993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.156207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.156217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.156413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.156576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.156586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.156826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.157090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.157100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.157230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.157374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.157384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.157517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.157714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.157723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.157886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.158085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.158096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.158317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.158445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.158454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.158602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.158671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.158681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.158902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.159050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.159060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.159239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.159391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.159402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.159537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.159663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.159673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.159869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.160001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.160011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.160226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.160446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.160456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.160609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.160751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.160760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.160892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.160969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.657 [2024-12-16 14:34:16.160979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.657 qpair failed and we were unable to recover it. 00:30:01.657 [2024-12-16 14:34:16.161147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.161368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.161380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.161646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.161791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.161801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.162025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.162199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.162209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.162336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.162536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.162546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.162700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.162828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.162838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.162994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.163135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.163146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.163240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.163480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.163490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.163707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.163941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.163952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.164174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.164396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.164406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.164599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.164748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.164757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.164964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.165111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.165124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.165263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.165326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.165336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.165428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.165589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.165599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.165823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.165982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.165993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.166186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.166381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.166391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.166521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.166680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.166690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.166887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.167116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.167126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.167341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.167488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.167498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.167640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.167837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.167846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.168101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.168307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.168317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.168459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.168701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.168713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.658 [2024-12-16 14:34:16.168934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.169022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.658 [2024-12-16 14:34:16.169031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.658 qpair failed and we were unable to recover it. 00:30:01.936 [2024-12-16 14:34:16.169295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.169417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.169428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.936 qpair failed and we were unable to recover it. 00:30:01.936 [2024-12-16 14:34:16.169651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.169799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.169809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.936 qpair failed and we were unable to recover it. 00:30:01.936 [2024-12-16 14:34:16.169983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.170126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.170135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.936 qpair failed and we were unable to recover it. 00:30:01.936 [2024-12-16 14:34:16.170289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.170484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.170494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.936 qpair failed and we were unable to recover it. 00:30:01.936 [2024-12-16 14:34:16.170575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.170721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.170730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.936 qpair failed and we were unable to recover it. 00:30:01.936 [2024-12-16 14:34:16.170875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.171031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.171041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.936 qpair failed and we were unable to recover it. 00:30:01.936 [2024-12-16 14:34:16.171238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.171406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.936 [2024-12-16 14:34:16.171416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.171658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.171896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.171907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.172164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.172319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.172331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.172503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.172661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.172671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.172800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.172948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.172958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.173155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.173396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.173407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.173629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.173783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.173793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.173879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.174026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.174036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.174243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.174447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.174457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.174594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.174765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.174775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.174978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.175147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.175157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.175315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.175456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.175466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.175662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.175833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.175843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.175991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.176145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.176155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.176402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.176576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.176586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.176752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.176913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.176924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.177097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.177244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.177254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.177382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.177446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.177456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.177651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.177736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.177745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.177887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.178107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.178117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.178259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.178524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.178533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.178737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.178828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.178837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.179062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.179190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.179200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.179346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.179474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.179484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.179626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.179845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.179866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.180039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.180122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.180132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.180382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.180533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.180543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.180781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.181030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.181041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.181294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.181518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.181528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.181776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.181843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.937 [2024-12-16 14:34:16.181856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.937 qpair failed and we were unable to recover it. 00:30:01.937 [2024-12-16 14:34:16.182027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.182203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.182213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.182430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.182594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.182604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.182770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.182913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.182923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.183055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.183141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.183150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.183389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.183522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.183532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.183662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.183904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.183915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.184138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.184333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.184343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.184421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.184618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.184628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.184893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.185026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.185036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.185177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.185388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.185397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.185623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.185785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.185795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.185887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.186123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.186133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.186285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.186508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.186518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.186723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.186903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.186913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.187134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.187369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.187379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.187609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.187702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.187712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.187863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.188081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.188092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.188236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.188367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.188376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.188463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.188602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.188612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.188774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.188990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.189000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.189220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.189422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.189432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.189580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.189779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.189789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.189950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.190024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.190034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.190194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.190356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.190366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.190599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.190824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.190834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.190931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.191003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.191013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.191225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.191355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.191365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.191520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.191716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.191725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.191984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.192252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.192262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.938 qpair failed and we were unable to recover it. 00:30:01.938 [2024-12-16 14:34:16.192457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.192678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.938 [2024-12-16 14:34:16.192687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.192907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.193001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.193011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.193073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.193159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.193169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.193376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.193536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.193546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.193696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.193821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.193831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.194049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.194133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.194143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.194323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.194486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.194496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.194596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.194748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.194757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.194888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.195134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.195144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.195277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.195445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.195455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.195679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.195752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.195762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.195906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.196075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.196085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.196166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.196376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.196385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.196447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.196587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.196597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.196797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.196875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.196886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.197133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.197325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.197335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.197573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.197714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.197724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.197873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.198099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.198109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.198277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.198419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.198429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.198600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.198832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.198842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.198952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.199134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.199144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.199289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.199428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.199438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.199586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.199730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.199740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.199939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.200147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.200157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.200376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.200575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.200585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.200791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.200875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.200886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.200975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.201116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.201126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.201273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.201468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.201478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.201730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.201886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.201896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.202049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.202217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.939 [2024-12-16 14:34:16.202227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.939 qpair failed and we were unable to recover it. 00:30:01.939 [2024-12-16 14:34:16.202397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.202472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.202482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.202622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.202757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.202767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.202985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.203187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.203197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.203356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.203503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.203513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.203722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.203968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.203979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.204134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.204352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.204362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.204586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.204805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.204815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.204976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.205202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.205212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.205479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.205715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.205725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.205970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.206137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.206147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.206368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.206498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.206508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.206723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.206938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.206948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.207134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.207355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.207365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.207565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.207730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.207740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.207937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.208162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.208172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.208257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.208385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.208394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.208587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.208791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.208801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.208957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.209144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.209154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.209317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.209403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.209413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.209632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.209773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.209783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.210005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.210248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.210257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.210499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.210736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.210746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.210912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.211084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.211094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.211309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.211439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.211449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.211590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.211757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.211766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.211989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.212172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.212182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.212383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.212550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.212560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.212689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.212842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.212852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.213012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.213237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.213247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.940 qpair failed and we were unable to recover it. 00:30:01.940 [2024-12-16 14:34:16.213397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.213551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.940 [2024-12-16 14:34:16.213561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.213689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.213910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.213921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.214084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.214158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.214167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.214317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.214472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.214482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.214728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.214874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.214884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.215039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.215213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.215225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.215369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.215522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.215532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.215663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.215726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.215735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.215956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.216100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.216110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.216327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.216472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.216482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.216622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.216755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.216765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.216959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.217201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.217211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.217361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.217604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.217614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.217827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.218047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.218057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.218191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.218398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.218408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.218555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.218647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.218660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.218810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.218957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.218967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.219184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.219392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.219402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.219597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.219739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.219749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.219971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.220137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.220147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.220347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.220494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.220504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.220674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.220897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.220907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.221125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.221336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.221345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.221571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.221716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.221725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.221962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.222045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.222055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.941 [2024-12-16 14:34:16.222197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.222417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.941 [2024-12-16 14:34:16.222430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.941 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.222584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.222731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.222740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.222939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.223031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.223041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.223264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.223430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.223440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.223676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.223773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.223783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.223923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.224088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.224098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.224246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.224468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.224478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.224704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.224921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.224931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.225062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.225287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.225297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.225498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.225644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.225654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.225860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.226111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.226123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.226263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.226489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.226499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.226723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.226817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.226828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.227073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.227294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.227304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.227473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.227565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.227575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.227749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.227913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.227923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.228007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.228105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.228114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.228251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.228392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.228401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.228618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.228811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.228821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.228971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.229134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.229144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.229355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.229539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.229549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.229707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.229902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.229912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.230009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.230148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.230158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.230318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.230470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.230480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.230564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.230656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.230666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.230888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.231085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.231095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.231316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.231517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.231527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.231728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.231944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.231954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.232175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.232275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.232285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.232505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.232654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.232664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.942 qpair failed and we were unable to recover it. 00:30:01.942 [2024-12-16 14:34:16.232754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.942 [2024-12-16 14:34:16.233020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.233030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.233192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.233269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.233278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.233408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.233649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.233658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.233805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.233972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.233982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.234179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.234273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.234283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.234488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.234621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.234630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.234808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.235027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.235038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.235128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.235326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.235336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.235557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.235774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.235785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.235927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.236129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.236139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.236376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.236546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.236556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.236709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.236845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.236857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.236987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.237133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.237143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.237350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.237523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.237532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.237755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.237899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.237909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.238053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.238234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.238244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.238440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.238663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.238673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.238804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.238883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.238893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.239114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.239309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.239319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.239408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.239632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.239642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.239787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.239954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.239965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.240104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.240291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.240301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.240468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.240618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.240628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.240824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.241046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.241056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.241273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.241413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.241423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.241621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.241765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.241775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.241995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.242135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.242145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.242385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.242468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.242477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.242666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.242810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.242819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.943 [2024-12-16 14:34:16.242982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.243123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.943 [2024-12-16 14:34:16.243133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.943 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.243331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.243480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.243490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.243560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.243783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.243792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.244012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.244106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.244116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.244207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.244422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.244432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.244639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.244823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.244833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.245033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.245267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.245276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.245446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.245509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.245519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.245662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.245886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.245896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.245958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.246156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.246166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.246397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.246479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.246489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.246640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.246786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.246796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.246947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.247119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.247129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.247398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.247646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.247656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.247853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.248095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.248105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.248328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.248483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.248492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.248658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.248828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.248837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.249040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.249195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.249205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.249338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.249415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.249424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.249623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.249846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.249859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.250096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.250184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.250194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.250467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.250614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.250624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.250846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.251092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.251103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.251352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.251605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.251615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.251774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.251941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.251952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.252085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.252236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.252246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.252407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.252550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.252559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.252793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.252944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.252954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.253037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.253174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.253184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.253332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.253569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.253579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.944 qpair failed and we were unable to recover it. 00:30:01.944 [2024-12-16 14:34:16.253802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.944 [2024-12-16 14:34:16.253999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.254009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.254252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.254472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.254482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.254707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.254926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.254936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.255107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.255254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.255264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.255410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.255618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.255628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.255870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.256060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.256071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.256286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.256434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.256444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.256675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.256889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.256899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.256979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.257181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.257191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.257342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.257540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.257549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.257747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.257941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.257952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.258110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.258199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.258209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.258406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.258627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.258637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.258788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.258985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.258995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.259236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.259388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.259398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.259559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.259760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.259771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.259857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.260079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.260089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.260231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.260469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.260479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.260629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.260707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.260717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.260873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.261095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.261105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.261197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.261418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.261428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.261646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.261864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.261875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.262020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.262108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.262118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.262335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.262435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.262446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.262693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.262887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.262897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.263036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.263248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.263258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.945 qpair failed and we were unable to recover it. 00:30:01.945 [2024-12-16 14:34:16.263387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.945 [2024-12-16 14:34:16.263551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.263561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.263721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.263886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.263897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.264028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.264153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.264163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.264361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.264579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.264589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.264670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.264817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.264827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.265026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.265195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.265205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.265359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.265488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.265498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.265719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.265916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.265927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.266087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.266214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.266224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.266356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.266585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.266595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.266794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.266877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.266887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.267047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.267267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.267277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.267503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.267645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.267655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.267751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.267827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.267837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.267941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.268098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.268108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.268351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.268498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.268507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.268676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.268772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.268782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.268935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.269083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.269094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.269226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.269429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.269439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.269594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.269852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.269871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.270089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.270301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.270311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.270461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.270603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.270613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.270833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.270895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.270905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.271007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.271227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.271237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.271311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.271538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.271548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.271691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.271839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.271849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.272003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.272129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.272141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.272311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.272469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.272478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.272553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.272808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.272817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.946 [2024-12-16 14:34:16.273056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.273209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.946 [2024-12-16 14:34:16.273220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.946 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.273463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.273657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.273667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.273736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.273911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.273921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.274148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.274313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.274323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.274557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.274700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.274710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.274785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.275007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.275017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.275215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.275287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.275296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.275506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.275663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.275675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.275864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.276076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.276085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.276289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.276428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.276437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.276679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.276758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.276768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.276918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.277117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.277127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.277270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.277418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.277428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.277625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.277789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.277799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.277954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.278150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.278160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.278358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.278576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.278587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.278828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.278968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.278979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.279122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.279318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.279330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.279565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.279785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.279795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.279995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.280134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.280144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.280234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.280467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.280477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.280612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.280863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.280874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.281071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.281289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.281299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.281432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.281594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.281603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.281823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.282039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.282049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.282270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.282421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.282431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.282561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.282723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.282733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.282820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.283039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.283051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.283131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.283215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.283225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.947 [2024-12-16 14:34:16.283471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.283689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.947 [2024-12-16 14:34:16.283699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.947 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.283872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.284094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.284104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.284321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.284531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.284540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.284668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.284729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.284739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.284887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.285132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.285142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.285364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.285566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.285576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.285677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.285803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.285813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.285991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.286142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.286152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.286402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.286621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.286631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.286793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.287017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.287028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.287251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.287412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.287422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.287585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.287724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.287734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.287865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.288093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.288103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.288175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.288251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.288261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.288458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.288676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.288686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.288816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.289078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.289089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.289304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.289454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.289464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.289556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.289629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.289639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.289862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.289960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.289971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.290051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.290138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.290148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.290278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.290429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.290439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.290657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.290751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.290761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.290991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.291162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.291172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.291388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.291531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.291541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.291761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.291908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.291919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.292060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.292205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.292214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.292436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.292597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.292607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.292778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.292974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.292985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.293225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.293355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.293365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.293516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.293737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.948 [2024-12-16 14:34:16.293748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.948 qpair failed and we were unable to recover it. 00:30:01.948 [2024-12-16 14:34:16.293959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.294031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.294041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.294249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.294450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.294460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.294613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.294837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.294848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.295072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.295348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.295358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.295553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.295773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.295783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.296005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.296084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.296095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.296293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.296423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.296433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.296521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.296720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.296730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.296948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.297087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.297097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.297239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.297439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.297448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.297604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.297849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.297862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.298035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.298282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.298292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.298488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.298614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.298624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.298844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.298923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.298933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.299149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.299368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.299378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.299661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.299795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.299805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.300023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.300211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.300221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.300389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.300540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.300550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.300770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.300899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.300909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.301003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.301165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.301175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.301315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.301464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.301474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.301630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.301849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.301862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.302040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.302257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.302267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.302417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.302583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.302593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.302813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.303025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.303035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.303189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.303332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.303342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.303423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.303642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.303652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.303739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.303900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.303910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.304078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.304221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.304231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.949 qpair failed and we were unable to recover it. 00:30:01.949 [2024-12-16 14:34:16.304529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.304602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.949 [2024-12-16 14:34:16.304611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.304859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.305001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.305011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.305252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.305402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.305411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.305634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.305850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.305864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.305935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.306081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.306091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.306244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.306453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.306463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.306602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.306819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.306829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.306985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.307073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.307083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.307214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.307366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.307375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.307526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.307678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.307688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.307907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.308037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.308047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.308297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.308439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.308449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.308578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.308795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.308806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.309026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.309203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.309213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.309424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.309671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.309681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.309876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.310097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.310107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.310328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.310409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.310419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.310611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.310774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.310784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.310924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.311072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.311082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.311304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.311549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.311558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.311707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.311851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.311864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.312015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.312159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.312169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.312300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.312472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.312482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.312633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.312816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.312826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.313045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.313171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.313181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.313255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.313475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.313486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.950 [2024-12-16 14:34:16.313708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.313936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.950 [2024-12-16 14:34:16.313946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.950 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.314170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.314313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.314323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.314462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.314601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.314611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.314848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.314932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.314942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.315109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.315351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.315361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.315501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.315650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.315659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.315795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.315943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.315954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.316154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.316362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.316372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.316525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.316655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.316664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.316831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.317035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.317045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.317182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.317270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.317280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.317413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.317636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.317646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.317878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.318008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.318018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.318161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.318394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.318403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.318501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.318657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.318667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.318803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.318943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.318953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.319033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.319183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.319193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.319411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.319506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.319516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.319685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.319814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.319824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.320044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.320240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.320251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.320337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.320559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.320569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.320788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.320963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.320973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.321186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.321429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.321438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.321592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.321817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.321826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.322077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.322276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.322286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.322482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.322702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.322712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.322797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.322939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.322949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.323168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.323389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.323399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.323603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.323749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.323760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.323904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.324060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.324070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.951 qpair failed and we were unable to recover it. 00:30:01.951 [2024-12-16 14:34:16.324268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.951 [2024-12-16 14:34:16.324358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.324368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.324523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.324620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.324630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.324826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.325075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.325086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.325292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.325449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.325459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.325703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.325926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.325936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.326206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.326341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.326351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.326576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.326706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.326716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.326936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.327073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.327082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.327332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.327480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.327489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.327686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.327828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.327837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.328012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.328091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.328100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.328261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.328341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.328350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.328527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.328751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.328761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.328993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.329224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.329234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.329312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.329513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.329525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.329656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.329890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.329900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.330097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.330296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.330306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.330567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.330728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.330737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.330948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.331026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.331036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.331168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.331315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.331325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.331519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.331655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.331665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.331808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.331945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.331955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.332100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.332229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.332239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.332465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.332623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.332633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.332774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.332994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.333008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.333241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.333436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.333445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.333644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.333773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.333782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.333981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.334168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.334178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.334375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.334522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.334532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.952 [2024-12-16 14:34:16.334740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.334911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.952 [2024-12-16 14:34:16.334922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.952 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.335148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.335312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.335322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.335539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.335781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.335791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.335948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.336170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.336180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.336380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.336604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.336614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.336793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.336981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.336994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.337160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.337405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.337415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.337551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.337788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.337798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.337881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.338022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.338032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.338249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.338476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.338486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.338726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.338893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.338903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.339104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.339347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.339357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.339553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.339701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.339711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.339808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.339976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.339986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.340228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.340427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.340437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.340597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.340845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.340858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.341110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.341335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.341345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.341504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.341657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.341667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.341794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.341954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.341965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.342185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.342278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.342287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.342457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.342611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.342621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.342897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.343107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.343117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.343325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.343427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.343437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.343647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.343869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.343879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.344027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.344169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.344179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.344330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.344487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.344497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.344702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.344861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.344872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.345000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.345125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.345135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.345359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.345457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.345467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.345681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.345822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.345832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.953 qpair failed and we were unable to recover it. 00:30:01.953 [2024-12-16 14:34:16.345989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.953 [2024-12-16 14:34:16.346210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.346221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.346383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.346522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.346532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.346665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.346793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.346803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.347026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.347118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.347129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.347355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.347516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.347526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.347749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.347902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.347913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.348146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.348370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.348380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.348600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.348746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.348756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.348850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.349070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.349080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.349359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.349440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.349450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.349542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.349686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.349696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.349824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.350049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.350059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.350256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.350427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.350437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.350673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.350883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.350894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.351060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.351265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.351275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.351464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.351612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.351622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.351772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.352025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.352036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.352224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.352449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.352459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.352641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.352779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.352789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.352998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.353061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.353070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.353310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.353529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.353539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.353773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.353905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.353915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.354159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.354302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.354312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.354440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.354674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.354684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.354848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.355072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.355082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.355303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.355522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.355532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.954 qpair failed and we were unable to recover it. 00:30:01.954 [2024-12-16 14:34:16.355754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.954 [2024-12-16 14:34:16.355960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.355971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.356188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.356261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.356271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.356491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.356639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.356649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.356879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.357116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.357126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.357207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.357428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.357438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.357592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.357766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.357775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.358003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.358086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.358095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.358332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.358498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.358508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.358706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.358884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.358894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.358984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.359069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.359080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.359216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.359379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.359389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.359477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.359658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.359668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.359842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.359977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.359987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.360076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.360219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.360228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.360305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.360401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.360410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.360557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.360827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.360836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.361065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.361265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.361274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.361405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.361628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.361637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.361880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.362038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.362048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.362262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.362403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.362413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.362658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.362819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.362829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.363049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.363176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.363186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.363427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.363574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.363584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.363806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.363890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.363900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.364036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.364243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.364253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.364406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.364652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.364661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.364798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.364962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.364973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.365062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.365142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.365152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.365280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.365522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.365531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.955 [2024-12-16 14:34:16.365660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.365789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.955 [2024-12-16 14:34:16.365799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.955 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.366035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.366232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.366242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.366465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.366610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.366619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.366762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.366984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.366994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.367123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.367267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.367278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.367442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.367575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.367585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.367737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.367934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.367944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.368112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.368358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.368368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.368512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.368681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.368691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.368909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.369068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.369078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.369306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.369530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.369540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.369761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.369922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.369932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.370126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.370276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.370286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.370368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.370562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.370572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.370795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.370998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.371008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.371179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.371416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.371426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.371619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.371842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.371852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.372015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.372154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.372164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.372406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.372568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.372578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.372812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.372954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.372965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.373056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.373184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.373194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.373430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.373597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.373607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.373755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.373944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.373955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.374033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.374100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.374109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.374185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.374311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.374321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.374543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.374625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.374635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.374787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.374941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.374952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.375197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.375277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.375287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.375522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.375604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.375614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.375755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.375976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.375986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.956 qpair failed and we were unable to recover it. 00:30:01.956 [2024-12-16 14:34:16.376081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.956 [2024-12-16 14:34:16.376158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.376168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.376387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.376611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.376621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.376706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.376865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.376876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.377121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.377254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.377264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.377428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.377598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.377607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.377692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.377835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.377844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.378093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.378278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.378298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.378545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.378685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.378700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.378935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.379090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.379105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.379343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.379502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.379517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.379674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.379838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.379858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.380023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.380282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.380297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.380532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.380632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.380647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.380810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.380908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.380924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.381081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.381275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.381290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.381547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.381713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.381728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.381906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.382090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.382105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.382268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.382358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.382373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.382603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.382834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.382850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.382880] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15b3900 (9): Bad file descriptor 00:30:01.957 [2024-12-16 14:34:16.383126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.383318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.383338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.383555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.383753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.383771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.384025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.384270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.384280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.384480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.384636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.384646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.384815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.384968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.384979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.385209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.385415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.385425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.385727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.385970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.385981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.386200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.386347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.386356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.386580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.386826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.386836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.387085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.387223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.387232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.957 qpair failed and we were unable to recover it. 00:30:01.957 [2024-12-16 14:34:16.387451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.387656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.957 [2024-12-16 14:34:16.387666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.387813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.387941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.387952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.388169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.388427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.388443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.388601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.388754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.388769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.388966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.389120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.389136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.389306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.389459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.389474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.389659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.389805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.389820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.389975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.390132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.390148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.390314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.390471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.390486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.390769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.390940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.390956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.391123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.391276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.391292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.391549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.391745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.391761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.391907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.392140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.392157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.392338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.392496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.392511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.392768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.392940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.392951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.393047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.393243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.393253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.393386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.393478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.393488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.393630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.393857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.393868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.394074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.394228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.394238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.394408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.394558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.394568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.394750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.394947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.394957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.395183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.395312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.395322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.395517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.395607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.395617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.395794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.395938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.395948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.396097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.396259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.396269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.396344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.396565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.396575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.958 qpair failed and we were unable to recover it. 00:30:01.958 [2024-12-16 14:34:16.396778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.396907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.958 [2024-12-16 14:34:16.396918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.397061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.397230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.397240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.397462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.397609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.397619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.397782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.397869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.397879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.398008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.398150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.398159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.398359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.398602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.398612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.398860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.399069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.399079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.399151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.399305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.399314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.399538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.399748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.399758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.399907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.400056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.400067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.400161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.400407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.400417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.400517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.400605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.400615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.400696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.400920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.400931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.401083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.401228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.401238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.401326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.401547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.401557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.401688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.401913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.401924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.402121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.402339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.402349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.402583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.402800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.402810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.403048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.403244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.403254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.403477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.403679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.403689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.403892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.404106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.404116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.404247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.404449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.404458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.404600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.404795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.404806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.404939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.405075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.405085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.405223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.405379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.405389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.405588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.405736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.405745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.405896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.406054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.406067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.406262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.406514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.406525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.406653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.406780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.406789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.406938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.407069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.959 [2024-12-16 14:34:16.407079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.959 qpair failed and we were unable to recover it. 00:30:01.959 [2024-12-16 14:34:16.407311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.407506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.407516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.407770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.407990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.408001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.408232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.408400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.408410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.408539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.408775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.408785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.408940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.409149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.409158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.409314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.409486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.409496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.409714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.409859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.409871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.410114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.410303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.410313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.410457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.410605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.410615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.410698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.410840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.410850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.411052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.411274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.411284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.411426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.411557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.411567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.411790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.411964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.411974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.412133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.412276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.412286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.412534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.412693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.412702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.412915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.413047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.413056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.413211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.413381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.413393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.413540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.413787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.413797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.413932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.414086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.414096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.414243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.414337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.414347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.414497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.414713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.414723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.414902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.415064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.415074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.415156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.415328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.415338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.415472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.415659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.415668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.415890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.415987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.415997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.416147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.416379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.416389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.416534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.416681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.416693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.416842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.417063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.417073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.417313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.417485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.417495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.960 qpair failed and we were unable to recover it. 00:30:01.960 [2024-12-16 14:34:16.417692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.960 [2024-12-16 14:34:16.417847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.417861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.418010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.418143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.418153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.418255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.418424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.418434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.418514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.418736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.418746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.418988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.419169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.419178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.419412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.419647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.419657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.419813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.419976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.419986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.420135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.420353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.420363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.420586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.420752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.420762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.420930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.421124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.421135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.421331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.421471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.421481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.421547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.421692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.421702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.421795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.421932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.421942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.422071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.422221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.422231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.422419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.422616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.422626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.422687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.422826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.422836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.423051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.423244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.423254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.423423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.423617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.423627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.423846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.424057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.424067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.424292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.424439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.424449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.424670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.424916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.424926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.425184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.425427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.425437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.425634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.425860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.425870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.426048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.426113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.426123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.426320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.426534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.426544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.426778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.426995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.427006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.427203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.427404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.427413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.427495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.427634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.427644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.427912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.428109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.428118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.961 [2024-12-16 14:34:16.428339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.428583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.961 [2024-12-16 14:34:16.428593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.961 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.428767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.428957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.428967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.429100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.429326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.429336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.429592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.429814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.429825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.429900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.430118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.430128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.430296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.430425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.430435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.430585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.430732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.430742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.430884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.431041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.431052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.431135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.431293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.431303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.431468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.431683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.431693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.431926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.432081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.432091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.432310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.432469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.432479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.432687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.432977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.432988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.433184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.433395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.433404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.433556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.433693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.433703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.433795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.433993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.434003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.434226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.434371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.434381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.434607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.434800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.434810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.434961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.435023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.435033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.435276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.435533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.435542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.435787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.435918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.435928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.436077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.436319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.436329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.436545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.436766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.436777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.436999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.437168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.437178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.437397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.437591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.437601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.437841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.437972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.437982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.438206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.438414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.438424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.438642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.438831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.438841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.962 qpair failed and we were unable to recover it. 00:30:01.962 [2024-12-16 14:34:16.438987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.962 [2024-12-16 14:34:16.439163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.439172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.439382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.439606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.439616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.439702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.439829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.439839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.439987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.440129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.440139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.440386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.440523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.440533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.440700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.440921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.440932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.441074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.441206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.441215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.441381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.441532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.441541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.441688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.441749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.441758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.441897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.442031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.442040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.442171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.442392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.442402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.442653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.442822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.442833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.442981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.443122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.443132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.443276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.443517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.443527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.443659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.443819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.443829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.444024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.444109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.444119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.444248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.444309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.444318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.444537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.444726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.444736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.444882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.444961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.444971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.445124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.445347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.445357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.445530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.445758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.445768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.445979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.446155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.446165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.446359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.446605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.446615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.446776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.446988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.446998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.447230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.447381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.963 [2024-12-16 14:34:16.447391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.963 qpair failed and we were unable to recover it. 00:30:01.963 [2024-12-16 14:34:16.447539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.447801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.447811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.447952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.448103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.448113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.448269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.448490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.448499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.448583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.448722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.448732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.448884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.448967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.448978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.449116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.449282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.449292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.449374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.449519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.449529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.449750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.449946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.449957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.450056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.450208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.450218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.450371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.450512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.450522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.450728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.450871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.450881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.451035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.451121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.451131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.451265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.451494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.451504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.451657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.451827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.451837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.452088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.452309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.452319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.452508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.452744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.452754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.452987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.453186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.453196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.453422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.453618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.453628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.453707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.453905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.453915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.454157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.454299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.454309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.454533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.454680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.454690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.454771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.454928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.454938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.455176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.455388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.455398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.455558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.455775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.455786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.455968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.456121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.456130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.456260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.456403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.456413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.456514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.456669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.456678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.456764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.456926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.456937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.457067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.457264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.457274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.964 qpair failed and we were unable to recover it. 00:30:01.964 [2024-12-16 14:34:16.457423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.964 [2024-12-16 14:34:16.457507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.457517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.457674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.457752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.457762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.458002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.458239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.458249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.458400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.458635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.458645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.458803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.458935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.458945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.459089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.459224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.459234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.459377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.459564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.459574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.459722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.459956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.459969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.460135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.460377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.460388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.460604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.460699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.460709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.460918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.460999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.461010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.461208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.461406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.461416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.461583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.461710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.461722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.461946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.462164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.462174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.462348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.462493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.462503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.462726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.462966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.462977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.463187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.463356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.463367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.463505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.463705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.463717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.463871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.464098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.464109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.464286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.464504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.464515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.464680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.464909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.464920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.465049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.465194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.465204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.465341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.465484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.465494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.465717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.465801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.465810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.465904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.466040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.466052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.466292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.466382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.466391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.466641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.466865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.466879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.467043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.467190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.467203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.467288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.467432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.467442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.965 qpair failed and we were unable to recover it. 00:30:01.965 [2024-12-16 14:34:16.467574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.965 [2024-12-16 14:34:16.467801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.467811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.468029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.468199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.468209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.468428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.468597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.468608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.468708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.468905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.468916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.469063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.469264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.469274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.469353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.469503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.469513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.469655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.469795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.469805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.470044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.470241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.470251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.470330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.470498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.470510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.470603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.470781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.470791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.470963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.471094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.471103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.471278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.471497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.471507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.471639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.471889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.471900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.472044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.472188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.472198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.472286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.472427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.472438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.472574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.472725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.472735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.472977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.473075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.473085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.473280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.473497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.473507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.473730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.473974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.473985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.474276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.474464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.474474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.474682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.474830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.474841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.474938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.475026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.475036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.475211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.475403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.475415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.475483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.475679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.475692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.475929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.476009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.476019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.476104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.476255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.476266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.476511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.476705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.476716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.476937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.477083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.477094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.477318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.477516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.477526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.966 qpair failed and we were unable to recover it. 00:30:01.966 [2024-12-16 14:34:16.477752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.477988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.966 [2024-12-16 14:34:16.477999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.478151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.478242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.478251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.478506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.478635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.478645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.478885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.479028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.479038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.479173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.479420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.479430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.479571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.479712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.479723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.479922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.480098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.480109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.480270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.480418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.480428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.480514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.480652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.480662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.480815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.480982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.480993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.481219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.481395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.481405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.481484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.481702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.481712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.481863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.482019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.482030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.482110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.482254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.482264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.482353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.482524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.482534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.482676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.482898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.482909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.483160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.483319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.483329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.483564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.483788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.483799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.483894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.484101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.484111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.484260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.484425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.484436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.484581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.484727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.484737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.484831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.484921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.484932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.485015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.485142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.485153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.485304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.485454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.485464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.485705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.485847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.485863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.485962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.486137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.486147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.967 [2024-12-16 14:34:16.486220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.486363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.967 [2024-12-16 14:34:16.486373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.967 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.486595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.486762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.486772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.487036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.487123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.487133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.487351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.487624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.487634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.487808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.487996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.488008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.488092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.488232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.488242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.488314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.488502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.488512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.488705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.488851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.488871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.489114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.489208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.489219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.489376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.489633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.489643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.489900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.490028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.490039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.490194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.490365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.490375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.490596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.490686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.490696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.490842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.491069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.491080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:01.968 [2024-12-16 14:34:16.491308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.491392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:01.968 [2024-12-16 14:34:16.491403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:01.968 qpair failed and we were unable to recover it. 00:30:02.255 [2024-12-16 14:34:16.491603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.255 [2024-12-16 14:34:16.491755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.255 [2024-12-16 14:34:16.491767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.255 qpair failed and we were unable to recover it. 00:30:02.255 [2024-12-16 14:34:16.491950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.255 [2024-12-16 14:34:16.492093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.255 [2024-12-16 14:34:16.492103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.255 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.492177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.492319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.492329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.492483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.492712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.492722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.492816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.492972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.492982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.493139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.493287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.493297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.493472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.493622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.493632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.493783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.493940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.493951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.494088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.494253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.494263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.494447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.494696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.494714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.494800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.495058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.495074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.495236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.495434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.495450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.495621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.495863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.495880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.496098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.496201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.496216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.496375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.496544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.496560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.496843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.497138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.497155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.497364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.497550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.497566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.497800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.497956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.497975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.498128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.498330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.498341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.498507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.498598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.498608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.498780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.498969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.498980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.499125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.499377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.499387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.499663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.499737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.499747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.499894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.500050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.500062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.500208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.500303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.500314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.500388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.500457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.500467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.500614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.500743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.500753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.500890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.501043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.501053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.501181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.501317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.501327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.501493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.501738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.501750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.501833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.501984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.256 [2024-12-16 14:34:16.501996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.256 qpair failed and we were unable to recover it. 00:30:02.256 [2024-12-16 14:34:16.502091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.502222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.502233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.502375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.502509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.502519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.502739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.502824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.502834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.503035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.503130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.503141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.503291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.503534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.503545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.503777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.503912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.503922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.504136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.504279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.504289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.504436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.504656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.504667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.504817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.505016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.505027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.505172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.505314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.505324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.505429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.505676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.505686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.505837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.506013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.506024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.506175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.506358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.506368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.506538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.506681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.506691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.506778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.506959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.506970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.507071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.507148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.507159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.507328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.507431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.507442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.507680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.507843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.507857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.508027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.508114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.508127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.508308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.508535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.508545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.508709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.508792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.508802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.508883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.508968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.508978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.509149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.509290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.509300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.509541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.509774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.509787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.509867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.510049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.510059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.510257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.510476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.510488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.510735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.510956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.510969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.511187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.511336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.511347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.511490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.511579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.511591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.257 qpair failed and we were unable to recover it. 00:30:02.257 [2024-12-16 14:34:16.511730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.257 [2024-12-16 14:34:16.511826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.511836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.512057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.512122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.512132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.512279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.512364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.512375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.512589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.512793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.512804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.512958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.513106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.513117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.513259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.513410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.513420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.513585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.513667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.513693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.513783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.513936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.513947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.514166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.514300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.514311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.514409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.514572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.514585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.514775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.514862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.514873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.515041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.515191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.515202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.515343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.515552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.515563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.515711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.515842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.515852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.515938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.516091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.516103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.516182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.516260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.516271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.516343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.516439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.516449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.516676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.516868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.516879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.516981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.517156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.517166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.517365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.517588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.517601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.517809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.517899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.517910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.518110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.518189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.518199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.518424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.518650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.518661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.518810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.518890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.518902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.519082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.519232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.519242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.519386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.519564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.519575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.519736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.519986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.519998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.520148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.520330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.520340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.258 [2024-12-16 14:34:16.520487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.520649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.258 [2024-12-16 14:34:16.520659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.258 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.520747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.520879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.520889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.520966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.521130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.521140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.521236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.521387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.521397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.521482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.521628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.521638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.521786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.521875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.521885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.521996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.522084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.522094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.522227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.522314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.522324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.522393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.522470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.522480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.522564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.522768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.522778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.522931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.523177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.523187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.523327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.523510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.523521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.523588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.523812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.523822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.524044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.524195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.524205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.524356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.524513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.524523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.524733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.524805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.524814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.524980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.525108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.525118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.525264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.525479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.525489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.525637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.525806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.525817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.526058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.526134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.526143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.526340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.526576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.526586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.526735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.526953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.526964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.527049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.527199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.527208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.527408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.527569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.527579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.527813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.527975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.527985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.528141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.528218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.528228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.528317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.528406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.528416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.528581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.528786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.528797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.528872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.529024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.529034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.529172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.529245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.529255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.259 qpair failed and we were unable to recover it. 00:30:02.259 [2024-12-16 14:34:16.529392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.259 [2024-12-16 14:34:16.529543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.529553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.529701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.529872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.529882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.529962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.530111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.530121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.530329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.530412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.530421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.530581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.530676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.530686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.530817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.531011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.531022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.531090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.531277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.531287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.531361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.531578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.531588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.531734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.531871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.531881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.532034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.532192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.532202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.532291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.532524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.532535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.532694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.532920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.532931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.533096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.533179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.533189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.533277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.533439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.533449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.533616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.533745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.533755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.533903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.534046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.534056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.534160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.534373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.534384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.534613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.534852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.534868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.535044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.535242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.535251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.535348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.535454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.535463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.535540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.535698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.535708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.535872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.535937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.535946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.536179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.536260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.536270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.536414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.536607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.536616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.536783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.536990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.537001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.260 qpair failed and we were unable to recover it. 00:30:02.260 [2024-12-16 14:34:16.537100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.260 [2024-12-16 14:34:16.537303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.537313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.537375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.537473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.537483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.537621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.537760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.537770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.537920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.538073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.538083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.538282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.538494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.538504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.538720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.538882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.538893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.539099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.539294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.539304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.539455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.539629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.539639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.539773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.539950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.539961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.540110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.540332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.540342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.540518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.540598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.540608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.540738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.540887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.540898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.541062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.541292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.541302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.541495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.541637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.541647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.541848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.542000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.542010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.542235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.542409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.542419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.542600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.542748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.542758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.542845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.543000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.543010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.543170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.543366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.543376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.543544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.543744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.543754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.543829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.543967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.543978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.544067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.544201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.544210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.544286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.544434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.544444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.544610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.544737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.544747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.544973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.545062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.545072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.545215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.545299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.545308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.545408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.545553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.545562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.545760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.545951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.545961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.546043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.546183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.546193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.261 [2024-12-16 14:34:16.546259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.546401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.261 [2024-12-16 14:34:16.546410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.261 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.546504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.546593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.546602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.546763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.546918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.546928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.547137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.547313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.547323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.547500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.547639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.547650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.547735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.547806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.547816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.548022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.548192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.548202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.548290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.548429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.548438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.548608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.548679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.548689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.548869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.549013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.549023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.549117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.549280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.549290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.549533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.549605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.549615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.549832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.549947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.549958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.550097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.550193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.550204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.550346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.550559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.550570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.550769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.550908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.550918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.551085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.551169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.551179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.551343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.551422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.551432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.551661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.551724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.551733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.551962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.552089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.552099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.552228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.552366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.552376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.552462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.552651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.552662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.552898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.553046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.553057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.553221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.553311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.553321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.553515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.553661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.553671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.553809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.553938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.553949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.554034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.554169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.554179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.554321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.554516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.554527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.554655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.554879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.554890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.555108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.555288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.262 [2024-12-16 14:34:16.555298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.262 qpair failed and we were unable to recover it. 00:30:02.262 [2024-12-16 14:34:16.555449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.555546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.555556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.555739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.555883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.555894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.556023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.556105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.556115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.556264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.556414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.556424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.556523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.556757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.556767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.556931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.556995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.557004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.557224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.557384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.557394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.557559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.557727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.557737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.557877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.558033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.558045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.558157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.558291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.558301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.558396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.558637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.558647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.558778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.558990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.559000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.559133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.559286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.559296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.559384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.559619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.559629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.559791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.559867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.559878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.560028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.560229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.560239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.560478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.560609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.560619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.560932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.561035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.561045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.561135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.561278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.561290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.561373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.561456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.561465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.561612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.561840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.561850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.561934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.562064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.562074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.562227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.562301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.562311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.562517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.562663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.562672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.562744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.562917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.562928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.563147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.563239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.563249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.563412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.563499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.563509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.563742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.563836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.563846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.564044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.564290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.564302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.263 qpair failed and we were unable to recover it. 00:30:02.263 [2024-12-16 14:34:16.564540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.564778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.263 [2024-12-16 14:34:16.564788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.565053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.565142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.565152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.565354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.565433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.565442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.565620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.565766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.565777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.566007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.566099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.566109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.566205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.566296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.566305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.566442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.566587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.566596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.566683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.566827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.566837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.566982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.567130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.567140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.567226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.567304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.567316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.567405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.567556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.567567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.567696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.567865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.567880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.568033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.568196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.568206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.568308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.568495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.568507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.568728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.568822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.568833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.569068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.569209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.569219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.569306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.569400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.569409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.569571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.569717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.569727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.569901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.569984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.569995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.570144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.570292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.570302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.570448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.570581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.570591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.570819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.570975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.570986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.571116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.571258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.571268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.571371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.571557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.571567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.571706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.571795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.571805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.264 qpair failed and we were unable to recover it. 00:30:02.264 [2024-12-16 14:34:16.572007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.572176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.264 [2024-12-16 14:34:16.572185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.572335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.572516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.572527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.572727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.572865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.572875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.573025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.573182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.573193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.573288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.573478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.573488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.573606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.573699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.573709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.573802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.573886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.573896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.573971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.574210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.574221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.574372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.574614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.574624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.574791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.574933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.574943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.575101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.575198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.575208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.575298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.575390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.575399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.575559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.575720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.575730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.575871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.576058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.576068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.576241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.576377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.576387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.576560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.576711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.576722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.576823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.577045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.577055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.577135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.577278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.577288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.577484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.577746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.577756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.577975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.578072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.578083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.578173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.578266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.578276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.578419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.578579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.578589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.578670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.578809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.578819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.578967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.579061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.579072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.579168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.579384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.579394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.579489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.579695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.579706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.579973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.580123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.580133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.580281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.580363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.580373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.580527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.580622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.580632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.265 [2024-12-16 14:34:16.580710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.580916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.265 [2024-12-16 14:34:16.580926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.265 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.581076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.581181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.581192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.581388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.581649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.581659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.581816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.581966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.581977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.582118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.582215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.582225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.582383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.582473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.582483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.582743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.582892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.582902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.582993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.583091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.583101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.583276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.583543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.583553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.583633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.583797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.583809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.583895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.584042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.584052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.584182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.584325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.584336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.584547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.584766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.584777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.584989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.585139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.585149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.585236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.585402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.585413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.585496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.585555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.585566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.585788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.586001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.586012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.586103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.586193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.586204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.586335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.586534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.586544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.586640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.586796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.586806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.586959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.587052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.587063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.587207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.587308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.587318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.587419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.587500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.587510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.587649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.587778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.587788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.587946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.588185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.588358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.588603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.588887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.588980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.266 [2024-12-16 14:34:16.589062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.589149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.266 [2024-12-16 14:34:16.589160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.266 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.589292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.589419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.589430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.589563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.589779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.589789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.590033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.590120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.590130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.590216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.590319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.590329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.590457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.590649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.590659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.590804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.590962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.590973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.591057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.591189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.591199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.591348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.591614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.591624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.591732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.591863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.591873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.591988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.592223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.592458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.592703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.592888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.592998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.593083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.593323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.593496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.593713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.593876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.593971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.594061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.594137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.594146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.594290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.594375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.594386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.594474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.594554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.594564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.594714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.594810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.594820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.594924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.595080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.595303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.595527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.595702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.267 [2024-12-16 14:34:16.595867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.267 [2024-12-16 14:34:16.595966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.267 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.596041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.596188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.596338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.596496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.596639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.596862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.596952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.597021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.597161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.597305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.597549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.597695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.597870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.597942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.598011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.598190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.598348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.598556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.598761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.598908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.598992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.599072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.599293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.599430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.599575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.599730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.599872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.599936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.600194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.600331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.600471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.600626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.600772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.600911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.268 qpair failed and we were unable to recover it. 00:30:02.268 [2024-12-16 14:34:16.600981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.268 [2024-12-16 14:34:16.601053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.601130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.601347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.601482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.601650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.601809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.601890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.601961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.602116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.602250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.602409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.602623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.602781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.602866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.602930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.603099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.603243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.603395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.603566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.603715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.603863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.603948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.604008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.604215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.604391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.604527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.604672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.604819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.604976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.269 [2024-12-16 14:34:16.605038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.605113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.269 [2024-12-16 14:34:16.605123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.269 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.605205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.605334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.605344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.605418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.605560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.605570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.605659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.605725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.605736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.605800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.605928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.605938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.605998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.606218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.606386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.606603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.606756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.606840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.606907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.607189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.607329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.607485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.607637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.607845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.607992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.608133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.608287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.608445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.608589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.608740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.608814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.609027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.609165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.609331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.609632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.609861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.609941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.610008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.610153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.610163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.610308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.610460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.610470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.610549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.610617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.610627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.610693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.610823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.270 [2024-12-16 14:34:16.610833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.270 qpair failed and we were unable to recover it. 00:30:02.270 [2024-12-16 14:34:16.610966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.611119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.611284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.611628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.611771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.611885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.611958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.612121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.612285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.612430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.612584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.612793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.612883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.613032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.613235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.613408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.613648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.613802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.613897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.613970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.614139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.614361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.614512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.614667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.614803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.614888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.614961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.615137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.615306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.615542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.615683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.615842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.615928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.616066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.616166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.616175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.271 qpair failed and we were unable to recover it. 00:30:02.271 [2024-12-16 14:34:16.616242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.271 [2024-12-16 14:34:16.616374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.616384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.616633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.616717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.616727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.616790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.616852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.616867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.616941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.617085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.617309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.617455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.617609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.617774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.617849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.617963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.618178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.618309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.618472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.618662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.618813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.618905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.618977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.619192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.619402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.619754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.619930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.619991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.620062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.620223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.620555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.620836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.620940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.621004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.621283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.621568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.621714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.621863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.621999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.622009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.272 [2024-12-16 14:34:16.622082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.622173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.272 [2024-12-16 14:34:16.622183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.272 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.622250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.622329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.622339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.622490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.622555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.622565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.622661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.622749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.622759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.622844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.622982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.622992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.623059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.623204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.623439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.623586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.623884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.623967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.624035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.624287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.624458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.624707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.624884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.624963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.625045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.625254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.625407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.625631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.625769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.625922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.626058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.626216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.626226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.626360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.626437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.626447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.626599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.626740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.626750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.626880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.626945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.626955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.627031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.627112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.627122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.627204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.627274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.627284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.273 qpair failed and we were unable to recover it. 00:30:02.273 [2024-12-16 14:34:16.627374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.273 [2024-12-16 14:34:16.627449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.627459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.627587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.627694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.627703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.627792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.627870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.627881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.627946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.628170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.628332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.628485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.628643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.628809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.628949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.629036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.629195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.629477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.629651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.629797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.629886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.630049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.630200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.630359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.630499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.630668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.630822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.630978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.631062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.631209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.631358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.631572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.631717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.631878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.631964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.632114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.632183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.632193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.632277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.632447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.632457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.274 [2024-12-16 14:34:16.632608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.632688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.274 [2024-12-16 14:34:16.632698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.274 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.632775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.632906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.632917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.633001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.633214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.633364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.633527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.633668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.633837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.633920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.633983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.634288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.634572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.634747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.634907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.634988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.635074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.635305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.635521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.635670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.635821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.635906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.635973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.636115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.636350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.636493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.636709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.636872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.636951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.637028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.637171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.637378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.637547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.637741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.637891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.637995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.275 qpair failed and we were unable to recover it. 00:30:02.275 [2024-12-16 14:34:16.638087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.275 [2024-12-16 14:34:16.638147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.638218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.638360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.638514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.638651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.638807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.638883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.638961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.639113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.639333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.639487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.639642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.639789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.639935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.639997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.640076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.640232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.640375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.640520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.640683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.640832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.640904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.640965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.641091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.641238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.641411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.641620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.641775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.641888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.641969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.642129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.642285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.642427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.276 qpair failed and we were unable to recover it. 00:30:02.276 [2024-12-16 14:34:16.642630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.276 [2024-12-16 14:34:16.642719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.642786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.642849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.642865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.642929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.643152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.643294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.643425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.643630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.643777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.643874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.644019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.644171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.644345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.644619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.644818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.644972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.645049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.645213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.645354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.645489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.645702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.645838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.645938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.646005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.646164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.646313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.646452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.646597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.646781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.646897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.646990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.647172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.647339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.647519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.277 [2024-12-16 14:34:16.647686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.277 [2024-12-16 14:34:16.647781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.277 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.647928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.648113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.648400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.648571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.648728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.648838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.648938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.649144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.649384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.649627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.649801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.649982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.650058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.650133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.650149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.650300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.650398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.650415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.650672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.650748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.650763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.650839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.650931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.650942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.651103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.651264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.651537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.651742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.651882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.651997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.652133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.652277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.652440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.652588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.652723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.652899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.653047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.653125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.653135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.278 [2024-12-16 14:34:16.653204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.653332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.278 [2024-12-16 14:34:16.653342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.278 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.653406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.653491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.653501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.653582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.653712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.653722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.653927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.654100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.654246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.654400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.654552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.654773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.654870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.655018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.655176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.655491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.655776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.655928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.655994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.656069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.656373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.656526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.656661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.656826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.656921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.656982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.657222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.657394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.657552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.657907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.657999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.658144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.658367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.658566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.658799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.658872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.658955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.659028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.659038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.659101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.659232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.659246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.279 qpair failed and we were unable to recover it. 00:30:02.279 [2024-12-16 14:34:16.659312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.279 [2024-12-16 14:34:16.659374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.659383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.659462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.659598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.659608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.659683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.659762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.659773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.659852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.659952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.659962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.660027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.660177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.660349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.660514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.660667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.660811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.660888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.660959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.661159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.661295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.661441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.661583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.661718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.661873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.661948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.662021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.662234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.662380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.662534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.662750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.662914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.662987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.663049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.663191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.663341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.663476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.663618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.663769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.663846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.280 qpair failed and we were unable to recover it. 00:30:02.280 [2024-12-16 14:34:16.663941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.664004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.280 [2024-12-16 14:34:16.664014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.664087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.664310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.664573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.664712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.664867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.664941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.665001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.665148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.665314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.665466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.665602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.665740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.665814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.665880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.666096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.666237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.666377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.666527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.666656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.666813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.666895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.666970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.667119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.667253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.667396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.667549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.667685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.667819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.667956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.668031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.668093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.668103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.668232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.668307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.668317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.668378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.668447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.668458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.281 [2024-12-16 14:34:16.668518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.668585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.281 [2024-12-16 14:34:16.668595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.281 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.668674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.668804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.668814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.668964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.669205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.669346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.669510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.669659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.669799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.669875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.670105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.670266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.670407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.670606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.670823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.670900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.670969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.671120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.671266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.671504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.671666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.671790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.671873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.671948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.672090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.672369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.672509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.672669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.672872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.672957] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.282 [2024-12-16 14:34:16.673024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.673106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.282 [2024-12-16 14:34:16.673115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.282 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.673187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.673340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.673497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.673653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.673826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.673896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.674028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.674198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.674342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.674517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.674668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.674804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.674883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.674957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.675110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.675261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.675422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.675564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.675783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.675885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.675951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.676087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.676242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.676371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.676589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.676723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.676795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.676953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.677171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.677385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.677527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.677675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.677824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.677920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.283 qpair failed and we were unable to recover it. 00:30:02.283 [2024-12-16 14:34:16.677983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.283 [2024-12-16 14:34:16.678059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.678141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.678295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.678449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.678644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.678784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.678932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.678999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.679113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.679262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.679495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.679636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.679788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.679866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.679996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.680205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.680367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.680521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.680752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.680891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.681022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.681181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.681327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.681496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.681640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.681803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.681938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.682109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.682319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.682482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.682640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.682880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.682959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.683023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.683089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.683098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.284 [2024-12-16 14:34:16.683168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.683304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.284 [2024-12-16 14:34:16.683315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.284 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.683380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.683519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.683529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.683599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.683728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.683738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.683814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.683949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.683960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.684042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.684215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.684340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.684472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.684616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.684752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.684896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.684966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.685035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.685269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.685517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.685746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.685885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.685961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.686030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.686237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.686383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.686538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.686710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.686850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.686993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.687071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.687285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.687501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.687634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.687790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.687864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.687936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.688026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.688036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.688168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.688453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.688466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.688540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.688654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.688664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.285 qpair failed and we were unable to recover it. 00:30:02.285 [2024-12-16 14:34:16.688728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.285 [2024-12-16 14:34:16.688794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.688804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.688912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.688974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.688984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.689054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.689197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.689332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.689478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.689626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.689767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.689929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.690013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.690189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.690337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.690497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.690650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.690864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.690970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.691046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.691189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.691428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.691579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.691726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.691821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.691890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.692097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.692236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.692395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.692550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.692685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.692837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.692961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.693100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.693167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.693178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.693236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.693309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.693319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.693402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.693481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.693491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.286 [2024-12-16 14:34:16.693573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.693637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.286 [2024-12-16 14:34:16.693647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.286 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.693779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.693842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.693859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.693986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.694178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.694319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.694607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.694757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.694919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.694991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.695170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.695322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.695533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.695697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.695842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.695919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.695987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.696158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.696287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.696505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.696725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.696873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.696953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.697114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.697280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.697545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.697687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.697839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.697940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.698008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.698078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.698089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.698154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.698282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.698292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.287 [2024-12-16 14:34:16.698351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.698435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.287 [2024-12-16 14:34:16.698445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.287 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.698529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.698593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.698603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.698671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.698739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.698749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.698814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.698881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.698893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.698955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.699088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.699232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.699371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.699575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.699781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.699851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.699985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.700169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.700305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.700464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.700642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.700763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.700853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.701177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42e8000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.701380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.701620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.701776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.701851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.701945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.702120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.702340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.702551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.702715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.702908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.702990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.703099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.703432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.703613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.703852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.703968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.288 qpair failed and we were unable to recover it. 00:30:02.288 [2024-12-16 14:34:16.704069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.288 [2024-12-16 14:34:16.704148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.704241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.704481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.704664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.704815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.704959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.705031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.705186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.705339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.705512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.705711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.705795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.705931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.706200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.706349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.706635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.706814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.706892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.706958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.707127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.707279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.707423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.707566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.707741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.707822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.707893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.708179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.708397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.708548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.708693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.708885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.708966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.709030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.709175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.709186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.709249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.709393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.709404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.289 [2024-12-16 14:34:16.709506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.709574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.289 [2024-12-16 14:34:16.709585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.289 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.709724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.709787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.709798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.709862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.709923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.709934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.710001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.710171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.710394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.710544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.710738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.710891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.711024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.711184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.711364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.711528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.711704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.711873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.711961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.712028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.712037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.712116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.712265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.712276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.712422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.712626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.712639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.712772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.712861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.712872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.712960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.713026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.713037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.713107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.713287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.713299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.713377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.713514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.713525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.713748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.713824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.713834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.713907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.714138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.714388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.714634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.714889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.714998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.715154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.715325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.715481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.715644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.290 qpair failed and we were unable to recover it. 00:30:02.290 [2024-12-16 14:34:16.715883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.290 [2024-12-16 14:34:16.715951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.715962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.716028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.716194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.716337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.716608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.716790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.716892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.716978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.717210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.717380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.717590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.717764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.717912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.717977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.718211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.718355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.718639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.718822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.718973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.719048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.719205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.719426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.719583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.719799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.719882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.719960] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.720149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.720375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.720530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.720687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.291 qpair failed and we were unable to recover it. 00:30:02.291 [2024-12-16 14:34:16.720851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.291 [2024-12-16 14:34:16.720939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.720950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.721022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.721232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.721404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.721558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.721773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.721863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.721941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.722147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.722378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.722547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.722699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.722866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.722933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.723077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.723216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.723412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.723625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.723780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.723879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.723944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.724155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.724297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.724451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.724599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.724748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.724916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.724999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.725172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.725314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.725589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.725748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.725913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.725986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.292 [2024-12-16 14:34:16.726062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.726133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.292 [2024-12-16 14:34:16.726144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.292 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.726215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.726350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.726360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.726436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.726502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.726512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.726591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.726747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.726757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.726838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.726923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.726933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.727006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.727168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.727383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.727540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.727706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.727788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.727872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.728094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.728246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.728386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.728598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.728888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.728965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.729031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.729178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.729441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.729597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.729819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.729898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.729983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.730143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.730354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.730564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.730726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.730883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.730960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.731024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.731093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.731104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.731252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.731316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.731326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.731456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.731521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.731531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.293 qpair failed and we were unable to recover it. 00:30:02.293 [2024-12-16 14:34:16.731600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.293 [2024-12-16 14:34:16.731660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.731670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.731733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.731874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.731885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.731954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.732115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.732402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.732631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.732871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.732958] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.733021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.733182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.733422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.733575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.733710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.733819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.733893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.734106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.734272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.734442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.734583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.734823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.734910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.734978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.735126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.735345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.735488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.735640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.735774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.735890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.735959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.736100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.736250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.736507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.736646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.294 qpair failed and we were unable to recover it. 00:30:02.294 [2024-12-16 14:34:16.736813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.294 [2024-12-16 14:34:16.736943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.736954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.737018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.737180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.737329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.737470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.737622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.737842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.737945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.738079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.738241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.738397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.738546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.738706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.738873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.738970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.739034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.739251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.739401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.739577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.739723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.739794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.739869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.740076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.740297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.740521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.740750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.740905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.740989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.741119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.741261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.741405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.741574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.741720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.295 qpair failed and we were unable to recover it. 00:30:02.295 [2024-12-16 14:34:16.741880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.295 [2024-12-16 14:34:16.741953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.742085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.742244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.742394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.742576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.742743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.742839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.742942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.743089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.743304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.743445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.743609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.743826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.743907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.743974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.744124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.744261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.744468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.744602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.744831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.744921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.744990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.745238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.745407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.745632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.745866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.745955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.746024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.746168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.746181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.746274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.746340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.746350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.746428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.746508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.746519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.296 [2024-12-16 14:34:16.746598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.746793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.296 [2024-12-16 14:34:16.746804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.296 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.746875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.746941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.746951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.747028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.747179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.747475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.747687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.747837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.747992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.748057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.748148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.748159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.748366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.748436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.748446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.748574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.748645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.748655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.748731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.748867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.748878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.748945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.749099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.749395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.749557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.749748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.749918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.749996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.750101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.750279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.750517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.750652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.750864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.750955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.751020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.751187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.751327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.751491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.751636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.751773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.751920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.751991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.752001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.752069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.752151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.752162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.752229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.752311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.752321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.297 [2024-12-16 14:34:16.752392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.752524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.297 [2024-12-16 14:34:16.752535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.297 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.752665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.752724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.752734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.752882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.752949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.752961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.753115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.753345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.753489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.753639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.753798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.753883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.753953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.754133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.754278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.754501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.754645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.754807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.754888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.754963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.755110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.755253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.755411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.755630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.755785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.755874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.755969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.756180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.756356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.756647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.756823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.756966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.757034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.757236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.757469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.757621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.757787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.757935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.758015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.758074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.758084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.758146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.758206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.758217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.298 [2024-12-16 14:34:16.758295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.758424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.298 [2024-12-16 14:34:16.758435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.298 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.758516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.758584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.758595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.758657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.758731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.758742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.758807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.758875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.758886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.759083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.759380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.759539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.759680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.759898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.759972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.760029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.760239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.760408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.760553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.760712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.760867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.760960] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.761025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.761203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.761360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.761505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.761681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.761822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.761954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.762171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.762352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.762507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.762801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.762892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.762969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.763116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.763358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.763523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.763680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.763907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.763998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.764008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.764093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.764167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.764178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.299 [2024-12-16 14:34:16.764265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.764348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.299 [2024-12-16 14:34:16.764358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.299 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.764428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.764496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.764508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.764578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.764640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.764651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.764765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.764831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.764842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.764916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.764992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.765073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.765266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.765504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.765704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.765930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.765995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.766145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.766304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.766509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.766667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.766899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.766973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.767040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.767211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.767457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.767603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.767747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.767824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.767906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.768043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.768054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.768197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.768278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.768288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.768365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.768493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.768503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.768595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.768673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.300 [2024-12-16 14:34:16.768684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.300 qpair failed and we were unable to recover it. 00:30:02.300 [2024-12-16 14:34:16.768763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.768826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.768835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.768922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.768985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.768995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.769059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.769249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.769463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.769613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.769844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.769940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.770006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.770148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.770304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.770459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.770582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.770797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.770882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.770945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.771144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.771296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.771447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.771674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.771886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.771971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.772037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.772245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.772398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.772536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.772702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.772774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.772974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.773039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.773049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.773113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.773171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.773180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.773309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.773376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.773386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.301 qpair failed and we were unable to recover it. 00:30:02.301 [2024-12-16 14:34:16.773448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.301 [2024-12-16 14:34:16.773540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.773550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.773608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.773699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.773709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.773782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.773852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.773870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.773946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.774108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.774265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.774411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.774564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.774702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.774833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.774910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.774979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.775211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.775345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.775484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.775700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.775849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.775939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.776001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.776148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.776293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.776534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.776674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.776894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.776979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.777046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.777218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.777421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.777554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.777778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.777887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.777963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.778100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.778238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.778394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.778652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.302 qpair failed and we were unable to recover it. 00:30:02.302 [2024-12-16 14:34:16.778808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.302 [2024-12-16 14:34:16.778879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.778889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.778959] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.779330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.779476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.779650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.779800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.779885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.779956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.780168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.780375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.780529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.780677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.780839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.780927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.780993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.781233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.781446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.781598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.781747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.781903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.781980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.782042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.782331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.782470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.782657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.782796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.782875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.782939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.783156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.783329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.783482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.783632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.783917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.783999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.784010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.784078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.784205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.784215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.784298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.784373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.784383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.784462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.784609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.784619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.303 qpair failed and we were unable to recover it. 00:30:02.303 [2024-12-16 14:34:16.784685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.303 [2024-12-16 14:34:16.784737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.784747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.784815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.785027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.785038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.785225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.785304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.785314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.785572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.785749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.785759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.785977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.786071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.786081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.786213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.786304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.786313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.786454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.786645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.786656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.786729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.786805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.786815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.786907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.787060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.787070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.787167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.787256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.787266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.787417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.787493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.787502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.787697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.787830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.787839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.788111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.788277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.788286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.788416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.788550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.788560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.788706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.788832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.788841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.788997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.789176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.789186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.789324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.789403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.789412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.789569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.789796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.789806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.789988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.790134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.790144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.790296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.790506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.790517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.790716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.790928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.790938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.791027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.791105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.791115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.791243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.791366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.791376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.791542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.791715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.791725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.791863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.791998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.792008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.792165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.792327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.792338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.304 qpair failed and we were unable to recover it. 00:30:02.304 [2024-12-16 14:34:16.792419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.792584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.304 [2024-12-16 14:34:16.792595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.792732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.792936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.792947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.793091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.793186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.793196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.793359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.793537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.793547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.793707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.793834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.793844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.794021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.794179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.794196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.794308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.794497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.794513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.794623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.794775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.794790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.795039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.795149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.795165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.795316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.795528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.795543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.795779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.795954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.795974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.796083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.796184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.796198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.796425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.796716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.796732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.796937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.797149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.797164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.797375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.797517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.797532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.797742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.797917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.797934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.798184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.798284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.798299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.798572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.798735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.798751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.798972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.799184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.799198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.799298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.799446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.799460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.799766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.800012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.800028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.800187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.800350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.800366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.800621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.800741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.800756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.305 [2024-12-16 14:34:16.800847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.801016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.305 [2024-12-16 14:34:16.801036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.305 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.801188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.801305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.801321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.801535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.801760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 14:34:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:02.585 [2024-12-16 14:34:16.801776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 14:34:16 -- common/autotest_common.sh@862 -- # return 0 00:30:02.585 [2024-12-16 14:34:16.802025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 14:34:16 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:02.585 [2024-12-16 14:34:16.802196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.802212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 14:34:16 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 14:34:16 -- common/autotest_common.sh@10 -- # set +x 00:30:02.585 [2024-12-16 14:34:16.802512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.802676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.802691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.802942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.803033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.803048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.803162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.803268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.803284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.803508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.803629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.803645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.803757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.803933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.803949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.804183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.804388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.804404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.804572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.804722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.804738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.804992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.805095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.805112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.805279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.805440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.805455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.805627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.805893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.805910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.806099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.806256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.806272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.806455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.806565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.806581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.806755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.806840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.806860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.807052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.807157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.807172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.807274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.807529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.807544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.807703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.807866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.807882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15a5ea0 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.808068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.808182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.808201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42f4000b90 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.808311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.808404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.808414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.808508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.808640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.808650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.585 qpair failed and we were unable to recover it. 00:30:02.585 [2024-12-16 14:34:16.808785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.808891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.585 [2024-12-16 14:34:16.808902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.808983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.809081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.809092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.809190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.809263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.809274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.809354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.809444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.809455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.809618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.809875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.809886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.809973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.810055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.810065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.810150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.810239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.810250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.810338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.810540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.810551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.810702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.810847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.810871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.810984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.811171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.811388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.811658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.811906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.811982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.812086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.812227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.812237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.812338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.812422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.812433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.812519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.812695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.812705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.812776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.812993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.813099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.813297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.813542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.813724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.813874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.814012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.814206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.814389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.814554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.814867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.814973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.815058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.815151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.815161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.815244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.815336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.815346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.586 [2024-12-16 14:34:16.815429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.815526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.586 [2024-12-16 14:34:16.815536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.586 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.815672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.815877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.815888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.815983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.816085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.816096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.816234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.816324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.816335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.816543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.816760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.816770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.816879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.816981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.816991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.817085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.817179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.817189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.817283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.817363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.817373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.817514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.817725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.817734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.817877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.818101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.818334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.818514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.818698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.818866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.818973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.819116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.819127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.819219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.819348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.819358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.819444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.819587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.819598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.819754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.819906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.819918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.820046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.820237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.820414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.820632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.820865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.820949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.821012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.821198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.821434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.821594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.821920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.821997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.822007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.822081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.822148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.822159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.822255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.822319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.822329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.587 qpair failed and we were unable to recover it. 00:30:02.587 [2024-12-16 14:34:16.822419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.587 [2024-12-16 14:34:16.822628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.822639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.822719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.822923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.822934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.823020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.823098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.823108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.823213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.823306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.823316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.823473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.823672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.823683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.823842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.823982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.823994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.824067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.824316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.824508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.824669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.824912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.824991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.825082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.825272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.825563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.825793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.825903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.825982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.826175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.826360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.826638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.826875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.826961] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.827063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.827218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.827409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.827635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.827864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.827937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.828071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.828149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.828159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.828225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.828304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.828314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.828416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.828567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.828579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.828660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.828864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.828876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.588 [2024-12-16 14:34:16.828968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.829127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.588 [2024-12-16 14:34:16.829136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.588 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.829234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.829298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.829308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.829399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.829559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.829570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.829705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.829789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.829800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.830011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.830257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.830423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.830661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.830888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.830982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.831126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.831210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.831220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.831314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.831407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.831417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.831631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.831787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.831797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.831957] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.832096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.832107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.832195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.832279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.832289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.832375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.832456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.832466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.832624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.832824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.832835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.832931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.833119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.833287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.833567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.833753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.833906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.833993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.834161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.834172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.834240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.834315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.834325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.834425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.834561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.834571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.834766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.834981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.834992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.835131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.835214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.589 [2024-12-16 14:34:16.835225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.589 qpair failed and we were unable to recover it. 00:30:02.589 [2024-12-16 14:34:16.835292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.835375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.835386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.835544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.835717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.835727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.835863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.835955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.835965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.836056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.836145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.836155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.836240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.836311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.836320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.836427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.836689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.836700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.836833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.836982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.836992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.837068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.837152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.837162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.837254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 14:34:16 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:02.590 [2024-12-16 14:34:16.837382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.837395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.837633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 14:34:16 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:02.590 [2024-12-16 14:34:16.837766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.837777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.837925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 14:34:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.590 [2024-12-16 14:34:16.838065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.838078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.838209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 14:34:16 -- common/autotest_common.sh@10 -- # set +x 00:30:02.590 [2024-12-16 14:34:16.838296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.838308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.838382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.838547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.838557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.838629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.838781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.838790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.838924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.839000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.839010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.839098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.839227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.839237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.839364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.839449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.839459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.839682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.839765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.839775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.839933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.840149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.840339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.840548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.840767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.840964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.841112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.841208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.841219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.841306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.841391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.841401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.841497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.841578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.841588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.841797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.841940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.841951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.842033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.842160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.842170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.590 [2024-12-16 14:34:16.842266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.842354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.590 [2024-12-16 14:34:16.842364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.590 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.842447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.842680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.842690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.842845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.842922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.842934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.843001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.843092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.843101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.843204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.843275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.843284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.843371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.843470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.843481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.843700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.843905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.843915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.844015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.844099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.844108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.844205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.844284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.844293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.844379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.844469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.844479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.844634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.844859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.844870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.845005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.845100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.845110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.845265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.845338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.845347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.845604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.845769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.845779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.845962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.846064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.846074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.846164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.846242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.846252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.846344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.846597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.846607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.846765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.846879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.846890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.847035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.847120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.847130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.847226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.847373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.847384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.847557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.847702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.847711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.847840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.848054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.848065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.848195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.848275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.848285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.848380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.848464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.848474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.848611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.848748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.848758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.848913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.849001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.849013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.849167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.849253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.849263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.849396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.849539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.849548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.849643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.849862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.849873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.849952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.850033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.850043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.591 qpair failed and we were unable to recover it. 00:30:02.591 [2024-12-16 14:34:16.850123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.591 [2024-12-16 14:34:16.850266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.850277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.850352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.850438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.850449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.850590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.850730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.850740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.850829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.850989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.851001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.851144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.851244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.851255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.851331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.851407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.851419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.851603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.851802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.851812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.851897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.852130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.852319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.852482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.852691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.852774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.852933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.853028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.853038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.853114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.853173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.853183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.853280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.853370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.853380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.853538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.853703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.853716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.853880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.854032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.854043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.854203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.854296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.854307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.854406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.854572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.854584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.854831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.854914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.854926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.855030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.855114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.855127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.855227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.855323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.855334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.855419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.855611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.855623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.855849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.855947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.855959] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.856120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.856218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.856229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.856332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.856430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.856443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.856507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.856588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.856598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.856738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.857024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.857035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.857109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.857246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.857256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.592 [2024-12-16 14:34:16.857355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.857433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.592 [2024-12-16 14:34:16.857443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.592 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.857653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.857803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.857813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.857882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.857978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.857989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.858090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.858182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.858192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.858272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.858357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.858366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.858461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.858611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.858621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 Malloc0 00:30:02.593 [2024-12-16 14:34:16.858775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.858940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.858950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 14:34:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.593 [2024-12-16 14:34:16.859030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.859132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.859142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 14:34:16 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:02.593 [2024-12-16 14:34:16.859246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 14:34:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.593 [2024-12-16 14:34:16.859383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.859393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 14:34:16 -- common/autotest_common.sh@10 -- # set +x 00:30:02.593 [2024-12-16 14:34:16.859577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.859728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.859738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.859889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.859954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.859964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.860064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.860148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.860157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.860355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.860540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.860550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.860754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.860905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.860915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.861125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.861226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.861236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.861463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.861605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.861616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.861804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.861962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.861972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.862120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.862223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.862233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.862328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.862349] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:02.593 [2024-12-16 14:34:16.862429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.862439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.862678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.862875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.862886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.862992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.863066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.863076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.863247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.863335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.863344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.863415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.863562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.863572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.863791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.863917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.863928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.864006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.864206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.864217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.864303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.864405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.864415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.864598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.864765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.864775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.864867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.864956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.864966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.593 [2024-12-16 14:34:16.865061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.865261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.593 [2024-12-16 14:34:16.865272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.593 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.865422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.865601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.865611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.865765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.865978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.865988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.866230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.866327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.866338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.866543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.866684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.866694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.866822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.866954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.866965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.867116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.867182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.867193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.867282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.867422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.867432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.867604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.867770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.867780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.867946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.868082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.868092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.868292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.868422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.868432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.868590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.868782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.868793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.868985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.869161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.869171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.869326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.869424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.869434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.869537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.869647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.869657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.869817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.869981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.869992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.870082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.870278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.870288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.870382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.870605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.870615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 14:34:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.594 [2024-12-16 14:34:16.870769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 14:34:16 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:02.594 [2024-12-16 14:34:16.870918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.870930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 14:34:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.871008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 14:34:16 -- common/autotest_common.sh@10 -- # set +x 00:30:02.594 [2024-12-16 14:34:16.871153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.871164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.871254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.871410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.871419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.871579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.871775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.871785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.871936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.872094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.872105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.872262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.872413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.872422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.872587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.872754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.872765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.872908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.873006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.873016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.594 [2024-12-16 14:34:16.873095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.873256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.594 [2024-12-16 14:34:16.873267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.594 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.873350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.873453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.873463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.873546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.873629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.873638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.873874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.873958] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.873967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.874054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.874149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.874159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.874237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.874406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.874415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.874577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.874707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.874717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.874794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.874871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.874881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.875029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.875117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.875127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.875209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.875309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.875319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.875561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.875689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.875698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.875845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.875991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.876095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.876279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.876511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.876850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.876971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.877135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.877302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.877311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.877534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.877752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.877762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.877954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.878097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.878107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.878268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.878371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.878382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.878471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.878615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.878625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 14:34:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.595 [2024-12-16 14:34:16.878765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 14:34:16 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:02.595 [2024-12-16 14:34:16.878994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.879006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 14:34:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.595 [2024-12-16 14:34:16.879152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 14:34:16 -- common/autotest_common.sh@10 -- # set +x 00:30:02.595 [2024-12-16 14:34:16.879222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.879231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.879378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.879544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.879554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.879753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.879979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.879989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.880080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.880170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.880180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.880337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.880493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.880504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.880701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.880875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.880884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.881028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.881096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.881106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.595 qpair failed and we were unable to recover it. 00:30:02.595 [2024-12-16 14:34:16.881201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.881273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.595 [2024-12-16 14:34:16.881283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.881386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.881595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.881605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.881803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.881889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.881899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.882047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.882195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.882204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.882304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.882401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.882411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.882582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.882677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.882687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.882932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.883107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.883351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.883596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.883826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.883918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.884124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.884222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.884232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.884310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.884438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.884448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.884523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.884697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.884707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.884794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.884991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.885002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.885164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.885253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.885263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.885359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.885441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.885452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.885668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.885850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.885882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.886035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.886166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.886176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.886313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.886414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.886423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.886584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 14:34:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.596 [2024-12-16 14:34:16.886746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.886758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 14:34:16 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:02.596 [2024-12-16 14:34:16.886891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 14:34:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.596 [2024-12-16 14:34:16.887046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.887057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 14:34:16 -- common/autotest_common.sh@10 -- # set +x 00:30:02.596 [2024-12-16 14:34:16.887194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.887286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.887296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.887374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.887534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.887544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.887705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.887848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.887863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.888029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.888198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.888207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.888308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.888512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.888522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.888741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.888939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.888950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.889031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.889227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.889238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.596 qpair failed and we were unable to recover it. 00:30:02.596 [2024-12-16 14:34:16.889388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.596 [2024-12-16 14:34:16.889602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.597 [2024-12-16 14:34:16.889612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.889765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.597 [2024-12-16 14:34:16.889827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.597 [2024-12-16 14:34:16.889837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.889990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.597 [2024-12-16 14:34:16.890071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.597 [2024-12-16 14:34:16.890081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.890159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.597 [2024-12-16 14:34:16.890304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.597 [2024-12-16 14:34:16.890314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7f42ec000b90 with addr=10.0.0.2, port=4420 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.890442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:02.597 [2024-12-16 14:34:16.890601] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:02.597 [2024-12-16 14:34:16.892495] posix.c: 670:posix_sock_psk_use_session_client_cb: *ERROR*: PSK is not set 00:30:02.597 [2024-12-16 14:34:16.892533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x7f42ec000b90 (107): Transport endpoint is not connected 00:30:02.597 [2024-12-16 14:34:16.892579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 14:34:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.597 14:34:16 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:02.597 14:34:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:02.597 14:34:16 -- common/autotest_common.sh@10 -- # set +x 00:30:02.597 14:34:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:02.597 [2024-12-16 14:34:16.902915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.902995] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.903014] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.903023] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.903030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.903048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 14:34:16 -- host/target_disconnect.sh@58 -- # wait 553581 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.912918] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.912978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.912992] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.913000] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.913005] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.913020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.922876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.922937] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.922951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.922961] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.922967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.922981] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.932847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.932929] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.932942] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.932948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.932954] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.932968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.942913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.942972] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.942986] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.942993] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.942999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.943013] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.952945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.953000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.953013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.953020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.953025] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.953039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.962967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.963025] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.963038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.963044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.963050] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.963064] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.973000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.973057] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.973071] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.973077] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.973083] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.973097] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.983001] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.983055] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.983068] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.983074] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.983080] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.983094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:16.993047] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:16.993103] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:16.993116] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:16.993122] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:16.993128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.597 [2024-12-16 14:34:16.993142] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.597 qpair failed and we were unable to recover it. 00:30:02.597 [2024-12-16 14:34:17.003070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.597 [2024-12-16 14:34:17.003126] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.597 [2024-12-16 14:34:17.003139] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.597 [2024-12-16 14:34:17.003145] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.597 [2024-12-16 14:34:17.003151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.003165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.013093] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.013150] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.013166] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.013172] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.013178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.013192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.023115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.023166] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.023179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.023185] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.023191] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.023205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.033203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.033269] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.033282] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.033289] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.033294] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.033308] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.043166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.043218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.043232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.043237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.043243] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.043257] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.053203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.053259] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.053273] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.053279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.053285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.053301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.063239] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.063294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.063307] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.063313] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.063319] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.063333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.073259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.073322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.073335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.073341] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.073347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.073361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.083294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.083349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.083362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.083368] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.083374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.083388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.093427] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.093495] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.093508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.093514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.093520] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.093534] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.103399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.103455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.103471] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.103478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.103483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.103498] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.113410] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.113459] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.113472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.113478] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.113484] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.598 [2024-12-16 14:34:17.113497] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.598 qpair failed and we were unable to recover it. 00:30:02.598 [2024-12-16 14:34:17.123446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.598 [2024-12-16 14:34:17.123507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.598 [2024-12-16 14:34:17.123520] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.598 [2024-12-16 14:34:17.123527] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.598 [2024-12-16 14:34:17.123532] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.599 [2024-12-16 14:34:17.123546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.599 qpair failed and we were unable to recover it. 00:30:02.599 [2024-12-16 14:34:17.133408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.599 [2024-12-16 14:34:17.133470] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.599 [2024-12-16 14:34:17.133483] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.599 [2024-12-16 14:34:17.133490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.599 [2024-12-16 14:34:17.133495] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.599 [2024-12-16 14:34:17.133509] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.599 qpair failed and we were unable to recover it. 00:30:02.882 [2024-12-16 14:34:17.143488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.882 [2024-12-16 14:34:17.143548] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.882 [2024-12-16 14:34:17.143561] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.882 [2024-12-16 14:34:17.143568] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.882 [2024-12-16 14:34:17.143573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.882 [2024-12-16 14:34:17.143590] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.882 qpair failed and we were unable to recover it. 00:30:02.882 [2024-12-16 14:34:17.153474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.882 [2024-12-16 14:34:17.153526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.882 [2024-12-16 14:34:17.153539] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.882 [2024-12-16 14:34:17.153545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.882 [2024-12-16 14:34:17.153551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.882 [2024-12-16 14:34:17.153564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.882 qpair failed and we were unable to recover it. 00:30:02.882 [2024-12-16 14:34:17.163510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.882 [2024-12-16 14:34:17.163568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.882 [2024-12-16 14:34:17.163581] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.882 [2024-12-16 14:34:17.163587] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.882 [2024-12-16 14:34:17.163593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.882 [2024-12-16 14:34:17.163607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.882 qpair failed and we were unable to recover it. 00:30:02.882 [2024-12-16 14:34:17.173532] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.882 [2024-12-16 14:34:17.173583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.882 [2024-12-16 14:34:17.173596] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.882 [2024-12-16 14:34:17.173602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.882 [2024-12-16 14:34:17.173608] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.882 [2024-12-16 14:34:17.173622] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.882 qpair failed and we were unable to recover it. 00:30:02.882 [2024-12-16 14:34:17.183510] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.882 [2024-12-16 14:34:17.183582] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.882 [2024-12-16 14:34:17.183595] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.882 [2024-12-16 14:34:17.183602] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.882 [2024-12-16 14:34:17.183607] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.882 [2024-12-16 14:34:17.183621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.882 qpair failed and we were unable to recover it. 00:30:02.882 [2024-12-16 14:34:17.193586] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.882 [2024-12-16 14:34:17.193644] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.882 [2024-12-16 14:34:17.193661] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.882 [2024-12-16 14:34:17.193667] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.882 [2024-12-16 14:34:17.193673] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.882 [2024-12-16 14:34:17.193687] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.882 qpair failed and we were unable to recover it. 00:30:02.882 [2024-12-16 14:34:17.203631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.882 [2024-12-16 14:34:17.203692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.203706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.203713] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.203718] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.203732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.213647] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.213701] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.213714] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.213720] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.213726] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.213741] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.223716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.223769] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.223782] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.223788] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.223794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.223808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.233654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.233718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.233731] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.233737] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.233746] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.233760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.243768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.243834] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.243847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.243858] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.243865] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.243879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.253823] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.253879] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.253892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.253899] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.253904] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.253918] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.263799] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.263851] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.263869] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.263875] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.263881] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.263895] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.273757] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.273813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.273825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.273832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.273838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.273852] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.283863] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.283926] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.283940] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.283946] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.283952] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.283966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.293913] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.293982] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.293995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.294002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.294008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.294022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.303857] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.303912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.303925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.303932] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.303938] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.303951] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.313945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.313997] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.314010] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.314016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.314022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.314036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.323989] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.324041] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.324054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.324060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.324069] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.324083] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.334044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.883 [2024-12-16 14:34:17.334127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.883 [2024-12-16 14:34:17.334140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.883 [2024-12-16 14:34:17.334146] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.883 [2024-12-16 14:34:17.334151] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.883 [2024-12-16 14:34:17.334165] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.883 qpair failed and we were unable to recover it. 00:30:02.883 [2024-12-16 14:34:17.344105] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.344193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.344207] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.344214] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.344220] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.344235] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.354062] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.354121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.354134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.354140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.354146] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.354160] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.364099] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.364151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.364165] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.364171] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.364177] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.364191] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.374117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.374168] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.374182] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.374188] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.374194] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.374208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.384179] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.384235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.384248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.384254] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.384260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.384274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.394101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.394156] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.394169] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.394175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.394181] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.394195] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.404214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.404272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.404284] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.404291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.404296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.404311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.414264] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.414320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.414333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.414342] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.414348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.414361] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.424317] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.424371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.424384] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.424391] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.424396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.424410] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.434282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.434339] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.434352] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.434358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.434364] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.434377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:02.884 [2024-12-16 14:34:17.444323] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:02.884 [2024-12-16 14:34:17.444379] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:02.884 [2024-12-16 14:34:17.444391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:02.884 [2024-12-16 14:34:17.444398] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:02.884 [2024-12-16 14:34:17.444403] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:02.884 [2024-12-16 14:34:17.444417] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:02.884 qpair failed and we were unable to recover it. 00:30:03.143 [2024-12-16 14:34:17.454355] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:03.143 [2024-12-16 14:34:17.454412] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:03.143 [2024-12-16 14:34:17.454425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:03.143 [2024-12-16 14:34:17.454432] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:03.143 [2024-12-16 14:34:17.454438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:03.143 [2024-12-16 14:34:17.454452] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:03.143 qpair failed and we were unable to recover it. 00:30:03.143 [2024-12-16 14:34:17.464391] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:03.143 [2024-12-16 14:34:17.464452] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:03.143 [2024-12-16 14:34:17.464464] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:03.143 [2024-12-16 14:34:17.464470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:03.143 [2024-12-16 14:34:17.464476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:03.143 [2024-12-16 14:34:17.464490] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:03.144 qpair failed and we were unable to recover it. 00:30:03.144 [2024-12-16 14:34:17.474397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:03.144 [2024-12-16 14:34:17.474453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:03.144 [2024-12-16 14:34:17.474467] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:03.144 [2024-12-16 14:34:17.474474] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:03.144 [2024-12-16 14:34:17.474480] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:03.144 [2024-12-16 14:34:17.474495] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:03.144 qpair failed and we were unable to recover it. 00:30:03.144 [2024-12-16 14:34:17.484470] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:03.144 [2024-12-16 14:34:17.484525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:03.144 [2024-12-16 14:34:17.484538] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:03.144 [2024-12-16 14:34:17.484544] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:03.144 [2024-12-16 14:34:17.484550] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:03.144 [2024-12-16 14:34:17.484564] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:03.144 qpair failed and we were unable to recover it. 00:30:03.144 [2024-12-16 14:34:17.494437] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:03.144 [2024-12-16 14:34:17.494500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:03.144 [2024-12-16 14:34:17.494532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:03.144 [2024-12-16 14:34:17.494539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:03.144 [2024-12-16 14:34:17.494545] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7f42ec000b90 00:30:03.144 [2024-12-16 14:34:17.494567] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:03.144 qpair failed and we were unable to recover it. 00:30:03.144 [2024-12-16 14:34:17.494602] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:03.144 A controller has encountered a failure and is being reset. 00:30:03.144 Controller properly reset. 00:30:08.413 Initializing NVMe Controllers 00:30:08.413 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:08.413 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:08.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:08.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:08.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:08.413 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:08.413 Initialization complete. Launching workers. 00:30:08.413 Starting thread on core 1 00:30:08.413 Starting thread on core 2 00:30:08.413 Starting thread on core 3 00:30:08.413 Starting thread on core 0 00:30:08.413 14:34:22 -- host/target_disconnect.sh@59 -- # sync 00:30:08.413 00:30:08.413 real 0m11.272s 00:30:08.413 user 0m34.389s 00:30:08.413 sys 0m4.815s 00:30:08.413 14:34:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:08.413 14:34:22 -- common/autotest_common.sh@10 -- # set +x 00:30:08.413 ************************************ 00:30:08.413 END TEST nvmf_target_disconnect_tc2 00:30:08.413 ************************************ 00:30:08.413 14:34:22 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:08.413 14:34:22 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:08.413 14:34:22 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:08.413 14:34:22 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:08.413 14:34:22 -- nvmf/common.sh@116 -- # sync 00:30:08.413 14:34:22 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:08.413 14:34:22 -- nvmf/common.sh@119 -- # set +e 00:30:08.413 14:34:22 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:08.413 14:34:22 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:08.413 rmmod nvme_tcp 00:30:08.413 rmmod nvme_fabrics 00:30:08.413 rmmod nvme_keyring 00:30:08.413 14:34:22 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:08.413 14:34:22 -- nvmf/common.sh@123 -- # set -e 00:30:08.413 14:34:22 -- nvmf/common.sh@124 -- # return 0 00:30:08.413 14:34:22 -- nvmf/common.sh@477 -- # '[' -n 554265 ']' 00:30:08.413 14:34:22 -- nvmf/common.sh@478 -- # killprocess 554265 00:30:08.413 14:34:22 -- common/autotest_common.sh@936 -- # '[' -z 554265 ']' 00:30:08.413 14:34:22 -- common/autotest_common.sh@940 -- # kill -0 554265 00:30:08.413 14:34:22 -- common/autotest_common.sh@941 -- # uname 00:30:08.413 14:34:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:08.413 14:34:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 554265 00:30:08.413 14:34:22 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:08.413 14:34:22 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:08.413 14:34:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 554265' 00:30:08.413 killing process with pid 554265 00:30:08.413 14:34:22 -- common/autotest_common.sh@955 -- # kill 554265 00:30:08.413 14:34:22 -- common/autotest_common.sh@960 -- # wait 554265 00:30:08.413 14:34:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:08.413 14:34:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:08.413 14:34:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:08.413 14:34:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:08.413 14:34:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:08.413 14:34:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:08.413 14:34:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:08.414 14:34:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:10.319 14:34:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:10.319 00:30:10.319 real 0m19.493s 00:30:10.319 user 1m1.293s 00:30:10.319 sys 0m9.446s 00:30:10.319 14:34:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:10.319 14:34:24 -- common/autotest_common.sh@10 -- # set +x 00:30:10.319 ************************************ 00:30:10.319 END TEST nvmf_target_disconnect 00:30:10.319 ************************************ 00:30:10.319 14:34:24 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:10.319 14:34:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:10.319 14:34:24 -- common/autotest_common.sh@10 -- # set +x 00:30:10.319 14:34:24 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:10.319 00:30:10.319 real 23m30.125s 00:30:10.319 user 63m49.080s 00:30:10.319 sys 6m16.859s 00:30:10.319 14:34:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:10.319 14:34:24 -- common/autotest_common.sh@10 -- # set +x 00:30:10.319 ************************************ 00:30:10.319 END TEST nvmf_tcp 00:30:10.319 ************************************ 00:30:10.319 14:34:24 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:10.319 14:34:24 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:10.319 14:34:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:10.319 14:34:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:10.319 14:34:24 -- common/autotest_common.sh@10 -- # set +x 00:30:10.319 ************************************ 00:30:10.319 START TEST spdkcli_nvmf_tcp 00:30:10.319 ************************************ 00:30:10.319 14:34:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:10.319 * Looking for test storage... 00:30:10.319 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:10.319 14:34:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:10.319 14:34:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:10.319 14:34:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:10.319 14:34:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:10.319 14:34:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:10.319 14:34:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:10.319 14:34:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:10.319 14:34:24 -- scripts/common.sh@335 -- # IFS=.-: 00:30:10.319 14:34:24 -- scripts/common.sh@335 -- # read -ra ver1 00:30:10.319 14:34:24 -- scripts/common.sh@336 -- # IFS=.-: 00:30:10.319 14:34:24 -- scripts/common.sh@336 -- # read -ra ver2 00:30:10.319 14:34:24 -- scripts/common.sh@337 -- # local 'op=<' 00:30:10.319 14:34:24 -- scripts/common.sh@339 -- # ver1_l=2 00:30:10.319 14:34:24 -- scripts/common.sh@340 -- # ver2_l=1 00:30:10.319 14:34:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:10.319 14:34:24 -- scripts/common.sh@343 -- # case "$op" in 00:30:10.319 14:34:24 -- scripts/common.sh@344 -- # : 1 00:30:10.319 14:34:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:10.319 14:34:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:10.319 14:34:24 -- scripts/common.sh@364 -- # decimal 1 00:30:10.319 14:34:24 -- scripts/common.sh@352 -- # local d=1 00:30:10.319 14:34:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:10.319 14:34:24 -- scripts/common.sh@354 -- # echo 1 00:30:10.319 14:34:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:10.319 14:34:24 -- scripts/common.sh@365 -- # decimal 2 00:30:10.319 14:34:24 -- scripts/common.sh@352 -- # local d=2 00:30:10.319 14:34:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:10.319 14:34:24 -- scripts/common.sh@354 -- # echo 2 00:30:10.319 14:34:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:10.319 14:34:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:10.319 14:34:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:10.319 14:34:24 -- scripts/common.sh@367 -- # return 0 00:30:10.319 14:34:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:10.319 14:34:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:10.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:10.319 --rc genhtml_branch_coverage=1 00:30:10.319 --rc genhtml_function_coverage=1 00:30:10.319 --rc genhtml_legend=1 00:30:10.319 --rc geninfo_all_blocks=1 00:30:10.319 --rc geninfo_unexecuted_blocks=1 00:30:10.319 00:30:10.319 ' 00:30:10.319 14:34:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:10.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:10.319 --rc genhtml_branch_coverage=1 00:30:10.319 --rc genhtml_function_coverage=1 00:30:10.319 --rc genhtml_legend=1 00:30:10.319 --rc geninfo_all_blocks=1 00:30:10.319 --rc geninfo_unexecuted_blocks=1 00:30:10.319 00:30:10.319 ' 00:30:10.319 14:34:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:10.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:10.319 --rc genhtml_branch_coverage=1 00:30:10.319 --rc genhtml_function_coverage=1 00:30:10.319 --rc genhtml_legend=1 00:30:10.319 --rc geninfo_all_blocks=1 00:30:10.319 --rc geninfo_unexecuted_blocks=1 00:30:10.319 00:30:10.319 ' 00:30:10.319 14:34:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:10.319 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:10.319 --rc genhtml_branch_coverage=1 00:30:10.319 --rc genhtml_function_coverage=1 00:30:10.319 --rc genhtml_legend=1 00:30:10.319 --rc geninfo_all_blocks=1 00:30:10.319 --rc geninfo_unexecuted_blocks=1 00:30:10.319 00:30:10.319 ' 00:30:10.319 14:34:24 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:10.319 14:34:24 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:10.319 14:34:24 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:10.319 14:34:24 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:10.319 14:34:24 -- nvmf/common.sh@7 -- # uname -s 00:30:10.319 14:34:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:10.319 14:34:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:10.319 14:34:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:10.319 14:34:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:10.319 14:34:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:10.319 14:34:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:10.320 14:34:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:10.320 14:34:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:10.320 14:34:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:10.320 14:34:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:10.579 14:34:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:30:10.579 14:34:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:30:10.579 14:34:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:10.579 14:34:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:10.579 14:34:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:10.579 14:34:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:10.579 14:34:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:10.579 14:34:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:10.579 14:34:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:10.580 14:34:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:10.580 14:34:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:10.580 14:34:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:10.580 14:34:24 -- paths/export.sh@5 -- # export PATH 00:30:10.580 14:34:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:10.580 14:34:24 -- nvmf/common.sh@46 -- # : 0 00:30:10.580 14:34:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:10.580 14:34:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:10.580 14:34:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:10.580 14:34:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:10.580 14:34:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:10.580 14:34:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:10.580 14:34:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:10.580 14:34:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:10.580 14:34:24 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:10.580 14:34:24 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:10.580 14:34:24 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:10.580 14:34:24 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:10.580 14:34:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:10.580 14:34:24 -- common/autotest_common.sh@10 -- # set +x 00:30:10.580 14:34:24 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:10.580 14:34:24 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=555774 00:30:10.580 14:34:24 -- spdkcli/common.sh@34 -- # waitforlisten 555774 00:30:10.580 14:34:24 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:10.580 14:34:24 -- common/autotest_common.sh@829 -- # '[' -z 555774 ']' 00:30:10.580 14:34:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:10.580 14:34:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:10.580 14:34:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:10.580 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:10.580 14:34:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:10.580 14:34:24 -- common/autotest_common.sh@10 -- # set +x 00:30:10.580 [2024-12-16 14:34:24.937747] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:10.580 [2024-12-16 14:34:24.937793] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid555774 ] 00:30:10.580 EAL: No free 2048 kB hugepages reported on node 1 00:30:10.580 [2024-12-16 14:34:24.991501] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:10.580 [2024-12-16 14:34:25.069719] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:10.580 [2024-12-16 14:34:25.069851] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:10.580 [2024-12-16 14:34:25.069859] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:11.517 14:34:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:11.517 14:34:25 -- common/autotest_common.sh@862 -- # return 0 00:30:11.517 14:34:25 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:11.517 14:34:25 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:11.517 14:34:25 -- common/autotest_common.sh@10 -- # set +x 00:30:11.517 14:34:25 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:11.517 14:34:25 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:11.517 14:34:25 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:11.517 14:34:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:11.517 14:34:25 -- common/autotest_common.sh@10 -- # set +x 00:30:11.517 14:34:25 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:11.517 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:11.517 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:11.517 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:11.517 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:11.517 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:11.517 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:11.517 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:11.517 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:11.517 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:11.517 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:11.517 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:11.517 ' 00:30:11.776 [2024-12-16 14:34:26.135980] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:13.680 [2024-12-16 14:34:28.182180] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:15.058 [2024-12-16 14:34:29.370145] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:17.590 [2024-12-16 14:34:31.561089] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:18.968 [2024-12-16 14:34:33.443213] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:20.346 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:20.346 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:20.346 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:20.346 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:20.346 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:20.346 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:20.346 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:20.346 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:20.346 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:20.346 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:20.346 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:20.346 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:20.605 14:34:35 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:20.605 14:34:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:20.605 14:34:35 -- common/autotest_common.sh@10 -- # set +x 00:30:20.605 14:34:35 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:20.605 14:34:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:20.605 14:34:35 -- common/autotest_common.sh@10 -- # set +x 00:30:20.605 14:34:35 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:20.605 14:34:35 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:20.863 14:34:35 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:21.121 14:34:35 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:21.121 14:34:35 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:21.121 14:34:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:21.121 14:34:35 -- common/autotest_common.sh@10 -- # set +x 00:30:21.121 14:34:35 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:21.121 14:34:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:21.121 14:34:35 -- common/autotest_common.sh@10 -- # set +x 00:30:21.121 14:34:35 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:21.121 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:21.121 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:21.121 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:21.121 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:21.121 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:21.121 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:21.121 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:21.121 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:21.121 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:21.121 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:21.121 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:21.121 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:21.121 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:21.121 ' 00:30:26.394 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:30:26.394 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:30:26.394 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:26.394 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:30:26.394 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:30:26.394 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:30:26.394 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:30:26.394 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:30:26.394 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:30:26.394 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:30:26.394 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:30:26.394 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:30:26.394 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:30:26.394 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:30:26.394 14:34:40 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:30:26.394 14:34:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:26.394 14:34:40 -- common/autotest_common.sh@10 -- # set +x 00:30:26.394 14:34:40 -- spdkcli/nvmf.sh@90 -- # killprocess 555774 00:30:26.394 14:34:40 -- common/autotest_common.sh@936 -- # '[' -z 555774 ']' 00:30:26.394 14:34:40 -- common/autotest_common.sh@940 -- # kill -0 555774 00:30:26.394 14:34:40 -- common/autotest_common.sh@941 -- # uname 00:30:26.394 14:34:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:26.394 14:34:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 555774 00:30:26.394 14:34:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:26.394 14:34:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:26.394 14:34:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 555774' 00:30:26.394 killing process with pid 555774 00:30:26.394 14:34:40 -- common/autotest_common.sh@955 -- # kill 555774 00:30:26.394 [2024-12-16 14:34:40.558278] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:26.394 14:34:40 -- common/autotest_common.sh@960 -- # wait 555774 00:30:26.394 14:34:40 -- spdkcli/nvmf.sh@1 -- # cleanup 00:30:26.394 14:34:40 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:30:26.394 14:34:40 -- spdkcli/common.sh@13 -- # '[' -n 555774 ']' 00:30:26.394 14:34:40 -- spdkcli/common.sh@14 -- # killprocess 555774 00:30:26.394 14:34:40 -- common/autotest_common.sh@936 -- # '[' -z 555774 ']' 00:30:26.394 14:34:40 -- common/autotest_common.sh@940 -- # kill -0 555774 00:30:26.394 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (555774) - No such process 00:30:26.394 14:34:40 -- common/autotest_common.sh@963 -- # echo 'Process with pid 555774 is not found' 00:30:26.394 Process with pid 555774 is not found 00:30:26.394 14:34:40 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:30:26.394 14:34:40 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:30:26.394 14:34:40 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:30:26.394 00:30:26.394 real 0m16.045s 00:30:26.394 user 0m33.349s 00:30:26.394 sys 0m0.665s 00:30:26.394 14:34:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:26.394 14:34:40 -- common/autotest_common.sh@10 -- # set +x 00:30:26.394 ************************************ 00:30:26.394 END TEST spdkcli_nvmf_tcp 00:30:26.394 ************************************ 00:30:26.394 14:34:40 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:26.394 14:34:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:26.394 14:34:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:26.394 14:34:40 -- common/autotest_common.sh@10 -- # set +x 00:30:26.394 ************************************ 00:30:26.394 START TEST nvmf_identify_passthru 00:30:26.394 ************************************ 00:30:26.394 14:34:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:30:26.394 * Looking for test storage... 00:30:26.394 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:26.394 14:34:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:26.394 14:34:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:26.394 14:34:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:26.394 14:34:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:26.394 14:34:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:26.394 14:34:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:26.394 14:34:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:26.394 14:34:40 -- scripts/common.sh@335 -- # IFS=.-: 00:30:26.394 14:34:40 -- scripts/common.sh@335 -- # read -ra ver1 00:30:26.394 14:34:40 -- scripts/common.sh@336 -- # IFS=.-: 00:30:26.394 14:34:40 -- scripts/common.sh@336 -- # read -ra ver2 00:30:26.394 14:34:40 -- scripts/common.sh@337 -- # local 'op=<' 00:30:26.394 14:34:40 -- scripts/common.sh@339 -- # ver1_l=2 00:30:26.394 14:34:40 -- scripts/common.sh@340 -- # ver2_l=1 00:30:26.394 14:34:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:26.394 14:34:40 -- scripts/common.sh@343 -- # case "$op" in 00:30:26.394 14:34:40 -- scripts/common.sh@344 -- # : 1 00:30:26.394 14:34:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:26.394 14:34:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:26.394 14:34:40 -- scripts/common.sh@364 -- # decimal 1 00:30:26.394 14:34:40 -- scripts/common.sh@352 -- # local d=1 00:30:26.394 14:34:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:26.394 14:34:40 -- scripts/common.sh@354 -- # echo 1 00:30:26.394 14:34:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:26.394 14:34:40 -- scripts/common.sh@365 -- # decimal 2 00:30:26.394 14:34:40 -- scripts/common.sh@352 -- # local d=2 00:30:26.394 14:34:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:26.394 14:34:40 -- scripts/common.sh@354 -- # echo 2 00:30:26.394 14:34:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:26.394 14:34:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:26.394 14:34:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:26.394 14:34:40 -- scripts/common.sh@367 -- # return 0 00:30:26.394 14:34:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:26.394 14:34:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:26.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:26.394 --rc genhtml_branch_coverage=1 00:30:26.394 --rc genhtml_function_coverage=1 00:30:26.394 --rc genhtml_legend=1 00:30:26.394 --rc geninfo_all_blocks=1 00:30:26.394 --rc geninfo_unexecuted_blocks=1 00:30:26.394 00:30:26.394 ' 00:30:26.394 14:34:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:26.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:26.394 --rc genhtml_branch_coverage=1 00:30:26.394 --rc genhtml_function_coverage=1 00:30:26.394 --rc genhtml_legend=1 00:30:26.394 --rc geninfo_all_blocks=1 00:30:26.394 --rc geninfo_unexecuted_blocks=1 00:30:26.394 00:30:26.394 ' 00:30:26.394 14:34:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:26.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:26.394 --rc genhtml_branch_coverage=1 00:30:26.394 --rc genhtml_function_coverage=1 00:30:26.394 --rc genhtml_legend=1 00:30:26.394 --rc geninfo_all_blocks=1 00:30:26.394 --rc geninfo_unexecuted_blocks=1 00:30:26.394 00:30:26.394 ' 00:30:26.394 14:34:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:26.394 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:26.394 --rc genhtml_branch_coverage=1 00:30:26.394 --rc genhtml_function_coverage=1 00:30:26.394 --rc genhtml_legend=1 00:30:26.394 --rc geninfo_all_blocks=1 00:30:26.394 --rc geninfo_unexecuted_blocks=1 00:30:26.394 00:30:26.394 ' 00:30:26.395 14:34:40 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:26.395 14:34:40 -- nvmf/common.sh@7 -- # uname -s 00:30:26.395 14:34:40 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:26.395 14:34:40 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:26.395 14:34:40 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:26.395 14:34:40 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:26.395 14:34:40 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:26.395 14:34:40 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:26.395 14:34:40 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:26.395 14:34:40 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:26.395 14:34:40 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:26.654 14:34:40 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:26.654 14:34:40 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:30:26.654 14:34:40 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:30:26.654 14:34:40 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:26.654 14:34:40 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:26.654 14:34:40 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:26.654 14:34:40 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:26.654 14:34:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:26.654 14:34:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:26.654 14:34:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:26.654 14:34:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:26.654 14:34:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:26.654 14:34:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:26.654 14:34:40 -- paths/export.sh@5 -- # export PATH 00:30:26.654 14:34:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:26.654 14:34:40 -- nvmf/common.sh@46 -- # : 0 00:30:26.654 14:34:40 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:26.654 14:34:40 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:26.654 14:34:40 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:26.654 14:34:40 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:26.654 14:34:40 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:26.654 14:34:40 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:26.654 14:34:40 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:26.654 14:34:40 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:26.654 14:34:40 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:26.654 14:34:40 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:26.654 14:34:40 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:26.654 14:34:40 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:26.655 14:34:40 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:26.655 14:34:40 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:26.655 14:34:40 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:26.655 14:34:40 -- paths/export.sh@5 -- # export PATH 00:30:26.655 14:34:40 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:26.655 14:34:40 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:30:26.655 14:34:40 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:26.655 14:34:40 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:26.655 14:34:40 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:26.655 14:34:40 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:26.655 14:34:40 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:26.655 14:34:40 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:26.655 14:34:40 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:26.655 14:34:40 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:26.655 14:34:40 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:26.655 14:34:40 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:26.655 14:34:40 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:26.655 14:34:40 -- common/autotest_common.sh@10 -- # set +x 00:30:31.928 14:34:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:31.928 14:34:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:31.928 14:34:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:31.928 14:34:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:31.928 14:34:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:31.928 14:34:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:31.928 14:34:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:31.928 14:34:45 -- nvmf/common.sh@294 -- # net_devs=() 00:30:31.928 14:34:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:31.928 14:34:45 -- nvmf/common.sh@295 -- # e810=() 00:30:31.928 14:34:45 -- nvmf/common.sh@295 -- # local -ga e810 00:30:31.928 14:34:45 -- nvmf/common.sh@296 -- # x722=() 00:30:31.928 14:34:45 -- nvmf/common.sh@296 -- # local -ga x722 00:30:31.928 14:34:45 -- nvmf/common.sh@297 -- # mlx=() 00:30:31.928 14:34:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:31.928 14:34:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:31.928 14:34:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:31.928 14:34:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:31.928 14:34:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:31.928 14:34:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:31.928 14:34:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:30:31.928 Found 0000:af:00.0 (0x8086 - 0x159b) 00:30:31.928 14:34:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:31.928 14:34:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:30:31.928 Found 0000:af:00.1 (0x8086 - 0x159b) 00:30:31.928 14:34:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:31.928 14:34:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:31.928 14:34:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:31.928 14:34:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:31.928 14:34:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:31.928 14:34:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:30:31.928 Found net devices under 0000:af:00.0: cvl_0_0 00:30:31.928 14:34:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:31.928 14:34:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:31.928 14:34:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:31.928 14:34:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:31.928 14:34:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:31.928 14:34:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:30:31.928 Found net devices under 0000:af:00.1: cvl_0_1 00:30:31.928 14:34:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:31.928 14:34:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:31.928 14:34:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:31.928 14:34:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:31.928 14:34:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:31.928 14:34:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:31.928 14:34:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:31.928 14:34:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:31.928 14:34:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:31.928 14:34:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:31.928 14:34:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:31.928 14:34:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:31.928 14:34:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:31.928 14:34:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:31.928 14:34:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:31.928 14:34:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:31.928 14:34:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:31.928 14:34:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:31.928 14:34:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:31.928 14:34:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:31.928 14:34:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:31.928 14:34:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:31.928 14:34:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:31.928 14:34:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:31.928 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:31.928 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.394 ms 00:30:31.928 00:30:31.928 --- 10.0.0.2 ping statistics --- 00:30:31.928 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:31.928 rtt min/avg/max/mdev = 0.394/0.394/0.394/0.000 ms 00:30:31.928 14:34:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:31.928 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:31.928 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.199 ms 00:30:31.928 00:30:31.928 --- 10.0.0.1 ping statistics --- 00:30:31.928 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:31.928 rtt min/avg/max/mdev = 0.199/0.199/0.199/0.000 ms 00:30:31.928 14:34:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:31.928 14:34:45 -- nvmf/common.sh@410 -- # return 0 00:30:31.928 14:34:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:31.928 14:34:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:31.928 14:34:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:31.928 14:34:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:31.928 14:34:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:31.928 14:34:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:31.928 14:34:45 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:30:31.928 14:34:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:31.928 14:34:45 -- common/autotest_common.sh@10 -- # set +x 00:30:31.928 14:34:45 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:30:31.928 14:34:45 -- common/autotest_common.sh@1519 -- # bdfs=() 00:30:31.928 14:34:45 -- common/autotest_common.sh@1519 -- # local bdfs 00:30:31.928 14:34:45 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:30:31.928 14:34:45 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:30:31.928 14:34:45 -- common/autotest_common.sh@1508 -- # bdfs=() 00:30:31.928 14:34:45 -- common/autotest_common.sh@1508 -- # local bdfs 00:30:31.928 14:34:45 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:30:31.928 14:34:45 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:30:31.928 14:34:45 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:30:31.928 14:34:46 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:30:31.928 14:34:46 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:5e:00.0 00:30:31.928 14:34:46 -- common/autotest_common.sh@1522 -- # echo 0000:5e:00.0 00:30:31.928 14:34:46 -- target/identify_passthru.sh@16 -- # bdf=0000:5e:00.0 00:30:31.928 14:34:46 -- target/identify_passthru.sh@17 -- # '[' -z 0000:5e:00.0 ']' 00:30:31.928 14:34:46 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:5e:00.0' -i 0 00:30:31.928 14:34:46 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:30:31.928 14:34:46 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:30:31.928 EAL: No free 2048 kB hugepages reported on node 1 00:30:36.116 14:34:50 -- target/identify_passthru.sh@23 -- # nvme_serial_number=BTLJ7244049A1P0FGN 00:30:36.116 14:34:50 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:5e:00.0' -i 0 00:30:36.116 14:34:50 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:30:36.116 14:34:50 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:30:36.116 EAL: No free 2048 kB hugepages reported on node 1 00:30:40.307 14:34:54 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:30:40.307 14:34:54 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:30:40.307 14:34:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:40.307 14:34:54 -- common/autotest_common.sh@10 -- # set +x 00:30:40.307 14:34:54 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:30:40.307 14:34:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:40.307 14:34:54 -- common/autotest_common.sh@10 -- # set +x 00:30:40.307 14:34:54 -- target/identify_passthru.sh@31 -- # nvmfpid=562739 00:30:40.307 14:34:54 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:30:40.307 14:34:54 -- target/identify_passthru.sh@35 -- # waitforlisten 562739 00:30:40.307 14:34:54 -- common/autotest_common.sh@829 -- # '[' -z 562739 ']' 00:30:40.308 14:34:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:40.308 14:34:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:40.308 14:34:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:40.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:40.308 14:34:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:40.308 14:34:54 -- common/autotest_common.sh@10 -- # set +x 00:30:40.308 14:34:54 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:30:40.308 [2024-12-16 14:34:54.335233] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:40.308 [2024-12-16 14:34:54.335278] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:40.308 EAL: No free 2048 kB hugepages reported on node 1 00:30:40.308 [2024-12-16 14:34:54.393048] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:40.308 [2024-12-16 14:34:54.469482] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:40.308 [2024-12-16 14:34:54.469591] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:40.308 [2024-12-16 14:34:54.469599] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:40.308 [2024-12-16 14:34:54.469605] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:40.308 [2024-12-16 14:34:54.469647] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:40.308 [2024-12-16 14:34:54.469664] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:40.308 [2024-12-16 14:34:54.469769] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:40.308 [2024-12-16 14:34:54.469771] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:40.874 14:34:55 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:40.874 14:34:55 -- common/autotest_common.sh@862 -- # return 0 00:30:40.874 14:34:55 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:30:40.874 14:34:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.874 14:34:55 -- common/autotest_common.sh@10 -- # set +x 00:30:40.874 INFO: Log level set to 20 00:30:40.874 INFO: Requests: 00:30:40.874 { 00:30:40.874 "jsonrpc": "2.0", 00:30:40.874 "method": "nvmf_set_config", 00:30:40.874 "id": 1, 00:30:40.874 "params": { 00:30:40.874 "admin_cmd_passthru": { 00:30:40.874 "identify_ctrlr": true 00:30:40.874 } 00:30:40.874 } 00:30:40.874 } 00:30:40.874 00:30:40.874 INFO: response: 00:30:40.874 { 00:30:40.874 "jsonrpc": "2.0", 00:30:40.874 "id": 1, 00:30:40.874 "result": true 00:30:40.874 } 00:30:40.874 00:30:40.874 14:34:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.874 14:34:55 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:30:40.874 14:34:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.875 14:34:55 -- common/autotest_common.sh@10 -- # set +x 00:30:40.875 INFO: Setting log level to 20 00:30:40.875 INFO: Setting log level to 20 00:30:40.875 INFO: Log level set to 20 00:30:40.875 INFO: Log level set to 20 00:30:40.875 INFO: Requests: 00:30:40.875 { 00:30:40.875 "jsonrpc": "2.0", 00:30:40.875 "method": "framework_start_init", 00:30:40.875 "id": 1 00:30:40.875 } 00:30:40.875 00:30:40.875 INFO: Requests: 00:30:40.875 { 00:30:40.875 "jsonrpc": "2.0", 00:30:40.875 "method": "framework_start_init", 00:30:40.875 "id": 1 00:30:40.875 } 00:30:40.875 00:30:40.875 [2024-12-16 14:34:55.239700] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:30:40.875 INFO: response: 00:30:40.875 { 00:30:40.875 "jsonrpc": "2.0", 00:30:40.875 "id": 1, 00:30:40.875 "result": true 00:30:40.875 } 00:30:40.875 00:30:40.875 INFO: response: 00:30:40.875 { 00:30:40.875 "jsonrpc": "2.0", 00:30:40.875 "id": 1, 00:30:40.875 "result": true 00:30:40.875 } 00:30:40.875 00:30:40.875 14:34:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.875 14:34:55 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:40.875 14:34:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.875 14:34:55 -- common/autotest_common.sh@10 -- # set +x 00:30:40.875 INFO: Setting log level to 40 00:30:40.875 INFO: Setting log level to 40 00:30:40.875 INFO: Setting log level to 40 00:30:40.875 [2024-12-16 14:34:55.253085] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:40.875 14:34:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:40.875 14:34:55 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:30:40.875 14:34:55 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:40.875 14:34:55 -- common/autotest_common.sh@10 -- # set +x 00:30:40.875 14:34:55 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:5e:00.0 00:30:40.875 14:34:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:40.875 14:34:55 -- common/autotest_common.sh@10 -- # set +x 00:30:44.162 Nvme0n1 00:30:44.162 14:34:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.162 14:34:58 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:30:44.162 14:34:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.162 14:34:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.162 14:34:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.162 14:34:58 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:30:44.162 14:34:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.162 14:34:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.162 14:34:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.162 14:34:58 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:44.162 14:34:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.162 14:34:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.162 [2024-12-16 14:34:58.150524] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:44.162 14:34:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.162 14:34:58 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:30:44.162 14:34:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.162 14:34:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.162 [2024-12-16 14:34:58.158298] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:44.162 [ 00:30:44.162 { 00:30:44.162 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:30:44.162 "subtype": "Discovery", 00:30:44.162 "listen_addresses": [], 00:30:44.162 "allow_any_host": true, 00:30:44.162 "hosts": [] 00:30:44.162 }, 00:30:44.162 { 00:30:44.162 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:30:44.162 "subtype": "NVMe", 00:30:44.162 "listen_addresses": [ 00:30:44.162 { 00:30:44.162 "transport": "TCP", 00:30:44.162 "trtype": "TCP", 00:30:44.162 "adrfam": "IPv4", 00:30:44.162 "traddr": "10.0.0.2", 00:30:44.162 "trsvcid": "4420" 00:30:44.162 } 00:30:44.162 ], 00:30:44.162 "allow_any_host": true, 00:30:44.162 "hosts": [], 00:30:44.162 "serial_number": "SPDK00000000000001", 00:30:44.162 "model_number": "SPDK bdev Controller", 00:30:44.162 "max_namespaces": 1, 00:30:44.162 "min_cntlid": 1, 00:30:44.162 "max_cntlid": 65519, 00:30:44.162 "namespaces": [ 00:30:44.162 { 00:30:44.162 "nsid": 1, 00:30:44.162 "bdev_name": "Nvme0n1", 00:30:44.162 "name": "Nvme0n1", 00:30:44.162 "nguid": "2E2DB17322C549FAB5BDDED6ED007753", 00:30:44.162 "uuid": "2e2db173-22c5-49fa-b5bd-ded6ed007753" 00:30:44.162 } 00:30:44.162 ] 00:30:44.162 } 00:30:44.162 ] 00:30:44.162 14:34:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.162 14:34:58 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:44.162 14:34:58 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:30:44.162 14:34:58 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:30:44.162 EAL: No free 2048 kB hugepages reported on node 1 00:30:44.162 14:34:58 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=BTLJ7244049A1P0FGN 00:30:44.162 14:34:58 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:30:44.162 14:34:58 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:30:44.162 14:34:58 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:30:44.162 EAL: No free 2048 kB hugepages reported on node 1 00:30:44.162 14:34:58 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:30:44.162 14:34:58 -- target/identify_passthru.sh@63 -- # '[' BTLJ7244049A1P0FGN '!=' BTLJ7244049A1P0FGN ']' 00:30:44.162 14:34:58 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:30:44.162 14:34:58 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:44.162 14:34:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:44.162 14:34:58 -- common/autotest_common.sh@10 -- # set +x 00:30:44.162 14:34:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:44.162 14:34:58 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:30:44.162 14:34:58 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:30:44.162 14:34:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:44.162 14:34:58 -- nvmf/common.sh@116 -- # sync 00:30:44.162 14:34:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:44.162 14:34:58 -- nvmf/common.sh@119 -- # set +e 00:30:44.162 14:34:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:44.162 14:34:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:44.162 rmmod nvme_tcp 00:30:44.162 rmmod nvme_fabrics 00:30:44.162 rmmod nvme_keyring 00:30:44.162 14:34:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:44.162 14:34:58 -- nvmf/common.sh@123 -- # set -e 00:30:44.162 14:34:58 -- nvmf/common.sh@124 -- # return 0 00:30:44.162 14:34:58 -- nvmf/common.sh@477 -- # '[' -n 562739 ']' 00:30:44.162 14:34:58 -- nvmf/common.sh@478 -- # killprocess 562739 00:30:44.162 14:34:58 -- common/autotest_common.sh@936 -- # '[' -z 562739 ']' 00:30:44.162 14:34:58 -- common/autotest_common.sh@940 -- # kill -0 562739 00:30:44.162 14:34:58 -- common/autotest_common.sh@941 -- # uname 00:30:44.162 14:34:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:44.162 14:34:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 562739 00:30:44.162 14:34:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:44.162 14:34:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:44.162 14:34:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 562739' 00:30:44.162 killing process with pid 562739 00:30:44.162 14:34:58 -- common/autotest_common.sh@955 -- # kill 562739 00:30:44.162 [2024-12-16 14:34:58.588321] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:30:44.162 14:34:58 -- common/autotest_common.sh@960 -- # wait 562739 00:30:46.067 14:35:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:46.067 14:35:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:46.067 14:35:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:46.067 14:35:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:46.067 14:35:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:46.067 14:35:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:46.067 14:35:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:46.067 14:35:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:47.970 14:35:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:47.970 00:30:47.970 real 0m21.401s 00:30:47.970 user 0m29.722s 00:30:47.970 sys 0m4.538s 00:30:47.970 14:35:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:47.970 14:35:02 -- common/autotest_common.sh@10 -- # set +x 00:30:47.970 ************************************ 00:30:47.970 END TEST nvmf_identify_passthru 00:30:47.970 ************************************ 00:30:47.970 14:35:02 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:30:47.970 14:35:02 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:47.970 14:35:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:47.970 14:35:02 -- common/autotest_common.sh@10 -- # set +x 00:30:47.970 ************************************ 00:30:47.970 START TEST nvmf_dif 00:30:47.970 ************************************ 00:30:47.970 14:35:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:30:47.970 * Looking for test storage... 00:30:47.970 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:30:47.970 14:35:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:47.970 14:35:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:47.970 14:35:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:47.970 14:35:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:47.970 14:35:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:47.970 14:35:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:47.970 14:35:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:47.970 14:35:02 -- scripts/common.sh@335 -- # IFS=.-: 00:30:47.970 14:35:02 -- scripts/common.sh@335 -- # read -ra ver1 00:30:47.970 14:35:02 -- scripts/common.sh@336 -- # IFS=.-: 00:30:47.970 14:35:02 -- scripts/common.sh@336 -- # read -ra ver2 00:30:47.970 14:35:02 -- scripts/common.sh@337 -- # local 'op=<' 00:30:47.970 14:35:02 -- scripts/common.sh@339 -- # ver1_l=2 00:30:47.970 14:35:02 -- scripts/common.sh@340 -- # ver2_l=1 00:30:47.970 14:35:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:47.970 14:35:02 -- scripts/common.sh@343 -- # case "$op" in 00:30:47.970 14:35:02 -- scripts/common.sh@344 -- # : 1 00:30:47.970 14:35:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:47.970 14:35:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:47.970 14:35:02 -- scripts/common.sh@364 -- # decimal 1 00:30:47.970 14:35:02 -- scripts/common.sh@352 -- # local d=1 00:30:47.970 14:35:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:47.970 14:35:02 -- scripts/common.sh@354 -- # echo 1 00:30:47.970 14:35:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:47.970 14:35:02 -- scripts/common.sh@365 -- # decimal 2 00:30:47.970 14:35:02 -- scripts/common.sh@352 -- # local d=2 00:30:47.970 14:35:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:47.970 14:35:02 -- scripts/common.sh@354 -- # echo 2 00:30:47.970 14:35:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:47.970 14:35:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:47.970 14:35:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:47.970 14:35:02 -- scripts/common.sh@367 -- # return 0 00:30:47.970 14:35:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:47.970 14:35:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:47.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:47.970 --rc genhtml_branch_coverage=1 00:30:47.970 --rc genhtml_function_coverage=1 00:30:47.970 --rc genhtml_legend=1 00:30:47.970 --rc geninfo_all_blocks=1 00:30:47.970 --rc geninfo_unexecuted_blocks=1 00:30:47.970 00:30:47.970 ' 00:30:47.970 14:35:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:47.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:47.970 --rc genhtml_branch_coverage=1 00:30:47.970 --rc genhtml_function_coverage=1 00:30:47.970 --rc genhtml_legend=1 00:30:47.970 --rc geninfo_all_blocks=1 00:30:47.970 --rc geninfo_unexecuted_blocks=1 00:30:47.970 00:30:47.970 ' 00:30:47.970 14:35:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:47.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:47.970 --rc genhtml_branch_coverage=1 00:30:47.970 --rc genhtml_function_coverage=1 00:30:47.970 --rc genhtml_legend=1 00:30:47.970 --rc geninfo_all_blocks=1 00:30:47.970 --rc geninfo_unexecuted_blocks=1 00:30:47.970 00:30:47.970 ' 00:30:47.970 14:35:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:47.970 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:47.970 --rc genhtml_branch_coverage=1 00:30:47.970 --rc genhtml_function_coverage=1 00:30:47.970 --rc genhtml_legend=1 00:30:47.970 --rc geninfo_all_blocks=1 00:30:47.970 --rc geninfo_unexecuted_blocks=1 00:30:47.970 00:30:47.970 ' 00:30:47.970 14:35:02 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:47.970 14:35:02 -- nvmf/common.sh@7 -- # uname -s 00:30:47.970 14:35:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:47.970 14:35:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:47.970 14:35:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:47.970 14:35:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:47.970 14:35:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:47.970 14:35:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:47.970 14:35:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:47.970 14:35:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:47.970 14:35:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:47.970 14:35:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:47.970 14:35:02 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:30:47.970 14:35:02 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:30:47.970 14:35:02 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:47.970 14:35:02 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:47.970 14:35:02 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:47.970 14:35:02 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:47.970 14:35:02 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:47.970 14:35:02 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:47.970 14:35:02 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:47.970 14:35:02 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:47.970 14:35:02 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:47.970 14:35:02 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:47.970 14:35:02 -- paths/export.sh@5 -- # export PATH 00:30:47.970 14:35:02 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:47.970 14:35:02 -- nvmf/common.sh@46 -- # : 0 00:30:47.970 14:35:02 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:47.970 14:35:02 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:47.970 14:35:02 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:47.970 14:35:02 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:47.970 14:35:02 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:47.970 14:35:02 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:47.970 14:35:02 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:47.970 14:35:02 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:47.970 14:35:02 -- target/dif.sh@15 -- # NULL_META=16 00:30:47.970 14:35:02 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:30:47.970 14:35:02 -- target/dif.sh@15 -- # NULL_SIZE=64 00:30:47.970 14:35:02 -- target/dif.sh@15 -- # NULL_DIF=1 00:30:47.970 14:35:02 -- target/dif.sh@135 -- # nvmftestinit 00:30:47.970 14:35:02 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:47.970 14:35:02 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:47.970 14:35:02 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:47.970 14:35:02 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:47.970 14:35:02 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:47.970 14:35:02 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:47.970 14:35:02 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:30:47.970 14:35:02 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:47.970 14:35:02 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:47.970 14:35:02 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:47.970 14:35:02 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:47.970 14:35:02 -- common/autotest_common.sh@10 -- # set +x 00:30:53.242 14:35:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:53.242 14:35:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:53.242 14:35:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:53.242 14:35:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:53.242 14:35:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:53.242 14:35:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:53.242 14:35:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:53.242 14:35:07 -- nvmf/common.sh@294 -- # net_devs=() 00:30:53.242 14:35:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:53.242 14:35:07 -- nvmf/common.sh@295 -- # e810=() 00:30:53.242 14:35:07 -- nvmf/common.sh@295 -- # local -ga e810 00:30:53.242 14:35:07 -- nvmf/common.sh@296 -- # x722=() 00:30:53.242 14:35:07 -- nvmf/common.sh@296 -- # local -ga x722 00:30:53.242 14:35:07 -- nvmf/common.sh@297 -- # mlx=() 00:30:53.242 14:35:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:53.242 14:35:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:53.242 14:35:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:53.242 14:35:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:53.242 14:35:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:53.242 14:35:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:53.242 14:35:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:30:53.242 Found 0000:af:00.0 (0x8086 - 0x159b) 00:30:53.242 14:35:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:53.242 14:35:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:30:53.242 Found 0000:af:00.1 (0x8086 - 0x159b) 00:30:53.242 14:35:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:53.242 14:35:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:53.242 14:35:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:53.242 14:35:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:53.242 14:35:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:53.242 14:35:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:53.242 14:35:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:30:53.242 Found net devices under 0000:af:00.0: cvl_0_0 00:30:53.242 14:35:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:53.242 14:35:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:53.242 14:35:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:53.242 14:35:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:53.242 14:35:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:53.242 14:35:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:30:53.242 Found net devices under 0000:af:00.1: cvl_0_1 00:30:53.242 14:35:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:53.243 14:35:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:53.243 14:35:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:53.243 14:35:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:53.243 14:35:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:53.243 14:35:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:53.243 14:35:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:53.243 14:35:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:53.243 14:35:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:53.243 14:35:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:53.243 14:35:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:53.243 14:35:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:53.243 14:35:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:53.243 14:35:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:53.243 14:35:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:53.243 14:35:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:53.243 14:35:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:53.243 14:35:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:53.243 14:35:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:53.243 14:35:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:53.243 14:35:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:53.243 14:35:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:53.243 14:35:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:53.243 14:35:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:53.243 14:35:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:53.243 14:35:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:53.243 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:53.243 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.373 ms 00:30:53.243 00:30:53.243 --- 10.0.0.2 ping statistics --- 00:30:53.243 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:53.243 rtt min/avg/max/mdev = 0.373/0.373/0.373/0.000 ms 00:30:53.243 14:35:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:53.243 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:53.243 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.191 ms 00:30:53.243 00:30:53.243 --- 10.0.0.1 ping statistics --- 00:30:53.243 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:53.243 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:30:53.243 14:35:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:53.243 14:35:07 -- nvmf/common.sh@410 -- # return 0 00:30:53.243 14:35:07 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:30:53.243 14:35:07 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:30:55.774 0000:5e:00.0 (8086 0a54): Already using the vfio-pci driver 00:30:55.774 0000:00:04.7 (8086 2021): Already using the vfio-pci driver 00:30:55.774 0000:00:04.6 (8086 2021): Already using the vfio-pci driver 00:30:55.774 0000:00:04.5 (8086 2021): Already using the vfio-pci driver 00:30:55.774 0000:00:04.4 (8086 2021): Already using the vfio-pci driver 00:30:55.774 0000:00:04.3 (8086 2021): Already using the vfio-pci driver 00:30:55.774 0000:00:04.2 (8086 2021): Already using the vfio-pci driver 00:30:55.774 0000:00:04.1 (8086 2021): Already using the vfio-pci driver 00:30:55.774 0000:00:04.0 (8086 2021): Already using the vfio-pci driver 00:30:55.775 0000:80:04.7 (8086 2021): Already using the vfio-pci driver 00:30:55.775 0000:80:04.6 (8086 2021): Already using the vfio-pci driver 00:30:55.775 0000:80:04.5 (8086 2021): Already using the vfio-pci driver 00:30:55.775 0000:80:04.4 (8086 2021): Already using the vfio-pci driver 00:30:55.775 0000:80:04.3 (8086 2021): Already using the vfio-pci driver 00:30:55.775 0000:80:04.2 (8086 2021): Already using the vfio-pci driver 00:30:55.775 0000:80:04.1 (8086 2021): Already using the vfio-pci driver 00:30:55.775 0000:80:04.0 (8086 2021): Already using the vfio-pci driver 00:30:56.034 14:35:10 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:56.034 14:35:10 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:56.034 14:35:10 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:56.034 14:35:10 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:56.034 14:35:10 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:56.034 14:35:10 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:56.034 14:35:10 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:30:56.035 14:35:10 -- target/dif.sh@137 -- # nvmfappstart 00:30:56.035 14:35:10 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:56.035 14:35:10 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:56.035 14:35:10 -- common/autotest_common.sh@10 -- # set +x 00:30:56.035 14:35:10 -- nvmf/common.sh@469 -- # nvmfpid=568312 00:30:56.035 14:35:10 -- nvmf/common.sh@470 -- # waitforlisten 568312 00:30:56.035 14:35:10 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:30:56.035 14:35:10 -- common/autotest_common.sh@829 -- # '[' -z 568312 ']' 00:30:56.035 14:35:10 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:56.035 14:35:10 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:56.035 14:35:10 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:56.035 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:56.035 14:35:10 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:56.035 14:35:10 -- common/autotest_common.sh@10 -- # set +x 00:30:56.035 [2024-12-16 14:35:10.456260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:56.035 [2024-12-16 14:35:10.456300] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:56.035 EAL: No free 2048 kB hugepages reported on node 1 00:30:56.035 [2024-12-16 14:35:10.513805] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:56.035 [2024-12-16 14:35:10.590611] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:56.035 [2024-12-16 14:35:10.590732] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:56.035 [2024-12-16 14:35:10.590739] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:56.035 [2024-12-16 14:35:10.590749] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:56.035 [2024-12-16 14:35:10.590768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:56.974 14:35:11 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:56.974 14:35:11 -- common/autotest_common.sh@862 -- # return 0 00:30:56.974 14:35:11 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:56.974 14:35:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:56.974 14:35:11 -- common/autotest_common.sh@10 -- # set +x 00:30:56.974 14:35:11 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:56.974 14:35:11 -- target/dif.sh@139 -- # create_transport 00:30:56.974 14:35:11 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:30:56.974 14:35:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.974 14:35:11 -- common/autotest_common.sh@10 -- # set +x 00:30:56.974 [2024-12-16 14:35:11.309967] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:56.974 14:35:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.974 14:35:11 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:30:56.974 14:35:11 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:56.974 14:35:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:56.974 14:35:11 -- common/autotest_common.sh@10 -- # set +x 00:30:56.974 ************************************ 00:30:56.974 START TEST fio_dif_1_default 00:30:56.974 ************************************ 00:30:56.974 14:35:11 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:30:56.974 14:35:11 -- target/dif.sh@86 -- # create_subsystems 0 00:30:56.974 14:35:11 -- target/dif.sh@28 -- # local sub 00:30:56.974 14:35:11 -- target/dif.sh@30 -- # for sub in "$@" 00:30:56.974 14:35:11 -- target/dif.sh@31 -- # create_subsystem 0 00:30:56.974 14:35:11 -- target/dif.sh@18 -- # local sub_id=0 00:30:56.974 14:35:11 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:30:56.974 14:35:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.974 14:35:11 -- common/autotest_common.sh@10 -- # set +x 00:30:56.974 bdev_null0 00:30:56.974 14:35:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.974 14:35:11 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:30:56.974 14:35:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.975 14:35:11 -- common/autotest_common.sh@10 -- # set +x 00:30:56.975 14:35:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.975 14:35:11 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:30:56.975 14:35:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.975 14:35:11 -- common/autotest_common.sh@10 -- # set +x 00:30:56.975 14:35:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.975 14:35:11 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:30:56.975 14:35:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:56.975 14:35:11 -- common/autotest_common.sh@10 -- # set +x 00:30:56.975 [2024-12-16 14:35:11.358229] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:56.975 14:35:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:56.975 14:35:11 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:30:56.975 14:35:11 -- target/dif.sh@87 -- # fio /dev/fd/62 00:30:56.975 14:35:11 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:30:56.975 14:35:11 -- nvmf/common.sh@520 -- # config=() 00:30:56.975 14:35:11 -- nvmf/common.sh@520 -- # local subsystem config 00:30:56.975 14:35:11 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:56.975 14:35:11 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:56.975 { 00:30:56.975 "params": { 00:30:56.975 "name": "Nvme$subsystem", 00:30:56.975 "trtype": "$TEST_TRANSPORT", 00:30:56.975 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:56.975 "adrfam": "ipv4", 00:30:56.975 "trsvcid": "$NVMF_PORT", 00:30:56.975 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:56.975 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:56.975 "hdgst": ${hdgst:-false}, 00:30:56.975 "ddgst": ${ddgst:-false} 00:30:56.975 }, 00:30:56.975 "method": "bdev_nvme_attach_controller" 00:30:56.975 } 00:30:56.975 EOF 00:30:56.975 )") 00:30:56.975 14:35:11 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:56.975 14:35:11 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:56.975 14:35:11 -- target/dif.sh@82 -- # gen_fio_conf 00:30:56.975 14:35:11 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:30:56.975 14:35:11 -- target/dif.sh@54 -- # local file 00:30:56.975 14:35:11 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:30:56.975 14:35:11 -- target/dif.sh@56 -- # cat 00:30:56.975 14:35:11 -- common/autotest_common.sh@1328 -- # local sanitizers 00:30:56.975 14:35:11 -- nvmf/common.sh@542 -- # cat 00:30:56.975 14:35:11 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:56.975 14:35:11 -- common/autotest_common.sh@1330 -- # shift 00:30:56.975 14:35:11 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:30:56.975 14:35:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:30:56.975 14:35:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:56.975 14:35:11 -- common/autotest_common.sh@1334 -- # grep libasan 00:30:56.975 14:35:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:30:56.975 14:35:11 -- target/dif.sh@72 -- # (( file = 1 )) 00:30:56.975 14:35:11 -- target/dif.sh@72 -- # (( file <= files )) 00:30:56.975 14:35:11 -- nvmf/common.sh@544 -- # jq . 00:30:56.975 14:35:11 -- nvmf/common.sh@545 -- # IFS=, 00:30:56.975 14:35:11 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:56.975 "params": { 00:30:56.975 "name": "Nvme0", 00:30:56.975 "trtype": "tcp", 00:30:56.975 "traddr": "10.0.0.2", 00:30:56.975 "adrfam": "ipv4", 00:30:56.975 "trsvcid": "4420", 00:30:56.975 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:30:56.975 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:30:56.975 "hdgst": false, 00:30:56.975 "ddgst": false 00:30:56.975 }, 00:30:56.975 "method": "bdev_nvme_attach_controller" 00:30:56.975 }' 00:30:56.975 14:35:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:30:56.975 14:35:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:30:56.975 14:35:11 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:30:56.975 14:35:11 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:30:56.975 14:35:11 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:30:56.975 14:35:11 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:30:56.975 14:35:11 -- common/autotest_common.sh@1334 -- # asan_lib= 00:30:56.975 14:35:11 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:30:56.975 14:35:11 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:30:56.975 14:35:11 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:30:57.234 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:30:57.234 fio-3.35 00:30:57.234 Starting 1 thread 00:30:57.234 EAL: No free 2048 kB hugepages reported on node 1 00:30:57.800 [2024-12-16 14:35:12.245477] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:30:57.800 [2024-12-16 14:35:12.245518] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:10.110 00:31:10.110 filename0: (groupid=0, jobs=1): err= 0: pid=568750: Mon Dec 16 14:35:22 2024 00:31:10.110 read: IOPS=95, BW=384KiB/s (393kB/s)(3840KiB/10003msec) 00:31:10.110 slat (nsec): min=5837, max=27805, avg=6221.96, stdev=1277.41 00:31:10.110 clat (usec): min=40868, max=46930, avg=41661.50, stdev=581.87 00:31:10.110 lat (usec): min=40874, max=46956, avg=41667.72, stdev=582.16 00:31:10.110 clat percentiles (usec): 00:31:10.110 | 1.00th=[41157], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:10.110 | 30.00th=[41157], 40.00th=[42206], 50.00th=[42206], 60.00th=[42206], 00:31:10.110 | 70.00th=[42206], 80.00th=[42206], 90.00th=[42206], 95.00th=[42206], 00:31:10.110 | 99.00th=[42206], 99.50th=[42206], 99.90th=[46924], 99.95th=[46924], 00:31:10.110 | 99.99th=[46924] 00:31:10.111 bw ( KiB/s): min= 352, max= 416, per=99.77%, avg=383.95, stdev=10.67, samples=19 00:31:10.111 iops : min= 88, max= 104, avg=95.95, stdev= 2.68, samples=19 00:31:10.111 lat (msec) : 50=100.00% 00:31:10.111 cpu : usr=92.57%, sys=7.13%, ctx=15, majf=0, minf=264 00:31:10.111 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:10.111 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:10.111 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:10.111 issued rwts: total=960,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:10.111 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:10.111 00:31:10.111 Run status group 0 (all jobs): 00:31:10.111 READ: bw=384KiB/s (393kB/s), 384KiB/s-384KiB/s (393kB/s-393kB/s), io=3840KiB (3932kB), run=10003-10003msec 00:31:10.111 14:35:22 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:10.111 14:35:22 -- target/dif.sh@43 -- # local sub 00:31:10.111 14:35:22 -- target/dif.sh@45 -- # for sub in "$@" 00:31:10.111 14:35:22 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:10.111 14:35:22 -- target/dif.sh@36 -- # local sub_id=0 00:31:10.111 14:35:22 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 00:31:10.111 real 0m11.248s 00:31:10.111 user 0m16.193s 00:31:10.111 sys 0m1.017s 00:31:10.111 14:35:22 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 ************************************ 00:31:10.111 END TEST fio_dif_1_default 00:31:10.111 ************************************ 00:31:10.111 14:35:22 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:10.111 14:35:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:10.111 14:35:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 ************************************ 00:31:10.111 START TEST fio_dif_1_multi_subsystems 00:31:10.111 ************************************ 00:31:10.111 14:35:22 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:10.111 14:35:22 -- target/dif.sh@92 -- # local files=1 00:31:10.111 14:35:22 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:10.111 14:35:22 -- target/dif.sh@28 -- # local sub 00:31:10.111 14:35:22 -- target/dif.sh@30 -- # for sub in "$@" 00:31:10.111 14:35:22 -- target/dif.sh@31 -- # create_subsystem 0 00:31:10.111 14:35:22 -- target/dif.sh@18 -- # local sub_id=0 00:31:10.111 14:35:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 bdev_null0 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 [2024-12-16 14:35:22.648744] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@30 -- # for sub in "$@" 00:31:10.111 14:35:22 -- target/dif.sh@31 -- # create_subsystem 1 00:31:10.111 14:35:22 -- target/dif.sh@18 -- # local sub_id=1 00:31:10.111 14:35:22 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 bdev_null1 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:10.111 14:35:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:10.111 14:35:22 -- common/autotest_common.sh@10 -- # set +x 00:31:10.111 14:35:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:10.111 14:35:22 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:10.111 14:35:22 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:10.111 14:35:22 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:10.111 14:35:22 -- nvmf/common.sh@520 -- # config=() 00:31:10.111 14:35:22 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:10.111 14:35:22 -- nvmf/common.sh@520 -- # local subsystem config 00:31:10.111 14:35:22 -- target/dif.sh@82 -- # gen_fio_conf 00:31:10.111 14:35:22 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:10.111 14:35:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:10.111 14:35:22 -- target/dif.sh@54 -- # local file 00:31:10.111 14:35:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:10.111 { 00:31:10.111 "params": { 00:31:10.111 "name": "Nvme$subsystem", 00:31:10.111 "trtype": "$TEST_TRANSPORT", 00:31:10.111 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:10.111 "adrfam": "ipv4", 00:31:10.111 "trsvcid": "$NVMF_PORT", 00:31:10.111 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:10.111 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:10.111 "hdgst": ${hdgst:-false}, 00:31:10.111 "ddgst": ${ddgst:-false} 00:31:10.111 }, 00:31:10.111 "method": "bdev_nvme_attach_controller" 00:31:10.111 } 00:31:10.111 EOF 00:31:10.111 )") 00:31:10.111 14:35:22 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:10.111 14:35:22 -- target/dif.sh@56 -- # cat 00:31:10.111 14:35:22 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:10.111 14:35:22 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:10.111 14:35:22 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:10.111 14:35:22 -- common/autotest_common.sh@1330 -- # shift 00:31:10.111 14:35:22 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:10.111 14:35:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:10.111 14:35:22 -- nvmf/common.sh@542 -- # cat 00:31:10.111 14:35:22 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:10.111 14:35:22 -- target/dif.sh@72 -- # (( file <= files )) 00:31:10.111 14:35:22 -- target/dif.sh@73 -- # cat 00:31:10.111 14:35:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:10.111 14:35:22 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:10.111 14:35:22 -- target/dif.sh@72 -- # (( file++ )) 00:31:10.111 14:35:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:10.111 14:35:22 -- target/dif.sh@72 -- # (( file <= files )) 00:31:10.111 14:35:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:10.111 14:35:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:10.111 { 00:31:10.111 "params": { 00:31:10.111 "name": "Nvme$subsystem", 00:31:10.111 "trtype": "$TEST_TRANSPORT", 00:31:10.111 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:10.111 "adrfam": "ipv4", 00:31:10.111 "trsvcid": "$NVMF_PORT", 00:31:10.111 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:10.111 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:10.111 "hdgst": ${hdgst:-false}, 00:31:10.111 "ddgst": ${ddgst:-false} 00:31:10.111 }, 00:31:10.111 "method": "bdev_nvme_attach_controller" 00:31:10.111 } 00:31:10.111 EOF 00:31:10.111 )") 00:31:10.111 14:35:22 -- nvmf/common.sh@542 -- # cat 00:31:10.111 14:35:22 -- nvmf/common.sh@544 -- # jq . 00:31:10.111 14:35:22 -- nvmf/common.sh@545 -- # IFS=, 00:31:10.111 14:35:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:10.111 "params": { 00:31:10.111 "name": "Nvme0", 00:31:10.111 "trtype": "tcp", 00:31:10.111 "traddr": "10.0.0.2", 00:31:10.111 "adrfam": "ipv4", 00:31:10.111 "trsvcid": "4420", 00:31:10.111 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:10.111 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:10.111 "hdgst": false, 00:31:10.111 "ddgst": false 00:31:10.111 }, 00:31:10.111 "method": "bdev_nvme_attach_controller" 00:31:10.111 },{ 00:31:10.111 "params": { 00:31:10.111 "name": "Nvme1", 00:31:10.111 "trtype": "tcp", 00:31:10.111 "traddr": "10.0.0.2", 00:31:10.111 "adrfam": "ipv4", 00:31:10.111 "trsvcid": "4420", 00:31:10.111 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:10.111 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:10.111 "hdgst": false, 00:31:10.111 "ddgst": false 00:31:10.111 }, 00:31:10.111 "method": "bdev_nvme_attach_controller" 00:31:10.111 }' 00:31:10.111 14:35:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:10.111 14:35:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:10.111 14:35:22 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:10.112 14:35:22 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:10.112 14:35:22 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:10.112 14:35:22 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:10.112 14:35:22 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:10.112 14:35:22 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:10.112 14:35:22 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:10.112 14:35:22 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:10.112 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:10.112 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:10.112 fio-3.35 00:31:10.112 Starting 2 threads 00:31:10.112 EAL: No free 2048 kB hugepages reported on node 1 00:31:10.112 [2024-12-16 14:35:23.555799] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:10.112 [2024-12-16 14:35:23.555837] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:20.093 00:31:20.093 filename0: (groupid=0, jobs=1): err= 0: pid=570700: Mon Dec 16 14:35:33 2024 00:31:20.093 read: IOPS=186, BW=747KiB/s (765kB/s)(7472KiB/10002msec) 00:31:20.093 slat (nsec): min=5901, max=34059, avg=7768.69, stdev=2657.99 00:31:20.093 clat (usec): min=347, max=42579, avg=21394.74, stdev=20440.71 00:31:20.093 lat (usec): min=353, max=42585, avg=21402.50, stdev=20440.21 00:31:20.093 clat percentiles (usec): 00:31:20.093 | 1.00th=[ 388], 5.00th=[ 429], 10.00th=[ 529], 20.00th=[ 562], 00:31:20.093 | 30.00th=[ 586], 40.00th=[ 619], 50.00th=[40633], 60.00th=[41157], 00:31:20.093 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:31:20.093 | 99.00th=[42206], 99.50th=[42730], 99.90th=[42730], 99.95th=[42730], 00:31:20.093 | 99.99th=[42730] 00:31:20.093 bw ( KiB/s): min= 576, max= 768, per=49.62%, avg=747.79, stdev=47.95, samples=19 00:31:20.093 iops : min= 144, max= 192, avg=186.95, stdev=11.99, samples=19 00:31:20.093 lat (usec) : 500=8.57%, 750=39.40%, 1000=1.07% 00:31:20.093 lat (msec) : 50=50.96% 00:31:20.093 cpu : usr=97.40%, sys=2.32%, ctx=12, majf=0, minf=219 00:31:20.093 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:20.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:20.093 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:20.093 issued rwts: total=1868,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:20.093 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:20.093 filename1: (groupid=0, jobs=1): err= 0: pid=570701: Mon Dec 16 14:35:33 2024 00:31:20.093 read: IOPS=189, BW=758KiB/s (776kB/s)(7584KiB/10002msec) 00:31:20.093 slat (nsec): min=5917, max=26992, avg=7869.71, stdev=2733.76 00:31:20.093 clat (usec): min=388, max=42481, avg=21078.06, stdev=20406.52 00:31:20.093 lat (usec): min=394, max=42493, avg=21085.93, stdev=20406.01 00:31:20.093 clat percentiles (usec): 00:31:20.093 | 1.00th=[ 400], 5.00th=[ 416], 10.00th=[ 529], 20.00th=[ 586], 00:31:20.093 | 30.00th=[ 611], 40.00th=[ 652], 50.00th=[40633], 60.00th=[41157], 00:31:20.093 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[41681], 00:31:20.093 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730], 00:31:20.093 | 99.99th=[42730] 00:31:20.093 bw ( KiB/s): min= 672, max= 768, per=50.42%, avg=759.58, stdev=25.78, samples=19 00:31:20.093 iops : min= 168, max= 192, avg=189.89, stdev= 6.45, samples=19 00:31:20.093 lat (usec) : 500=9.70%, 750=36.34%, 1000=3.74% 00:31:20.093 lat (msec) : 50=50.21% 00:31:20.093 cpu : usr=97.15%, sys=2.58%, ctx=10, majf=0, minf=103 00:31:20.093 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:20.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:20.093 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:20.093 issued rwts: total=1896,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:20.093 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:20.093 00:31:20.093 Run status group 0 (all jobs): 00:31:20.093 READ: bw=1505KiB/s (1541kB/s), 747KiB/s-758KiB/s (765kB/s-776kB/s), io=14.7MiB (15.4MB), run=10002-10002msec 00:31:20.093 14:35:33 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:20.093 14:35:33 -- target/dif.sh@43 -- # local sub 00:31:20.093 14:35:33 -- target/dif.sh@45 -- # for sub in "$@" 00:31:20.093 14:35:33 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:20.093 14:35:33 -- target/dif.sh@36 -- # local sub_id=0 00:31:20.093 14:35:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:20.093 14:35:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.093 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.093 14:35:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.093 14:35:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:20.093 14:35:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.093 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.093 14:35:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.093 14:35:33 -- target/dif.sh@45 -- # for sub in "$@" 00:31:20.094 14:35:33 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:20.094 14:35:33 -- target/dif.sh@36 -- # local sub_id=1 00:31:20.094 14:35:33 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:20.094 14:35:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.094 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.094 14:35:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.094 14:35:33 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:20.094 14:35:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.094 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.094 14:35:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.094 00:31:20.094 real 0m11.313s 00:31:20.094 user 0m26.356s 00:31:20.094 sys 0m0.861s 00:31:20.094 14:35:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:20.094 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.094 ************************************ 00:31:20.094 END TEST fio_dif_1_multi_subsystems 00:31:20.094 ************************************ 00:31:20.094 14:35:33 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:20.094 14:35:33 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:20.094 14:35:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:20.094 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.094 ************************************ 00:31:20.094 START TEST fio_dif_rand_params 00:31:20.094 ************************************ 00:31:20.094 14:35:33 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:20.094 14:35:33 -- target/dif.sh@100 -- # local NULL_DIF 00:31:20.094 14:35:33 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:20.094 14:35:33 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:20.094 14:35:33 -- target/dif.sh@103 -- # bs=128k 00:31:20.094 14:35:33 -- target/dif.sh@103 -- # numjobs=3 00:31:20.094 14:35:33 -- target/dif.sh@103 -- # iodepth=3 00:31:20.094 14:35:33 -- target/dif.sh@103 -- # runtime=5 00:31:20.094 14:35:33 -- target/dif.sh@105 -- # create_subsystems 0 00:31:20.094 14:35:33 -- target/dif.sh@28 -- # local sub 00:31:20.094 14:35:33 -- target/dif.sh@30 -- # for sub in "$@" 00:31:20.094 14:35:33 -- target/dif.sh@31 -- # create_subsystem 0 00:31:20.094 14:35:33 -- target/dif.sh@18 -- # local sub_id=0 00:31:20.094 14:35:33 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:20.094 14:35:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.094 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.094 bdev_null0 00:31:20.094 14:35:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.094 14:35:33 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:20.094 14:35:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.094 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.094 14:35:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.094 14:35:33 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:20.094 14:35:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.094 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.094 14:35:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.094 14:35:33 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:20.094 14:35:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:20.094 14:35:33 -- common/autotest_common.sh@10 -- # set +x 00:31:20.094 [2024-12-16 14:35:34.001331] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:20.094 14:35:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:20.094 14:35:34 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:20.094 14:35:34 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:20.094 14:35:34 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:20.094 14:35:34 -- nvmf/common.sh@520 -- # config=() 00:31:20.094 14:35:34 -- nvmf/common.sh@520 -- # local subsystem config 00:31:20.094 14:35:34 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:20.094 14:35:34 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:20.094 { 00:31:20.094 "params": { 00:31:20.094 "name": "Nvme$subsystem", 00:31:20.094 "trtype": "$TEST_TRANSPORT", 00:31:20.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:20.094 "adrfam": "ipv4", 00:31:20.094 "trsvcid": "$NVMF_PORT", 00:31:20.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:20.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:20.094 "hdgst": ${hdgst:-false}, 00:31:20.094 "ddgst": ${ddgst:-false} 00:31:20.094 }, 00:31:20.094 "method": "bdev_nvme_attach_controller" 00:31:20.094 } 00:31:20.094 EOF 00:31:20.094 )") 00:31:20.094 14:35:34 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:20.094 14:35:34 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:20.094 14:35:34 -- nvmf/common.sh@542 -- # cat 00:31:20.094 14:35:34 -- target/dif.sh@82 -- # gen_fio_conf 00:31:20.094 14:35:34 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:20.094 14:35:34 -- target/dif.sh@54 -- # local file 00:31:20.094 14:35:34 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:20.094 14:35:34 -- target/dif.sh@56 -- # cat 00:31:20.094 14:35:34 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:20.094 14:35:34 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:20.094 14:35:34 -- common/autotest_common.sh@1330 -- # shift 00:31:20.094 14:35:34 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:20.094 14:35:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:20.094 14:35:34 -- nvmf/common.sh@544 -- # jq . 00:31:20.094 14:35:34 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:20.094 14:35:34 -- target/dif.sh@72 -- # (( file <= files )) 00:31:20.094 14:35:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:20.094 14:35:34 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:20.094 14:35:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:20.094 14:35:34 -- nvmf/common.sh@545 -- # IFS=, 00:31:20.094 14:35:34 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:20.094 "params": { 00:31:20.094 "name": "Nvme0", 00:31:20.094 "trtype": "tcp", 00:31:20.094 "traddr": "10.0.0.2", 00:31:20.094 "adrfam": "ipv4", 00:31:20.094 "trsvcid": "4420", 00:31:20.094 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:20.094 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:20.094 "hdgst": false, 00:31:20.094 "ddgst": false 00:31:20.094 }, 00:31:20.094 "method": "bdev_nvme_attach_controller" 00:31:20.094 }' 00:31:20.094 14:35:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:20.094 14:35:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:20.094 14:35:34 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:20.094 14:35:34 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:20.094 14:35:34 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:20.094 14:35:34 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:20.094 14:35:34 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:20.094 14:35:34 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:20.094 14:35:34 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:20.094 14:35:34 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:20.094 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:20.094 ... 00:31:20.094 fio-3.35 00:31:20.094 Starting 3 threads 00:31:20.094 EAL: No free 2048 kB hugepages reported on node 1 00:31:20.353 [2024-12-16 14:35:34.858936] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:20.353 [2024-12-16 14:35:34.858981] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:25.626 00:31:25.626 filename0: (groupid=0, jobs=1): err= 0: pid=572648: Mon Dec 16 14:35:40 2024 00:31:25.626 read: IOPS=286, BW=35.8MiB/s (37.5MB/s)(180MiB/5044msec) 00:31:25.626 slat (nsec): min=6028, max=30300, avg=10447.14, stdev=2672.87 00:31:25.626 clat (usec): min=3847, max=93015, avg=10443.08, stdev=10591.69 00:31:25.626 lat (usec): min=3854, max=93027, avg=10453.53, stdev=10591.74 00:31:25.626 clat percentiles (usec): 00:31:25.626 | 1.00th=[ 4178], 5.00th=[ 5014], 10.00th=[ 5604], 20.00th=[ 6390], 00:31:25.626 | 30.00th=[ 7046], 40.00th=[ 7439], 50.00th=[ 7767], 60.00th=[ 8160], 00:31:25.626 | 70.00th=[ 8717], 80.00th=[ 9372], 90.00th=[10421], 95.00th=[47449], 00:31:25.626 | 99.00th=[50594], 99.50th=[51119], 99.90th=[53216], 99.95th=[92799], 00:31:25.626 | 99.99th=[92799] 00:31:25.626 bw ( KiB/s): min=28160, max=44544, per=31.70%, avg=36889.60, stdev=5165.94, samples=10 00:31:25.626 iops : min= 220, max= 348, avg=288.20, stdev=40.36, samples=10 00:31:25.626 lat (msec) : 4=0.35%, 10=86.42%, 20=6.51%, 50=4.64%, 100=2.08% 00:31:25.627 cpu : usr=95.64%, sys=4.03%, ctx=12, majf=0, minf=92 00:31:25.627 IO depths : 1=0.8%, 2=99.2%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:25.627 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.627 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.627 issued rwts: total=1443,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:25.627 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:25.627 filename0: (groupid=0, jobs=1): err= 0: pid=572649: Mon Dec 16 14:35:40 2024 00:31:25.627 read: IOPS=285, BW=35.7MiB/s (37.5MB/s)(180MiB/5045msec) 00:31:25.627 slat (nsec): min=6255, max=56737, avg=11178.38, stdev=2921.03 00:31:25.627 clat (usec): min=3022, max=56541, avg=10451.25, stdev=9368.12 00:31:25.627 lat (usec): min=3031, max=56554, avg=10462.43, stdev=9367.96 00:31:25.627 clat percentiles (usec): 00:31:25.627 | 1.00th=[ 3392], 5.00th=[ 4752], 10.00th=[ 5669], 20.00th=[ 6521], 00:31:25.627 | 30.00th=[ 7242], 40.00th=[ 7832], 50.00th=[ 8586], 60.00th=[ 9241], 00:31:25.627 | 70.00th=[ 9765], 80.00th=[10421], 90.00th=[11600], 95.00th=[44827], 00:31:25.627 | 99.00th=[50070], 99.50th=[51643], 99.90th=[56361], 99.95th=[56361], 00:31:25.627 | 99.99th=[56361] 00:31:25.627 bw ( KiB/s): min=17664, max=46848, per=31.68%, avg=36864.00, stdev=9151.78, samples=10 00:31:25.627 iops : min= 138, max= 366, avg=288.00, stdev=71.50, samples=10 00:31:25.627 lat (msec) : 4=3.33%, 10=70.39%, 20=20.94%, 50=4.30%, 100=1.04% 00:31:25.627 cpu : usr=95.78%, sys=3.87%, ctx=17, majf=0, minf=176 00:31:25.627 IO depths : 1=0.2%, 2=99.8%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:25.627 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.627 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.627 issued rwts: total=1442,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:25.627 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:25.627 filename0: (groupid=0, jobs=1): err= 0: pid=572650: Mon Dec 16 14:35:40 2024 00:31:25.627 read: IOPS=340, BW=42.5MiB/s (44.6MB/s)(213MiB/5003msec) 00:31:25.627 slat (nsec): min=6079, max=28957, avg=10976.46, stdev=2804.63 00:31:25.627 clat (usec): min=3329, max=50792, avg=8803.66, stdev=6753.15 00:31:25.627 lat (usec): min=3336, max=50804, avg=8814.64, stdev=6753.21 00:31:25.627 clat percentiles (usec): 00:31:25.627 | 1.00th=[ 3621], 5.00th=[ 4113], 10.00th=[ 5080], 20.00th=[ 5800], 00:31:25.627 | 30.00th=[ 6456], 40.00th=[ 7242], 50.00th=[ 7898], 60.00th=[ 8586], 00:31:25.627 | 70.00th=[ 8979], 80.00th=[ 9765], 90.00th=[10814], 95.00th=[11994], 00:31:25.627 | 99.00th=[48497], 99.50th=[49546], 99.90th=[50594], 99.95th=[50594], 00:31:25.627 | 99.99th=[50594] 00:31:25.627 bw ( KiB/s): min=35584, max=55552, per=37.39%, avg=43520.00, stdev=5861.35, samples=10 00:31:25.627 iops : min= 278, max= 434, avg=340.00, stdev=45.79, samples=10 00:31:25.627 lat (msec) : 4=4.11%, 10=78.26%, 20=14.98%, 50=2.35%, 100=0.29% 00:31:25.627 cpu : usr=94.48%, sys=5.18%, ctx=12, majf=0, minf=107 00:31:25.627 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:25.627 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.627 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:25.627 issued rwts: total=1702,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:25.627 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:25.627 00:31:25.627 Run status group 0 (all jobs): 00:31:25.627 READ: bw=114MiB/s (119MB/s), 35.7MiB/s-42.5MiB/s (37.5MB/s-44.6MB/s), io=573MiB (601MB), run=5003-5045msec 00:31:26.000 14:35:40 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:26.000 14:35:40 -- target/dif.sh@43 -- # local sub 00:31:26.000 14:35:40 -- target/dif.sh@45 -- # for sub in "$@" 00:31:26.000 14:35:40 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:26.000 14:35:40 -- target/dif.sh@36 -- # local sub_id=0 00:31:26.000 14:35:40 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:26.000 14:35:40 -- target/dif.sh@109 -- # bs=4k 00:31:26.000 14:35:40 -- target/dif.sh@109 -- # numjobs=8 00:31:26.000 14:35:40 -- target/dif.sh@109 -- # iodepth=16 00:31:26.000 14:35:40 -- target/dif.sh@109 -- # runtime= 00:31:26.000 14:35:40 -- target/dif.sh@109 -- # files=2 00:31:26.000 14:35:40 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:26.000 14:35:40 -- target/dif.sh@28 -- # local sub 00:31:26.000 14:35:40 -- target/dif.sh@30 -- # for sub in "$@" 00:31:26.000 14:35:40 -- target/dif.sh@31 -- # create_subsystem 0 00:31:26.000 14:35:40 -- target/dif.sh@18 -- # local sub_id=0 00:31:26.000 14:35:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 bdev_null0 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 [2024-12-16 14:35:40.261800] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@30 -- # for sub in "$@" 00:31:26.000 14:35:40 -- target/dif.sh@31 -- # create_subsystem 1 00:31:26.000 14:35:40 -- target/dif.sh@18 -- # local sub_id=1 00:31:26.000 14:35:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 bdev_null1 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@30 -- # for sub in "$@" 00:31:26.000 14:35:40 -- target/dif.sh@31 -- # create_subsystem 2 00:31:26.000 14:35:40 -- target/dif.sh@18 -- # local sub_id=2 00:31:26.000 14:35:40 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 bdev_null2 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:26.000 14:35:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:26.000 14:35:40 -- common/autotest_common.sh@10 -- # set +x 00:31:26.000 14:35:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:26.000 14:35:40 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:26.000 14:35:40 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:26.000 14:35:40 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:26.000 14:35:40 -- nvmf/common.sh@520 -- # config=() 00:31:26.000 14:35:40 -- target/dif.sh@82 -- # gen_fio_conf 00:31:26.000 14:35:40 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.000 14:35:40 -- target/dif.sh@54 -- # local file 00:31:26.000 14:35:40 -- nvmf/common.sh@520 -- # local subsystem config 00:31:26.000 14:35:40 -- target/dif.sh@56 -- # cat 00:31:26.000 14:35:40 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.000 14:35:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:26.000 14:35:40 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:26.000 14:35:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:26.000 { 00:31:26.000 "params": { 00:31:26.000 "name": "Nvme$subsystem", 00:31:26.000 "trtype": "$TEST_TRANSPORT", 00:31:26.000 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:26.000 "adrfam": "ipv4", 00:31:26.000 "trsvcid": "$NVMF_PORT", 00:31:26.000 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:26.000 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:26.000 "hdgst": ${hdgst:-false}, 00:31:26.000 "ddgst": ${ddgst:-false} 00:31:26.000 }, 00:31:26.000 "method": "bdev_nvme_attach_controller" 00:31:26.000 } 00:31:26.000 EOF 00:31:26.000 )") 00:31:26.001 14:35:40 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:26.001 14:35:40 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:26.001 14:35:40 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.001 14:35:40 -- common/autotest_common.sh@1330 -- # shift 00:31:26.001 14:35:40 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:26.001 14:35:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:26.001 14:35:40 -- nvmf/common.sh@542 -- # cat 00:31:26.001 14:35:40 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:26.001 14:35:40 -- target/dif.sh@72 -- # (( file <= files )) 00:31:26.001 14:35:40 -- target/dif.sh@73 -- # cat 00:31:26.001 14:35:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.001 14:35:40 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:26.001 14:35:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:26.001 14:35:40 -- target/dif.sh@72 -- # (( file++ )) 00:31:26.001 14:35:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:26.001 14:35:40 -- target/dif.sh@72 -- # (( file <= files )) 00:31:26.001 14:35:40 -- target/dif.sh@73 -- # cat 00:31:26.001 14:35:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:26.001 { 00:31:26.001 "params": { 00:31:26.001 "name": "Nvme$subsystem", 00:31:26.001 "trtype": "$TEST_TRANSPORT", 00:31:26.001 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:26.001 "adrfam": "ipv4", 00:31:26.001 "trsvcid": "$NVMF_PORT", 00:31:26.001 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:26.001 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:26.001 "hdgst": ${hdgst:-false}, 00:31:26.001 "ddgst": ${ddgst:-false} 00:31:26.001 }, 00:31:26.001 "method": "bdev_nvme_attach_controller" 00:31:26.001 } 00:31:26.001 EOF 00:31:26.001 )") 00:31:26.001 14:35:40 -- nvmf/common.sh@542 -- # cat 00:31:26.001 14:35:40 -- target/dif.sh@72 -- # (( file++ )) 00:31:26.001 14:35:40 -- target/dif.sh@72 -- # (( file <= files )) 00:31:26.001 14:35:40 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:26.001 14:35:40 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:26.001 { 00:31:26.001 "params": { 00:31:26.001 "name": "Nvme$subsystem", 00:31:26.001 "trtype": "$TEST_TRANSPORT", 00:31:26.001 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:26.001 "adrfam": "ipv4", 00:31:26.001 "trsvcid": "$NVMF_PORT", 00:31:26.001 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:26.001 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:26.001 "hdgst": ${hdgst:-false}, 00:31:26.001 "ddgst": ${ddgst:-false} 00:31:26.001 }, 00:31:26.001 "method": "bdev_nvme_attach_controller" 00:31:26.001 } 00:31:26.001 EOF 00:31:26.001 )") 00:31:26.001 14:35:40 -- nvmf/common.sh@542 -- # cat 00:31:26.001 14:35:40 -- nvmf/common.sh@544 -- # jq . 00:31:26.001 14:35:40 -- nvmf/common.sh@545 -- # IFS=, 00:31:26.001 14:35:40 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:26.001 "params": { 00:31:26.001 "name": "Nvme0", 00:31:26.001 "trtype": "tcp", 00:31:26.001 "traddr": "10.0.0.2", 00:31:26.001 "adrfam": "ipv4", 00:31:26.001 "trsvcid": "4420", 00:31:26.001 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:26.001 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:26.001 "hdgst": false, 00:31:26.001 "ddgst": false 00:31:26.001 }, 00:31:26.001 "method": "bdev_nvme_attach_controller" 00:31:26.001 },{ 00:31:26.001 "params": { 00:31:26.001 "name": "Nvme1", 00:31:26.001 "trtype": "tcp", 00:31:26.001 "traddr": "10.0.0.2", 00:31:26.001 "adrfam": "ipv4", 00:31:26.001 "trsvcid": "4420", 00:31:26.001 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:26.001 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:26.001 "hdgst": false, 00:31:26.001 "ddgst": false 00:31:26.001 }, 00:31:26.001 "method": "bdev_nvme_attach_controller" 00:31:26.001 },{ 00:31:26.001 "params": { 00:31:26.001 "name": "Nvme2", 00:31:26.001 "trtype": "tcp", 00:31:26.001 "traddr": "10.0.0.2", 00:31:26.001 "adrfam": "ipv4", 00:31:26.001 "trsvcid": "4420", 00:31:26.001 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:26.001 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:26.001 "hdgst": false, 00:31:26.001 "ddgst": false 00:31:26.001 }, 00:31:26.001 "method": "bdev_nvme_attach_controller" 00:31:26.001 }' 00:31:26.001 14:35:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:26.001 14:35:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:26.001 14:35:40 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:26.001 14:35:40 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:26.001 14:35:40 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:26.001 14:35:40 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:26.001 14:35:40 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:26.001 14:35:40 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:26.001 14:35:40 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:26.001 14:35:40 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:26.261 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:26.261 ... 00:31:26.261 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:26.261 ... 00:31:26.261 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:26.261 ... 00:31:26.261 fio-3.35 00:31:26.261 Starting 24 threads 00:31:26.261 EAL: No free 2048 kB hugepages reported on node 1 00:31:27.198 [2024-12-16 14:35:41.429269] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:27.198 [2024-12-16 14:35:41.429315] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:37.168 00:31:37.168 filename0: (groupid=0, jobs=1): err= 0: pid=573896: Mon Dec 16 14:35:51 2024 00:31:37.168 read: IOPS=578, BW=2316KiB/s (2371kB/s)(22.6MiB/10005msec) 00:31:37.168 slat (nsec): min=4437, max=86352, avg=17406.23, stdev=12834.57 00:31:37.168 clat (usec): min=2070, max=32263, avg=27481.36, stdev=2024.14 00:31:37.168 lat (usec): min=2112, max=32281, avg=27498.76, stdev=2025.45 00:31:37.169 clat percentiles (usec): 00:31:37.169 | 1.00th=[21627], 5.00th=[26346], 10.00th=[26346], 20.00th=[26608], 00:31:37.169 | 30.00th=[27132], 40.00th=[27395], 50.00th=[27919], 60.00th=[28181], 00:31:37.169 | 70.00th=[28181], 80.00th=[28443], 90.00th=[28443], 95.00th=[28705], 00:31:37.169 | 99.00th=[29230], 99.50th=[30016], 99.90th=[31851], 99.95th=[32113], 00:31:37.169 | 99.99th=[32375] 00:31:37.169 bw ( KiB/s): min= 2176, max= 2432, per=4.18%, avg=2310.74, stdev=90.24, samples=19 00:31:37.169 iops : min= 544, max= 608, avg=577.68, stdev=22.56, samples=19 00:31:37.169 lat (msec) : 4=0.28%, 10=0.28%, 20=0.40%, 50=99.05% 00:31:37.169 cpu : usr=98.05%, sys=1.22%, ctx=121, majf=0, minf=37 00:31:37.169 IO depths : 1=5.7%, 2=11.8%, 4=24.7%, 8=50.9%, 16=6.8%, 32=0.0%, >=64=0.0% 00:31:37.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 issued rwts: total=5792,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.169 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.169 filename0: (groupid=0, jobs=1): err= 0: pid=573897: Mon Dec 16 14:35:51 2024 00:31:37.169 read: IOPS=575, BW=2301KiB/s (2356kB/s)(22.5MiB/10015msec) 00:31:37.169 slat (usec): min=5, max=138, avg=44.80, stdev=22.54 00:31:37.169 clat (usec): min=18773, max=38875, avg=27450.31, stdev=1142.46 00:31:37.169 lat (usec): min=18800, max=38890, avg=27495.11, stdev=1145.69 00:31:37.169 clat percentiles (usec): 00:31:37.169 | 1.00th=[25297], 5.00th=[26084], 10.00th=[26346], 20.00th=[26608], 00:31:37.169 | 30.00th=[26870], 40.00th=[27132], 50.00th=[27657], 60.00th=[27919], 00:31:37.169 | 70.00th=[28181], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.169 | 99.00th=[28967], 99.50th=[29230], 99.90th=[39060], 99.95th=[39060], 00:31:37.169 | 99.99th=[39060] 00:31:37.169 bw ( KiB/s): min= 2176, max= 2432, per=4.15%, avg=2290.74, stdev=83.91, samples=19 00:31:37.169 iops : min= 544, max= 608, avg=572.68, stdev=20.98, samples=19 00:31:37.169 lat (msec) : 20=0.28%, 50=99.72% 00:31:37.169 cpu : usr=98.60%, sys=0.90%, ctx=70, majf=0, minf=27 00:31:37.169 IO depths : 1=5.6%, 2=11.8%, 4=24.9%, 8=50.9%, 16=6.9%, 32=0.0%, >=64=0.0% 00:31:37.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 issued rwts: total=5760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.169 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.169 filename0: (groupid=0, jobs=1): err= 0: pid=573898: Mon Dec 16 14:35:51 2024 00:31:37.169 read: IOPS=573, BW=2296KiB/s (2351kB/s)(22.4MiB/10007msec) 00:31:37.169 slat (nsec): min=7337, max=82428, avg=24121.75, stdev=13979.40 00:31:37.169 clat (usec): min=24236, max=45696, avg=27678.55, stdev=1300.90 00:31:37.169 lat (usec): min=24249, max=45730, avg=27702.67, stdev=1300.56 00:31:37.169 clat percentiles (usec): 00:31:37.169 | 1.00th=[25822], 5.00th=[26084], 10.00th=[26346], 20.00th=[26608], 00:31:37.169 | 30.00th=[27132], 40.00th=[27395], 50.00th=[27919], 60.00th=[28181], 00:31:37.169 | 70.00th=[28181], 80.00th=[28443], 90.00th=[28443], 95.00th=[28705], 00:31:37.169 | 99.00th=[29492], 99.50th=[31589], 99.90th=[45351], 99.95th=[45876], 00:31:37.169 | 99.99th=[45876] 00:31:37.169 bw ( KiB/s): min= 2048, max= 2432, per=4.15%, avg=2291.20, stdev=100.87, samples=20 00:31:37.169 iops : min= 512, max= 608, avg=572.80, stdev=25.22, samples=20 00:31:37.169 lat (msec) : 50=100.00% 00:31:37.169 cpu : usr=97.48%, sys=1.46%, ctx=242, majf=0, minf=28 00:31:37.169 IO depths : 1=5.0%, 2=11.2%, 4=24.8%, 8=51.5%, 16=7.5%, 32=0.0%, >=64=0.0% 00:31:37.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 issued rwts: total=5744,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.169 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.169 filename0: (groupid=0, jobs=1): err= 0: pid=573899: Mon Dec 16 14:35:51 2024 00:31:37.169 read: IOPS=582, BW=2331KiB/s (2387kB/s)(22.8MiB/10020msec) 00:31:37.169 slat (nsec): min=6573, max=81360, avg=18069.86, stdev=12710.30 00:31:37.169 clat (usec): min=2544, max=50948, avg=27309.39, stdev=2646.12 00:31:37.169 lat (usec): min=2581, max=50956, avg=27327.46, stdev=2645.32 00:31:37.169 clat percentiles (usec): 00:31:37.169 | 1.00th=[15139], 5.00th=[26084], 10.00th=[26346], 20.00th=[26608], 00:31:37.169 | 30.00th=[26870], 40.00th=[27132], 50.00th=[27919], 60.00th=[28181], 00:31:37.169 | 70.00th=[28443], 80.00th=[28443], 90.00th=[28443], 95.00th=[28705], 00:31:37.169 | 99.00th=[29230], 99.50th=[29754], 99.90th=[51119], 99.95th=[51119], 00:31:37.169 | 99.99th=[51119] 00:31:37.169 bw ( KiB/s): min= 2176, max= 2560, per=4.22%, avg=2329.60, stdev=98.27, samples=20 00:31:37.169 iops : min= 544, max= 640, avg=582.40, stdev=24.57, samples=20 00:31:37.169 lat (msec) : 4=0.27%, 10=0.33%, 20=1.63%, 50=97.67%, 100=0.10% 00:31:37.169 cpu : usr=98.90%, sys=0.74%, ctx=9, majf=0, minf=26 00:31:37.169 IO depths : 1=4.5%, 2=10.2%, 4=23.9%, 8=53.4%, 16=8.0%, 32=0.0%, >=64=0.0% 00:31:37.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 complete : 0=0.0%, 4=94.0%, 8=0.3%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 issued rwts: total=5840,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.169 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.169 filename0: (groupid=0, jobs=1): err= 0: pid=573900: Mon Dec 16 14:35:51 2024 00:31:37.169 read: IOPS=574, BW=2296KiB/s (2351kB/s)(22.4MiB/10006msec) 00:31:37.169 slat (nsec): min=7854, max=86639, avg=35893.76, stdev=15688.23 00:31:37.169 clat (usec): min=24093, max=49214, avg=27581.26, stdev=1365.20 00:31:37.169 lat (usec): min=24102, max=49247, avg=27617.15, stdev=1365.23 00:31:37.169 clat percentiles (usec): 00:31:37.169 | 1.00th=[25297], 5.00th=[26084], 10.00th=[26346], 20.00th=[26608], 00:31:37.169 | 30.00th=[26870], 40.00th=[27132], 50.00th=[27919], 60.00th=[27919], 00:31:37.169 | 70.00th=[28181], 80.00th=[28181], 90.00th=[28443], 95.00th=[28705], 00:31:37.169 | 99.00th=[31065], 99.50th=[32113], 99.90th=[45876], 99.95th=[45876], 00:31:37.169 | 99.99th=[49021] 00:31:37.169 bw ( KiB/s): min= 2048, max= 2432, per=4.15%, avg=2290.53, stdev=103.59, samples=19 00:31:37.169 iops : min= 512, max= 608, avg=572.63, stdev=25.90, samples=19 00:31:37.169 lat (msec) : 50=100.00% 00:31:37.169 cpu : usr=96.65%, sys=1.78%, ctx=749, majf=0, minf=26 00:31:37.169 IO depths : 1=5.4%, 2=11.6%, 4=24.7%, 8=51.2%, 16=7.1%, 32=0.0%, >=64=0.0% 00:31:37.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 issued rwts: total=5744,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.169 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.169 filename0: (groupid=0, jobs=1): err= 0: pid=573901: Mon Dec 16 14:35:51 2024 00:31:37.169 read: IOPS=577, BW=2309KiB/s (2364kB/s)(22.6MiB/10010msec) 00:31:37.169 slat (usec): min=4, max=148, avg=56.80, stdev=26.36 00:31:37.169 clat (usec): min=10657, max=44866, avg=27167.16, stdev=1811.82 00:31:37.169 lat (usec): min=10711, max=44884, avg=27223.96, stdev=1812.43 00:31:37.169 clat percentiles (usec): 00:31:37.169 | 1.00th=[18482], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.169 | 30.00th=[26608], 40.00th=[26870], 50.00th=[27395], 60.00th=[27657], 00:31:37.169 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.169 | 99.00th=[29230], 99.50th=[31589], 99.90th=[44827], 99.95th=[44827], 00:31:37.169 | 99.99th=[44827] 00:31:37.169 bw ( KiB/s): min= 2048, max= 2432, per=4.16%, avg=2298.11, stdev=99.95, samples=19 00:31:37.169 iops : min= 512, max= 608, avg=574.53, stdev=24.99, samples=19 00:31:37.169 lat (msec) : 20=1.18%, 50=98.82% 00:31:37.169 cpu : usr=98.76%, sys=0.84%, ctx=13, majf=0, minf=30 00:31:37.169 IO depths : 1=6.0%, 2=12.1%, 4=24.4%, 8=51.0%, 16=6.5%, 32=0.0%, >=64=0.0% 00:31:37.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 complete : 0=0.0%, 4=93.9%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 issued rwts: total=5778,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.169 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.169 filename0: (groupid=0, jobs=1): err= 0: pid=573902: Mon Dec 16 14:35:51 2024 00:31:37.169 read: IOPS=575, BW=2300KiB/s (2356kB/s)(22.5MiB/10016msec) 00:31:37.169 slat (usec): min=5, max=149, avg=59.91, stdev=23.13 00:31:37.169 clat (usec): min=18061, max=38827, avg=27278.21, stdev=1169.30 00:31:37.169 lat (usec): min=18098, max=38843, avg=27338.12, stdev=1168.17 00:31:37.169 clat percentiles (usec): 00:31:37.169 | 1.00th=[25560], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.169 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.169 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.169 | 99.00th=[28705], 99.50th=[28967], 99.90th=[38536], 99.95th=[38536], 00:31:37.169 | 99.99th=[39060] 00:31:37.169 bw ( KiB/s): min= 2176, max= 2432, per=4.15%, avg=2290.74, stdev=83.91, samples=19 00:31:37.169 iops : min= 544, max= 608, avg=572.68, stdev=20.98, samples=19 00:31:37.169 lat (msec) : 20=0.28%, 50=99.72% 00:31:37.169 cpu : usr=98.85%, sys=0.76%, ctx=14, majf=0, minf=20 00:31:37.169 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:37.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 issued rwts: total=5760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.169 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.169 filename0: (groupid=0, jobs=1): err= 0: pid=573903: Mon Dec 16 14:35:51 2024 00:31:37.169 read: IOPS=574, BW=2299KiB/s (2354kB/s)(22.5MiB/10006msec) 00:31:37.169 slat (usec): min=6, max=152, avg=55.61, stdev=25.64 00:31:37.169 clat (usec): min=4404, max=53102, avg=27298.48, stdev=2160.45 00:31:37.169 lat (usec): min=4413, max=53116, avg=27354.09, stdev=2160.61 00:31:37.169 clat percentiles (usec): 00:31:37.169 | 1.00th=[25297], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.169 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.169 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28181], 95.00th=[28443], 00:31:37.169 | 99.00th=[28967], 99.50th=[44827], 99.90th=[51643], 99.95th=[51643], 00:31:37.169 | 99.99th=[53216] 00:31:37.169 bw ( KiB/s): min= 2048, max= 2432, per=4.14%, avg=2286.32, stdev=99.05, samples=19 00:31:37.169 iops : min= 512, max= 608, avg=571.58, stdev=24.76, samples=19 00:31:37.169 lat (msec) : 10=0.10%, 20=0.56%, 50=99.10%, 100=0.24% 00:31:37.169 cpu : usr=98.89%, sys=0.72%, ctx=13, majf=0, minf=30 00:31:37.169 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:37.169 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.169 issued rwts: total=5750,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.169 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.170 filename1: (groupid=0, jobs=1): err= 0: pid=573904: Mon Dec 16 14:35:51 2024 00:31:37.170 read: IOPS=574, BW=2297KiB/s (2352kB/s)(22.5MiB/10013msec) 00:31:37.170 slat (usec): min=3, max=150, avg=58.07, stdev=24.77 00:31:37.170 clat (usec): min=11919, max=46240, avg=27324.21, stdev=2024.15 00:31:37.170 lat (usec): min=11942, max=46256, avg=27382.28, stdev=2023.40 00:31:37.170 clat percentiles (usec): 00:31:37.170 | 1.00th=[20579], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.170 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.170 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28705], 00:31:37.170 | 99.00th=[32900], 99.50th=[34866], 99.90th=[46400], 99.95th=[46400], 00:31:37.170 | 99.99th=[46400] 00:31:37.170 bw ( KiB/s): min= 2048, max= 2432, per=4.14%, avg=2286.32, stdev=99.05, samples=19 00:31:37.170 iops : min= 512, max= 608, avg=571.58, stdev=24.76, samples=19 00:31:37.170 lat (msec) : 20=0.66%, 50=99.34% 00:31:37.170 cpu : usr=98.86%, sys=0.73%, ctx=14, majf=0, minf=22 00:31:37.170 IO depths : 1=5.3%, 2=11.3%, 4=24.3%, 8=51.9%, 16=7.3%, 32=0.0%, >=64=0.0% 00:31:37.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 complete : 0=0.0%, 4=94.0%, 8=0.2%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 issued rwts: total=5750,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.170 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.170 filename1: (groupid=0, jobs=1): err= 0: pid=573905: Mon Dec 16 14:35:51 2024 00:31:37.170 read: IOPS=574, BW=2300KiB/s (2355kB/s)(22.5MiB/10018msec) 00:31:37.170 slat (usec): min=4, max=155, avg=59.29, stdev=23.29 00:31:37.170 clat (usec): min=18063, max=41085, avg=27304.33, stdev=1236.11 00:31:37.170 lat (usec): min=18086, max=41098, avg=27363.62, stdev=1233.86 00:31:37.170 clat percentiles (usec): 00:31:37.170 | 1.00th=[25560], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.170 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.170 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.170 | 99.00th=[28705], 99.50th=[28967], 99.90th=[41157], 99.95th=[41157], 00:31:37.170 | 99.99th=[41157] 00:31:37.170 bw ( KiB/s): min= 2176, max= 2432, per=4.16%, avg=2297.80, stdev=87.56, samples=20 00:31:37.170 iops : min= 544, max= 608, avg=574.45, stdev=21.89, samples=20 00:31:37.170 lat (msec) : 20=0.28%, 50=99.72% 00:31:37.170 cpu : usr=99.16%, sys=0.45%, ctx=13, majf=0, minf=27 00:31:37.170 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:37.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 issued rwts: total=5760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.170 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.170 filename1: (groupid=0, jobs=1): err= 0: pid=573906: Mon Dec 16 14:35:51 2024 00:31:37.170 read: IOPS=573, BW=2296KiB/s (2351kB/s)(22.4MiB/10008msec) 00:31:37.170 slat (usec): min=6, max=150, avg=57.01, stdev=25.36 00:31:37.170 clat (usec): min=24792, max=45758, avg=27380.26, stdev=1326.97 00:31:37.170 lat (usec): min=24840, max=45790, avg=27437.27, stdev=1323.60 00:31:37.170 clat percentiles (usec): 00:31:37.170 | 1.00th=[25560], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.170 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27919], 00:31:37.170 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.170 | 99.00th=[29230], 99.50th=[29754], 99.90th=[45351], 99.95th=[45876], 00:31:37.170 | 99.99th=[45876] 00:31:37.170 bw ( KiB/s): min= 2048, max= 2432, per=4.15%, avg=2291.20, stdev=100.87, samples=20 00:31:37.170 iops : min= 512, max= 608, avg=572.80, stdev=25.22, samples=20 00:31:37.170 lat (msec) : 50=100.00% 00:31:37.170 cpu : usr=98.99%, sys=0.60%, ctx=13, majf=0, minf=34 00:31:37.170 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:37.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 issued rwts: total=5744,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.170 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.170 filename1: (groupid=0, jobs=1): err= 0: pid=573907: Mon Dec 16 14:35:51 2024 00:31:37.170 read: IOPS=575, BW=2303KiB/s (2358kB/s)(22.5MiB/10006msec) 00:31:37.170 slat (usec): min=4, max=152, avg=56.84, stdev=24.79 00:31:37.170 clat (usec): min=11919, max=45013, avg=27228.36, stdev=1569.87 00:31:37.170 lat (usec): min=11943, max=45026, avg=27285.20, stdev=1570.52 00:31:37.170 clat percentiles (usec): 00:31:37.170 | 1.00th=[25297], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.170 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.170 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28181], 95.00th=[28443], 00:31:37.170 | 99.00th=[28705], 99.50th=[28967], 99.90th=[44827], 99.95th=[44827], 00:31:37.170 | 99.99th=[44827] 00:31:37.170 bw ( KiB/s): min= 2048, max= 2432, per=4.15%, avg=2290.53, stdev=103.59, samples=19 00:31:37.170 iops : min= 512, max= 608, avg=572.63, stdev=25.90, samples=19 00:31:37.170 lat (msec) : 20=0.56%, 50=99.44% 00:31:37.170 cpu : usr=99.04%, sys=0.57%, ctx=12, majf=0, minf=29 00:31:37.170 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:37.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 issued rwts: total=5760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.170 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.170 filename1: (groupid=0, jobs=1): err= 0: pid=573908: Mon Dec 16 14:35:51 2024 00:31:37.170 read: IOPS=576, BW=2308KiB/s (2363kB/s)(22.6MiB/10006msec) 00:31:37.170 slat (usec): min=4, max=150, avg=51.09, stdev=24.76 00:31:37.170 clat (usec): min=3682, max=44798, avg=27261.94, stdev=2175.70 00:31:37.170 lat (usec): min=3690, max=44819, avg=27313.03, stdev=2179.45 00:31:37.170 clat percentiles (usec): 00:31:37.170 | 1.00th=[18744], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.170 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.170 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.170 | 99.00th=[31327], 99.50th=[40109], 99.90th=[44827], 99.95th=[44827], 00:31:37.170 | 99.99th=[44827] 00:31:37.170 bw ( KiB/s): min= 2052, max= 2512, per=4.15%, avg=2293.26, stdev=108.42, samples=19 00:31:37.170 iops : min= 513, max= 628, avg=573.32, stdev=27.10, samples=19 00:31:37.170 lat (msec) : 4=0.12%, 20=1.13%, 50=98.75% 00:31:37.170 cpu : usr=98.80%, sys=0.81%, ctx=14, majf=0, minf=28 00:31:37.170 IO depths : 1=4.6%, 2=10.3%, 4=23.2%, 8=53.6%, 16=8.3%, 32=0.0%, >=64=0.0% 00:31:37.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 complete : 0=0.0%, 4=93.8%, 8=0.8%, 16=5.5%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 issued rwts: total=5773,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.170 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.170 filename1: (groupid=0, jobs=1): err= 0: pid=573909: Mon Dec 16 14:35:51 2024 00:31:37.170 read: IOPS=575, BW=2302KiB/s (2358kB/s)(22.5MiB/10007msec) 00:31:37.170 slat (usec): min=4, max=145, avg=57.58, stdev=24.36 00:31:37.170 clat (usec): min=11925, max=45578, avg=27231.74, stdev=1589.56 00:31:37.170 lat (usec): min=11938, max=45592, avg=27289.32, stdev=1589.90 00:31:37.170 clat percentiles (usec): 00:31:37.170 | 1.00th=[25297], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.170 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.170 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28181], 95.00th=[28443], 00:31:37.170 | 99.00th=[28705], 99.50th=[28967], 99.90th=[45351], 99.95th=[45351], 00:31:37.170 | 99.99th=[45351] 00:31:37.170 bw ( KiB/s): min= 2048, max= 2432, per=4.15%, avg=2290.53, stdev=103.59, samples=19 00:31:37.170 iops : min= 512, max= 608, avg=572.63, stdev=25.90, samples=19 00:31:37.170 lat (msec) : 20=0.56%, 50=99.44% 00:31:37.170 cpu : usr=98.68%, sys=0.92%, ctx=13, majf=0, minf=19 00:31:37.170 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:37.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 issued rwts: total=5760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.170 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.170 filename1: (groupid=0, jobs=1): err= 0: pid=573910: Mon Dec 16 14:35:51 2024 00:31:37.170 read: IOPS=574, BW=2297KiB/s (2352kB/s)(22.4MiB/10002msec) 00:31:37.170 slat (usec): min=6, max=165, avg=46.12, stdev=28.57 00:31:37.170 clat (usec): min=24157, max=44024, avg=27489.85, stdev=1240.59 00:31:37.170 lat (usec): min=24169, max=44044, avg=27535.97, stdev=1239.17 00:31:37.170 clat percentiles (usec): 00:31:37.170 | 1.00th=[25035], 5.00th=[26084], 10.00th=[26346], 20.00th=[26608], 00:31:37.170 | 30.00th=[26870], 40.00th=[27132], 50.00th=[27657], 60.00th=[27919], 00:31:37.170 | 70.00th=[28181], 80.00th=[28443], 90.00th=[28443], 95.00th=[28705], 00:31:37.170 | 99.00th=[28967], 99.50th=[29230], 99.90th=[43779], 99.95th=[43779], 00:31:37.170 | 99.99th=[43779] 00:31:37.170 bw ( KiB/s): min= 2048, max= 2432, per=4.15%, avg=2290.53, stdev=103.59, samples=19 00:31:37.170 iops : min= 512, max= 608, avg=572.63, stdev=25.90, samples=19 00:31:37.170 lat (msec) : 50=100.00% 00:31:37.170 cpu : usr=98.84%, sys=0.76%, ctx=31, majf=0, minf=25 00:31:37.170 IO depths : 1=5.0%, 2=11.1%, 4=24.6%, 8=51.8%, 16=7.5%, 32=0.0%, >=64=0.0% 00:31:37.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 issued rwts: total=5744,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.170 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.170 filename1: (groupid=0, jobs=1): err= 0: pid=573911: Mon Dec 16 14:35:51 2024 00:31:37.170 read: IOPS=575, BW=2300KiB/s (2356kB/s)(22.5MiB/10016msec) 00:31:37.170 slat (usec): min=5, max=141, avg=55.97, stdev=23.21 00:31:37.170 clat (usec): min=18568, max=39301, avg=27313.55, stdev=1158.38 00:31:37.170 lat (usec): min=18604, max=39317, avg=27369.53, stdev=1158.35 00:31:37.170 clat percentiles (usec): 00:31:37.170 | 1.00th=[25560], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.170 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.170 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.170 | 99.00th=[28705], 99.50th=[28967], 99.90th=[39060], 99.95th=[39060], 00:31:37.170 | 99.99th=[39060] 00:31:37.170 bw ( KiB/s): min= 2176, max= 2432, per=4.15%, avg=2290.53, stdev=84.20, samples=19 00:31:37.170 iops : min= 544, max= 608, avg=572.63, stdev=21.05, samples=19 00:31:37.170 lat (msec) : 20=0.28%, 50=99.72% 00:31:37.170 cpu : usr=98.87%, sys=0.73%, ctx=29, majf=0, minf=27 00:31:37.170 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:31:37.170 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.170 issued rwts: total=5760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.171 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.171 filename2: (groupid=0, jobs=1): err= 0: pid=573912: Mon Dec 16 14:35:51 2024 00:31:37.171 read: IOPS=575, BW=2302KiB/s (2357kB/s)(22.5MiB/10010msec) 00:31:37.171 slat (usec): min=3, max=149, avg=58.28, stdev=25.16 00:31:37.171 clat (usec): min=11837, max=44741, avg=27234.55, stdev=1597.20 00:31:37.171 lat (usec): min=11851, max=44755, avg=27292.83, stdev=1597.35 00:31:37.171 clat percentiles (usec): 00:31:37.171 | 1.00th=[25297], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.171 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.171 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28181], 95.00th=[28443], 00:31:37.171 | 99.00th=[28967], 99.50th=[32375], 99.90th=[44827], 99.95th=[44827], 00:31:37.171 | 99.99th=[44827] 00:31:37.171 bw ( KiB/s): min= 2048, max= 2432, per=4.15%, avg=2290.53, stdev=103.59, samples=19 00:31:37.171 iops : min= 512, max= 608, avg=572.63, stdev=25.90, samples=19 00:31:37.171 lat (msec) : 20=0.56%, 50=99.44% 00:31:37.171 cpu : usr=99.00%, sys=0.60%, ctx=13, majf=0, minf=35 00:31:37.171 IO depths : 1=6.1%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:37.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 issued rwts: total=5760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.171 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.171 filename2: (groupid=0, jobs=1): err= 0: pid=573913: Mon Dec 16 14:35:51 2024 00:31:37.171 read: IOPS=575, BW=2303KiB/s (2358kB/s)(22.5MiB/10006msec) 00:31:37.171 slat (usec): min=7, max=150, avg=57.87, stdev=24.90 00:31:37.171 clat (usec): min=11910, max=52991, avg=27223.91, stdev=1693.66 00:31:37.171 lat (usec): min=11924, max=53006, avg=27281.78, stdev=1694.36 00:31:37.171 clat percentiles (usec): 00:31:37.171 | 1.00th=[25297], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.171 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.171 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28181], 95.00th=[28443], 00:31:37.171 | 99.00th=[28967], 99.50th=[31851], 99.90th=[44827], 99.95th=[44827], 00:31:37.171 | 99.99th=[53216] 00:31:37.171 bw ( KiB/s): min= 2052, max= 2432, per=4.15%, avg=2290.74, stdev=103.07, samples=19 00:31:37.171 iops : min= 513, max= 608, avg=572.68, stdev=25.77, samples=19 00:31:37.171 lat (msec) : 20=0.62%, 50=99.34%, 100=0.03% 00:31:37.171 cpu : usr=99.04%, sys=0.56%, ctx=13, majf=0, minf=19 00:31:37.171 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:31:37.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 issued rwts: total=5760,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.171 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.171 filename2: (groupid=0, jobs=1): err= 0: pid=573914: Mon Dec 16 14:35:51 2024 00:31:37.171 read: IOPS=583, BW=2332KiB/s (2388kB/s)(22.8MiB/10006msec) 00:31:37.171 slat (usec): min=6, max=143, avg=42.80, stdev=26.35 00:31:37.171 clat (usec): min=7397, max=44808, avg=27036.48, stdev=2667.03 00:31:37.171 lat (usec): min=7407, max=44827, avg=27079.28, stdev=2673.42 00:31:37.171 clat percentiles (usec): 00:31:37.171 | 1.00th=[16450], 5.00th=[23200], 10.00th=[26084], 20.00th=[26346], 00:31:37.171 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.171 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.171 | 99.00th=[35390], 99.50th=[38011], 99.90th=[44827], 99.95th=[44827], 00:31:37.171 | 99.99th=[44827] 00:31:37.171 bw ( KiB/s): min= 2052, max= 2624, per=4.20%, avg=2321.89, stdev=138.12, samples=19 00:31:37.171 iops : min= 513, max= 656, avg=580.47, stdev=34.53, samples=19 00:31:37.171 lat (msec) : 10=0.07%, 20=3.74%, 50=96.19% 00:31:37.171 cpu : usr=98.66%, sys=0.88%, ctx=42, majf=0, minf=33 00:31:37.171 IO depths : 1=5.1%, 2=10.4%, 4=21.7%, 8=54.9%, 16=7.8%, 32=0.0%, >=64=0.0% 00:31:37.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 complete : 0=0.0%, 4=93.3%, 8=1.4%, 16=5.4%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 issued rwts: total=5834,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.171 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.171 filename2: (groupid=0, jobs=1): err= 0: pid=573915: Mon Dec 16 14:35:51 2024 00:31:37.171 read: IOPS=575, BW=2301KiB/s (2356kB/s)(22.5MiB/10007msec) 00:31:37.171 slat (usec): min=5, max=113, avg=30.61, stdev=17.99 00:31:37.171 clat (usec): min=12517, max=50766, avg=27575.42, stdev=1618.73 00:31:37.171 lat (usec): min=12528, max=50774, avg=27606.03, stdev=1617.78 00:31:37.171 clat percentiles (usec): 00:31:37.171 | 1.00th=[24773], 5.00th=[26084], 10.00th=[26346], 20.00th=[26608], 00:31:37.171 | 30.00th=[26870], 40.00th=[27395], 50.00th=[27919], 60.00th=[27919], 00:31:37.171 | 70.00th=[28181], 80.00th=[28443], 90.00th=[28443], 95.00th=[28705], 00:31:37.171 | 99.00th=[29492], 99.50th=[36439], 99.90th=[50594], 99.95th=[50594], 00:31:37.171 | 99.99th=[50594] 00:31:37.171 bw ( KiB/s): min= 2144, max= 2432, per=4.15%, avg=2295.58, stdev=91.82, samples=19 00:31:37.171 iops : min= 536, max= 608, avg=573.89, stdev=22.95, samples=19 00:31:37.171 lat (msec) : 20=0.30%, 50=99.55%, 100=0.16% 00:31:37.171 cpu : usr=98.48%, sys=1.02%, ctx=73, majf=0, minf=28 00:31:37.171 IO depths : 1=4.4%, 2=10.5%, 4=24.5%, 8=52.5%, 16=8.1%, 32=0.0%, >=64=0.0% 00:31:37.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 issued rwts: total=5756,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.171 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.171 filename2: (groupid=0, jobs=1): err= 0: pid=573916: Mon Dec 16 14:35:51 2024 00:31:37.171 read: IOPS=574, BW=2297KiB/s (2352kB/s)(22.5MiB/10019msec) 00:31:37.171 slat (usec): min=3, max=141, avg=57.78, stdev=23.13 00:31:37.171 clat (usec): min=18650, max=49930, avg=27335.14, stdev=1270.35 00:31:37.171 lat (usec): min=18731, max=49941, avg=27392.92, stdev=1267.62 00:31:37.171 clat percentiles (usec): 00:31:37.171 | 1.00th=[25560], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.171 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.171 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.171 | 99.00th=[28967], 99.50th=[29230], 99.90th=[41681], 99.95th=[41681], 00:31:37.171 | 99.99th=[50070] 00:31:37.171 bw ( KiB/s): min= 2176, max= 2432, per=4.16%, avg=2297.60, stdev=87.85, samples=20 00:31:37.171 iops : min= 544, max= 608, avg=574.40, stdev=21.96, samples=20 00:31:37.171 lat (msec) : 20=0.16%, 50=99.84% 00:31:37.171 cpu : usr=98.99%, sys=0.61%, ctx=13, majf=0, minf=32 00:31:37.171 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:31:37.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 issued rwts: total=5753,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.171 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.171 filename2: (groupid=0, jobs=1): err= 0: pid=573917: Mon Dec 16 14:35:51 2024 00:31:37.171 read: IOPS=574, BW=2300KiB/s (2355kB/s)(22.5MiB/10001msec) 00:31:37.171 slat (usec): min=5, max=149, avg=55.53, stdev=26.01 00:31:37.171 clat (usec): min=11471, max=47822, avg=27315.55, stdev=1678.01 00:31:37.171 lat (usec): min=11480, max=47834, avg=27371.08, stdev=1675.73 00:31:37.171 clat percentiles (usec): 00:31:37.171 | 1.00th=[25297], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.171 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.171 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28705], 00:31:37.171 | 99.00th=[29754], 99.50th=[32637], 99.90th=[47973], 99.95th=[47973], 00:31:37.171 | 99.99th=[47973] 00:31:37.171 bw ( KiB/s): min= 2176, max= 2432, per=4.15%, avg=2292.79, stdev=91.35, samples=19 00:31:37.171 iops : min= 544, max= 608, avg=573.16, stdev=22.78, samples=19 00:31:37.171 lat (msec) : 20=0.45%, 50=99.55% 00:31:37.171 cpu : usr=98.80%, sys=0.80%, ctx=16, majf=0, minf=28 00:31:37.171 IO depths : 1=5.8%, 2=11.9%, 4=24.7%, 8=50.9%, 16=6.8%, 32=0.0%, >=64=0.0% 00:31:37.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 issued rwts: total=5750,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.171 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.171 filename2: (groupid=0, jobs=1): err= 0: pid=573918: Mon Dec 16 14:35:51 2024 00:31:37.171 read: IOPS=578, BW=2312KiB/s (2368kB/s)(22.6MiB/10006msec) 00:31:37.171 slat (usec): min=6, max=155, avg=50.36, stdev=27.77 00:31:37.171 clat (usec): min=11895, max=62335, avg=27233.36, stdev=3362.15 00:31:37.171 lat (usec): min=11902, max=62355, avg=27283.72, stdev=3364.08 00:31:37.171 clat percentiles (usec): 00:31:37.171 | 1.00th=[16188], 5.00th=[23200], 10.00th=[25822], 20.00th=[26346], 00:31:37.171 | 30.00th=[26608], 40.00th=[26870], 50.00th=[27395], 60.00th=[27657], 00:31:37.171 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[29492], 00:31:37.171 | 99.00th=[43254], 99.50th=[44827], 99.90th=[47449], 99.95th=[47449], 00:31:37.171 | 99.99th=[62129] 00:31:37.171 bw ( KiB/s): min= 2020, max= 2448, per=4.15%, avg=2292.42, stdev=119.20, samples=19 00:31:37.171 iops : min= 505, max= 612, avg=573.11, stdev=29.80, samples=19 00:31:37.171 lat (msec) : 20=3.75%, 50=96.21%, 100=0.03% 00:31:37.171 cpu : usr=98.90%, sys=0.70%, ctx=13, majf=0, minf=37 00:31:37.171 IO depths : 1=4.2%, 2=8.7%, 4=19.1%, 8=58.7%, 16=9.3%, 32=0.0%, >=64=0.0% 00:31:37.171 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 complete : 0=0.0%, 4=92.7%, 8=2.5%, 16=4.8%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.171 issued rwts: total=5784,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.171 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.171 filename2: (groupid=0, jobs=1): err= 0: pid=573919: Mon Dec 16 14:35:51 2024 00:31:37.171 read: IOPS=574, BW=2298KiB/s (2354kB/s)(22.5MiB/10019msec) 00:31:37.171 slat (usec): min=4, max=150, avg=57.91, stdev=23.78 00:31:37.171 clat (usec): min=18410, max=42066, avg=27338.98, stdev=1393.79 00:31:37.171 lat (usec): min=18491, max=42078, avg=27396.88, stdev=1391.75 00:31:37.171 clat percentiles (usec): 00:31:37.171 | 1.00th=[25297], 5.00th=[25822], 10.00th=[26084], 20.00th=[26346], 00:31:37.171 | 30.00th=[26608], 40.00th=[27132], 50.00th=[27395], 60.00th=[27657], 00:31:37.171 | 70.00th=[27919], 80.00th=[28181], 90.00th=[28443], 95.00th=[28443], 00:31:37.171 | 99.00th=[29230], 99.50th=[34341], 99.90th=[42206], 99.95th=[42206], 00:31:37.171 | 99.99th=[42206] 00:31:37.171 bw ( KiB/s): min= 2176, max= 2432, per=4.16%, avg=2297.60, stdev=87.85, samples=20 00:31:37.171 iops : min= 544, max= 608, avg=574.40, stdev=21.96, samples=20 00:31:37.171 lat (msec) : 20=0.26%, 50=99.74% 00:31:37.171 cpu : usr=98.88%, sys=0.73%, ctx=18, majf=0, minf=25 00:31:37.172 IO depths : 1=5.9%, 2=12.1%, 4=25.0%, 8=50.4%, 16=6.6%, 32=0.0%, >=64=0.0% 00:31:37.172 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.172 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:37.172 issued rwts: total=5757,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:37.172 latency : target=0, window=0, percentile=100.00%, depth=16 00:31:37.172 00:31:37.172 Run status group 0 (all jobs): 00:31:37.172 READ: bw=53.9MiB/s (56.6MB/s), 2296KiB/s-2332KiB/s (2351kB/s-2388kB/s), io=541MiB (567MB), run=10001-10020msec 00:31:37.430 14:35:51 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:31:37.430 14:35:51 -- target/dif.sh@43 -- # local sub 00:31:37.430 14:35:51 -- target/dif.sh@45 -- # for sub in "$@" 00:31:37.430 14:35:51 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:37.430 14:35:51 -- target/dif.sh@36 -- # local sub_id=0 00:31:37.430 14:35:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@45 -- # for sub in "$@" 00:31:37.430 14:35:51 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:37.430 14:35:51 -- target/dif.sh@36 -- # local sub_id=1 00:31:37.430 14:35:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@45 -- # for sub in "$@" 00:31:37.430 14:35:51 -- target/dif.sh@46 -- # destroy_subsystem 2 00:31:37.430 14:35:51 -- target/dif.sh@36 -- # local sub_id=2 00:31:37.430 14:35:51 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@115 -- # NULL_DIF=1 00:31:37.430 14:35:51 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:31:37.430 14:35:51 -- target/dif.sh@115 -- # numjobs=2 00:31:37.430 14:35:51 -- target/dif.sh@115 -- # iodepth=8 00:31:37.430 14:35:51 -- target/dif.sh@115 -- # runtime=5 00:31:37.430 14:35:51 -- target/dif.sh@115 -- # files=1 00:31:37.430 14:35:51 -- target/dif.sh@117 -- # create_subsystems 0 1 00:31:37.430 14:35:51 -- target/dif.sh@28 -- # local sub 00:31:37.430 14:35:51 -- target/dif.sh@30 -- # for sub in "$@" 00:31:37.430 14:35:51 -- target/dif.sh@31 -- # create_subsystem 0 00:31:37.430 14:35:51 -- target/dif.sh@18 -- # local sub_id=0 00:31:37.430 14:35:51 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 bdev_null0 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 [2024-12-16 14:35:51.905961] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@30 -- # for sub in "$@" 00:31:37.430 14:35:51 -- target/dif.sh@31 -- # create_subsystem 1 00:31:37.430 14:35:51 -- target/dif.sh@18 -- # local sub_id=1 00:31:37.430 14:35:51 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 bdev_null1 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.430 14:35:51 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:37.430 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.430 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.430 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.431 14:35:51 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:37.431 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.431 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.431 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.431 14:35:51 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:37.431 14:35:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:37.431 14:35:51 -- common/autotest_common.sh@10 -- # set +x 00:31:37.431 14:35:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:37.431 14:35:51 -- target/dif.sh@118 -- # fio /dev/fd/62 00:31:37.431 14:35:51 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:31:37.431 14:35:51 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:37.431 14:35:51 -- nvmf/common.sh@520 -- # config=() 00:31:37.431 14:35:51 -- target/dif.sh@82 -- # gen_fio_conf 00:31:37.431 14:35:51 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:37.431 14:35:51 -- target/dif.sh@54 -- # local file 00:31:37.431 14:35:51 -- nvmf/common.sh@520 -- # local subsystem config 00:31:37.431 14:35:51 -- target/dif.sh@56 -- # cat 00:31:37.431 14:35:51 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:37.431 14:35:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:37.431 14:35:51 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:37.431 14:35:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:37.431 { 00:31:37.431 "params": { 00:31:37.431 "name": "Nvme$subsystem", 00:31:37.431 "trtype": "$TEST_TRANSPORT", 00:31:37.431 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:37.431 "adrfam": "ipv4", 00:31:37.431 "trsvcid": "$NVMF_PORT", 00:31:37.431 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:37.431 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:37.431 "hdgst": ${hdgst:-false}, 00:31:37.431 "ddgst": ${ddgst:-false} 00:31:37.431 }, 00:31:37.431 "method": "bdev_nvme_attach_controller" 00:31:37.431 } 00:31:37.431 EOF 00:31:37.431 )") 00:31:37.431 14:35:51 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:37.431 14:35:51 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:37.431 14:35:51 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:37.431 14:35:51 -- common/autotest_common.sh@1330 -- # shift 00:31:37.431 14:35:51 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:37.431 14:35:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:37.431 14:35:51 -- nvmf/common.sh@542 -- # cat 00:31:37.431 14:35:51 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:37.431 14:35:51 -- target/dif.sh@72 -- # (( file <= files )) 00:31:37.431 14:35:51 -- target/dif.sh@73 -- # cat 00:31:37.431 14:35:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:37.431 14:35:51 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:37.431 14:35:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:37.431 14:35:51 -- target/dif.sh@72 -- # (( file++ )) 00:31:37.431 14:35:51 -- target/dif.sh@72 -- # (( file <= files )) 00:31:37.431 14:35:51 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:37.431 14:35:51 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:37.431 { 00:31:37.431 "params": { 00:31:37.431 "name": "Nvme$subsystem", 00:31:37.431 "trtype": "$TEST_TRANSPORT", 00:31:37.431 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:37.431 "adrfam": "ipv4", 00:31:37.431 "trsvcid": "$NVMF_PORT", 00:31:37.431 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:37.431 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:37.431 "hdgst": ${hdgst:-false}, 00:31:37.431 "ddgst": ${ddgst:-false} 00:31:37.431 }, 00:31:37.431 "method": "bdev_nvme_attach_controller" 00:31:37.431 } 00:31:37.431 EOF 00:31:37.431 )") 00:31:37.431 14:35:51 -- nvmf/common.sh@542 -- # cat 00:31:37.431 14:35:51 -- nvmf/common.sh@544 -- # jq . 00:31:37.431 14:35:51 -- nvmf/common.sh@545 -- # IFS=, 00:31:37.431 14:35:51 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:37.431 "params": { 00:31:37.431 "name": "Nvme0", 00:31:37.431 "trtype": "tcp", 00:31:37.431 "traddr": "10.0.0.2", 00:31:37.431 "adrfam": "ipv4", 00:31:37.431 "trsvcid": "4420", 00:31:37.431 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:37.431 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:37.431 "hdgst": false, 00:31:37.431 "ddgst": false 00:31:37.431 }, 00:31:37.431 "method": "bdev_nvme_attach_controller" 00:31:37.431 },{ 00:31:37.431 "params": { 00:31:37.431 "name": "Nvme1", 00:31:37.431 "trtype": "tcp", 00:31:37.431 "traddr": "10.0.0.2", 00:31:37.431 "adrfam": "ipv4", 00:31:37.431 "trsvcid": "4420", 00:31:37.431 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:37.431 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:37.431 "hdgst": false, 00:31:37.431 "ddgst": false 00:31:37.431 }, 00:31:37.431 "method": "bdev_nvme_attach_controller" 00:31:37.431 }' 00:31:37.431 14:35:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:37.431 14:35:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:37.431 14:35:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:37.431 14:35:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:37.431 14:35:51 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:37.431 14:35:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:37.700 14:35:52 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:37.700 14:35:52 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:37.700 14:35:52 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:37.700 14:35:52 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:37.958 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:37.958 ... 00:31:37.958 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:31:37.958 ... 00:31:37.958 fio-3.35 00:31:37.958 Starting 4 threads 00:31:37.958 EAL: No free 2048 kB hugepages reported on node 1 00:31:38.524 [2024-12-16 14:35:52.886596] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:38.524 [2024-12-16 14:35:52.886637] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:43.783 00:31:43.783 filename0: (groupid=0, jobs=1): err= 0: pid=575850: Mon Dec 16 14:35:58 2024 00:31:43.783 read: IOPS=2761, BW=21.6MiB/s (22.6MB/s)(108MiB/5001msec) 00:31:43.783 slat (nsec): min=5933, max=91833, avg=15300.22, stdev=11015.34 00:31:43.783 clat (usec): min=839, max=5086, avg=2852.26, stdev=343.19 00:31:43.783 lat (usec): min=852, max=5094, avg=2867.56, stdev=343.44 00:31:43.783 clat percentiles (usec): 00:31:43.783 | 1.00th=[ 1958], 5.00th=[ 2311], 10.00th=[ 2540], 20.00th=[ 2737], 00:31:43.783 | 30.00th=[ 2769], 40.00th=[ 2802], 50.00th=[ 2802], 60.00th=[ 2835], 00:31:43.783 | 70.00th=[ 2868], 80.00th=[ 3032], 90.00th=[ 3228], 95.00th=[ 3458], 00:31:43.783 | 99.00th=[ 3982], 99.50th=[ 4293], 99.90th=[ 4686], 99.95th=[ 5014], 00:31:43.783 | 99.99th=[ 5080] 00:31:43.783 bw ( KiB/s): min=21488, max=22496, per=24.79%, avg=22106.22, stdev=345.23, samples=9 00:31:43.783 iops : min= 2686, max= 2812, avg=2763.22, stdev=43.11, samples=9 00:31:43.783 lat (usec) : 1000=0.04% 00:31:43.783 lat (msec) : 2=1.22%, 4=97.84%, 10=0.91% 00:31:43.783 cpu : usr=97.78%, sys=1.84%, ctx=8, majf=0, minf=124 00:31:43.783 IO depths : 1=0.1%, 2=1.9%, 4=70.2%, 8=27.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:43.783 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.783 complete : 0=0.0%, 4=92.4%, 8=7.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.783 issued rwts: total=13811,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.783 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:43.783 filename0: (groupid=0, jobs=1): err= 0: pid=575851: Mon Dec 16 14:35:58 2024 00:31:43.783 read: IOPS=2744, BW=21.4MiB/s (22.5MB/s)(107MiB/5001msec) 00:31:43.783 slat (nsec): min=5936, max=91193, avg=15933.03, stdev=11170.00 00:31:43.783 clat (usec): min=618, max=4882, avg=2868.48, stdev=327.40 00:31:43.783 lat (usec): min=635, max=4912, avg=2884.41, stdev=327.32 00:31:43.783 clat percentiles (usec): 00:31:43.783 | 1.00th=[ 1958], 5.00th=[ 2409], 10.00th=[ 2606], 20.00th=[ 2737], 00:31:43.783 | 30.00th=[ 2769], 40.00th=[ 2802], 50.00th=[ 2802], 60.00th=[ 2835], 00:31:43.783 | 70.00th=[ 2900], 80.00th=[ 3032], 90.00th=[ 3228], 95.00th=[ 3458], 00:31:43.783 | 99.00th=[ 3982], 99.50th=[ 4146], 99.90th=[ 4686], 99.95th=[ 4752], 00:31:43.784 | 99.99th=[ 4883] 00:31:43.784 bw ( KiB/s): min=21120, max=22464, per=24.63%, avg=21962.67, stdev=474.37, samples=9 00:31:43.784 iops : min= 2640, max= 2808, avg=2745.33, stdev=59.30, samples=9 00:31:43.784 lat (usec) : 750=0.01%, 1000=0.01% 00:31:43.784 lat (msec) : 2=1.16%, 4=97.97%, 10=0.85% 00:31:43.784 cpu : usr=97.62%, sys=2.00%, ctx=10, majf=0, minf=79 00:31:43.784 IO depths : 1=0.1%, 2=2.0%, 4=70.3%, 8=27.7%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:43.784 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.784 complete : 0=0.0%, 4=92.1%, 8=7.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.784 issued rwts: total=13723,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.784 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:43.784 filename1: (groupid=0, jobs=1): err= 0: pid=575852: Mon Dec 16 14:35:58 2024 00:31:43.784 read: IOPS=2759, BW=21.6MiB/s (22.6MB/s)(108MiB/5002msec) 00:31:43.784 slat (nsec): min=5722, max=52977, avg=13424.32, stdev=7826.83 00:31:43.784 clat (usec): min=983, max=5592, avg=2861.18, stdev=333.56 00:31:43.784 lat (usec): min=1003, max=5605, avg=2874.61, stdev=333.31 00:31:43.784 clat percentiles (usec): 00:31:43.784 | 1.00th=[ 1991], 5.00th=[ 2343], 10.00th=[ 2573], 20.00th=[ 2737], 00:31:43.784 | 30.00th=[ 2769], 40.00th=[ 2802], 50.00th=[ 2835], 60.00th=[ 2835], 00:31:43.784 | 70.00th=[ 2868], 80.00th=[ 3032], 90.00th=[ 3195], 95.00th=[ 3458], 00:31:43.784 | 99.00th=[ 4015], 99.50th=[ 4293], 99.90th=[ 4752], 99.95th=[ 5014], 00:31:43.784 | 99.99th=[ 5604] 00:31:43.784 bw ( KiB/s): min=21120, max=22944, per=24.83%, avg=22140.44, stdev=521.58, samples=9 00:31:43.784 iops : min= 2640, max= 2868, avg=2767.56, stdev=65.20, samples=9 00:31:43.784 lat (usec) : 1000=0.01% 00:31:43.784 lat (msec) : 2=1.04%, 4=97.89%, 10=1.06% 00:31:43.784 cpu : usr=96.96%, sys=2.70%, ctx=9, majf=0, minf=67 00:31:43.784 IO depths : 1=0.1%, 2=2.1%, 4=69.4%, 8=28.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:43.784 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.784 complete : 0=0.0%, 4=93.0%, 8=7.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.784 issued rwts: total=13805,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.784 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:43.784 filename1: (groupid=0, jobs=1): err= 0: pid=575853: Mon Dec 16 14:35:58 2024 00:31:43.784 read: IOPS=2883, BW=22.5MiB/s (23.6MB/s)(113MiB/5002msec) 00:31:43.784 slat (nsec): min=5823, max=52289, avg=13500.99, stdev=7980.81 00:31:43.784 clat (usec): min=866, max=44574, avg=2738.24, stdev=1041.69 00:31:43.784 lat (usec): min=880, max=44604, avg=2751.74, stdev=1041.77 00:31:43.784 clat percentiles (usec): 00:31:43.784 | 1.00th=[ 1795], 5.00th=[ 2089], 10.00th=[ 2245], 20.00th=[ 2442], 00:31:43.784 | 30.00th=[ 2638], 40.00th=[ 2769], 50.00th=[ 2802], 60.00th=[ 2835], 00:31:43.784 | 70.00th=[ 2835], 80.00th=[ 2868], 90.00th=[ 3032], 95.00th=[ 3163], 00:31:43.784 | 99.00th=[ 3654], 99.50th=[ 3818], 99.90th=[ 4359], 99.95th=[44303], 00:31:43.784 | 99.99th=[44303] 00:31:43.784 bw ( KiB/s): min=21136, max=24576, per=25.66%, avg=22885.33, stdev=964.62, samples=9 00:31:43.784 iops : min= 2642, max= 3072, avg=2860.67, stdev=120.58, samples=9 00:31:43.784 lat (usec) : 1000=0.01% 00:31:43.784 lat (msec) : 2=3.11%, 4=96.56%, 10=0.27%, 50=0.06% 00:31:43.784 cpu : usr=96.84%, sys=2.80%, ctx=8, majf=0, minf=53 00:31:43.784 IO depths : 1=0.2%, 2=3.8%, 4=63.8%, 8=32.2%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:43.784 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.784 complete : 0=0.0%, 4=96.0%, 8=4.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:43.784 issued rwts: total=14423,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:43.784 latency : target=0, window=0, percentile=100.00%, depth=8 00:31:43.784 00:31:43.784 Run status group 0 (all jobs): 00:31:43.784 READ: bw=87.1MiB/s (91.3MB/s), 21.4MiB/s-22.5MiB/s (22.5MB/s-23.6MB/s), io=436MiB (457MB), run=5001-5002msec 00:31:43.784 14:35:58 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:31:43.784 14:35:58 -- target/dif.sh@43 -- # local sub 00:31:43.784 14:35:58 -- target/dif.sh@45 -- # for sub in "$@" 00:31:43.784 14:35:58 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:43.784 14:35:58 -- target/dif.sh@36 -- # local sub_id=0 00:31:43.784 14:35:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:43.784 14:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.784 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:43.784 14:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.784 14:35:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:43.784 14:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.784 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:43.784 14:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.784 14:35:58 -- target/dif.sh@45 -- # for sub in "$@" 00:31:43.784 14:35:58 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:43.784 14:35:58 -- target/dif.sh@36 -- # local sub_id=1 00:31:43.784 14:35:58 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:43.784 14:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.784 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:43.784 14:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.784 14:35:58 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:43.784 14:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.784 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:43.784 14:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:43.784 00:31:43.784 real 0m24.339s 00:31:43.784 user 4m52.209s 00:31:43.784 sys 0m4.136s 00:31:43.784 14:35:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:43.784 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:43.784 ************************************ 00:31:43.784 END TEST fio_dif_rand_params 00:31:43.784 ************************************ 00:31:43.784 14:35:58 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:31:43.784 14:35:58 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:43.784 14:35:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:43.784 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:43.784 ************************************ 00:31:43.784 START TEST fio_dif_digest 00:31:43.784 ************************************ 00:31:43.784 14:35:58 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:31:43.784 14:35:58 -- target/dif.sh@123 -- # local NULL_DIF 00:31:43.784 14:35:58 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:31:43.784 14:35:58 -- target/dif.sh@125 -- # local hdgst ddgst 00:31:43.784 14:35:58 -- target/dif.sh@127 -- # NULL_DIF=3 00:31:43.784 14:35:58 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:31:43.784 14:35:58 -- target/dif.sh@127 -- # numjobs=3 00:31:43.784 14:35:58 -- target/dif.sh@127 -- # iodepth=3 00:31:43.784 14:35:58 -- target/dif.sh@127 -- # runtime=10 00:31:43.784 14:35:58 -- target/dif.sh@128 -- # hdgst=true 00:31:43.784 14:35:58 -- target/dif.sh@128 -- # ddgst=true 00:31:43.784 14:35:58 -- target/dif.sh@130 -- # create_subsystems 0 00:31:43.784 14:35:58 -- target/dif.sh@28 -- # local sub 00:31:43.784 14:35:58 -- target/dif.sh@30 -- # for sub in "$@" 00:31:43.784 14:35:58 -- target/dif.sh@31 -- # create_subsystem 0 00:31:43.784 14:35:58 -- target/dif.sh@18 -- # local sub_id=0 00:31:43.784 14:35:58 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:43.784 14:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:43.784 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:44.041 bdev_null0 00:31:44.041 14:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.041 14:35:58 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:44.041 14:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.041 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:44.041 14:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.041 14:35:58 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:44.041 14:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.041 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:44.041 14:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.041 14:35:58 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:44.041 14:35:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:44.041 14:35:58 -- common/autotest_common.sh@10 -- # set +x 00:31:44.041 [2024-12-16 14:35:58.378297] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:44.041 14:35:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:44.041 14:35:58 -- target/dif.sh@131 -- # fio /dev/fd/62 00:31:44.041 14:35:58 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:31:44.041 14:35:58 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:44.041 14:35:58 -- nvmf/common.sh@520 -- # config=() 00:31:44.041 14:35:58 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.041 14:35:58 -- nvmf/common.sh@520 -- # local subsystem config 00:31:44.041 14:35:58 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:44.041 14:35:58 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.041 14:35:58 -- target/dif.sh@82 -- # gen_fio_conf 00:31:44.041 14:35:58 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:44.041 { 00:31:44.041 "params": { 00:31:44.041 "name": "Nvme$subsystem", 00:31:44.041 "trtype": "$TEST_TRANSPORT", 00:31:44.041 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:44.041 "adrfam": "ipv4", 00:31:44.041 "trsvcid": "$NVMF_PORT", 00:31:44.041 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:44.041 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:44.041 "hdgst": ${hdgst:-false}, 00:31:44.041 "ddgst": ${ddgst:-false} 00:31:44.041 }, 00:31:44.041 "method": "bdev_nvme_attach_controller" 00:31:44.041 } 00:31:44.041 EOF 00:31:44.041 )") 00:31:44.041 14:35:58 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:44.041 14:35:58 -- target/dif.sh@54 -- # local file 00:31:44.041 14:35:58 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:44.041 14:35:58 -- target/dif.sh@56 -- # cat 00:31:44.041 14:35:58 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:44.041 14:35:58 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.041 14:35:58 -- common/autotest_common.sh@1330 -- # shift 00:31:44.041 14:35:58 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:44.041 14:35:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.041 14:35:58 -- nvmf/common.sh@542 -- # cat 00:31:44.041 14:35:58 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:44.041 14:35:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.041 14:35:58 -- target/dif.sh@72 -- # (( file <= files )) 00:31:44.041 14:35:58 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:44.041 14:35:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.041 14:35:58 -- nvmf/common.sh@544 -- # jq . 00:31:44.041 14:35:58 -- nvmf/common.sh@545 -- # IFS=, 00:31:44.041 14:35:58 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:44.041 "params": { 00:31:44.041 "name": "Nvme0", 00:31:44.041 "trtype": "tcp", 00:31:44.041 "traddr": "10.0.0.2", 00:31:44.041 "adrfam": "ipv4", 00:31:44.041 "trsvcid": "4420", 00:31:44.041 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:44.041 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:44.041 "hdgst": true, 00:31:44.041 "ddgst": true 00:31:44.041 }, 00:31:44.041 "method": "bdev_nvme_attach_controller" 00:31:44.041 }' 00:31:44.041 14:35:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.041 14:35:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.041 14:35:58 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:44.041 14:35:58 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:44.041 14:35:58 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:44.041 14:35:58 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:44.041 14:35:58 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:44.041 14:35:58 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:44.041 14:35:58 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:44.041 14:35:58 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:44.299 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:44.299 ... 00:31:44.299 fio-3.35 00:31:44.299 Starting 3 threads 00:31:44.299 EAL: No free 2048 kB hugepages reported on node 1 00:31:44.864 [2024-12-16 14:35:59.152099] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:44.864 [2024-12-16 14:35:59.152134] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:54.824 00:31:54.824 filename0: (groupid=0, jobs=1): err= 0: pid=576923: Mon Dec 16 14:36:09 2024 00:31:54.824 read: IOPS=282, BW=35.3MiB/s (37.0MB/s)(354MiB/10046msec) 00:31:54.824 slat (nsec): min=6376, max=52514, avg=20540.79, stdev=6855.52 00:31:54.824 clat (usec): min=7604, max=48877, avg=10596.40, stdev=1228.76 00:31:54.824 lat (usec): min=7615, max=48887, avg=10616.94, stdev=1228.50 00:31:54.824 clat percentiles (usec): 00:31:54.824 | 1.00th=[ 8979], 5.00th=[ 9372], 10.00th=[ 9634], 20.00th=[10028], 00:31:54.824 | 30.00th=[10159], 40.00th=[10421], 50.00th=[10552], 60.00th=[10683], 00:31:54.824 | 70.00th=[10945], 80.00th=[11076], 90.00th=[11600], 95.00th=[11863], 00:31:54.824 | 99.00th=[12649], 99.50th=[13042], 99.90th=[14353], 99.95th=[45876], 00:31:54.824 | 99.99th=[49021] 00:31:54.824 bw ( KiB/s): min=34560, max=36864, per=32.73%, avg=36249.60, stdev=640.13, samples=20 00:31:54.824 iops : min= 270, max= 288, avg=283.20, stdev= 5.00, samples=20 00:31:54.824 lat (msec) : 10=19.76%, 20=80.17%, 50=0.07% 00:31:54.824 cpu : usr=96.57%, sys=3.09%, ctx=16, majf=0, minf=123 00:31:54.824 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.824 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.824 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.824 issued rwts: total=2834,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.824 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:54.824 filename0: (groupid=0, jobs=1): err= 0: pid=576924: Mon Dec 16 14:36:09 2024 00:31:54.824 read: IOPS=301, BW=37.7MiB/s (39.5MB/s)(377MiB/10007msec) 00:31:54.824 slat (nsec): min=2844, max=49482, avg=17345.20, stdev=7285.07 00:31:54.824 clat (usec): min=7552, max=17986, avg=9933.55, stdev=751.91 00:31:54.824 lat (usec): min=7567, max=18003, avg=9950.89, stdev=751.81 00:31:54.824 clat percentiles (usec): 00:31:54.824 | 1.00th=[ 8356], 5.00th=[ 8717], 10.00th=[ 8979], 20.00th=[ 9372], 00:31:54.824 | 30.00th=[ 9634], 40.00th=[ 9765], 50.00th=[ 9896], 60.00th=[10159], 00:31:54.824 | 70.00th=[10290], 80.00th=[10421], 90.00th=[10814], 95.00th=[11076], 00:31:54.824 | 99.00th=[11863], 99.50th=[12125], 99.90th=[12911], 99.95th=[17957], 00:31:54.824 | 99.99th=[17957] 00:31:54.824 bw ( KiB/s): min=37120, max=40192, per=34.79%, avg=38530.74, stdev=807.10, samples=19 00:31:54.824 iops : min= 290, max= 314, avg=301.00, stdev= 6.33, samples=19 00:31:54.824 lat (msec) : 10=53.42%, 20=46.58% 00:31:54.824 cpu : usr=95.94%, sys=3.72%, ctx=21, majf=0, minf=132 00:31:54.824 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.824 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.824 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.824 issued rwts: total=3016,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.824 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:54.824 filename0: (groupid=0, jobs=1): err= 0: pid=576925: Mon Dec 16 14:36:09 2024 00:31:54.824 read: IOPS=282, BW=35.4MiB/s (37.1MB/s)(355MiB/10045msec) 00:31:54.824 slat (nsec): min=5634, max=44461, avg=18787.27, stdev=8256.26 00:31:54.824 clat (usec): min=8149, max=48261, avg=10571.34, stdev=1214.24 00:31:54.824 lat (usec): min=8165, max=48274, avg=10590.12, stdev=1214.30 00:31:54.824 clat percentiles (usec): 00:31:54.824 | 1.00th=[ 8979], 5.00th=[ 9372], 10.00th=[ 9634], 20.00th=[ 9896], 00:31:54.824 | 30.00th=[10159], 40.00th=[10290], 50.00th=[10552], 60.00th=[10683], 00:31:54.824 | 70.00th=[10814], 80.00th=[11076], 90.00th=[11469], 95.00th=[11863], 00:31:54.824 | 99.00th=[12649], 99.50th=[13173], 99.90th=[13829], 99.95th=[44827], 00:31:54.824 | 99.99th=[48497] 00:31:54.824 bw ( KiB/s): min=34560, max=37376, per=32.82%, avg=36339.20, stdev=702.19, samples=20 00:31:54.824 iops : min= 270, max= 292, avg=283.90, stdev= 5.49, samples=20 00:31:54.824 lat (msec) : 10=22.03%, 20=77.90%, 50=0.07% 00:31:54.824 cpu : usr=96.28%, sys=3.40%, ctx=20, majf=0, minf=165 00:31:54.824 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:54.824 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.824 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:54.824 issued rwts: total=2841,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:54.824 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:54.824 00:31:54.824 Run status group 0 (all jobs): 00:31:54.824 READ: bw=108MiB/s (113MB/s), 35.3MiB/s-37.7MiB/s (37.0MB/s-39.5MB/s), io=1086MiB (1139MB), run=10007-10046msec 00:31:55.083 14:36:09 -- target/dif.sh@132 -- # destroy_subsystems 0 00:31:55.083 14:36:09 -- target/dif.sh@43 -- # local sub 00:31:55.083 14:36:09 -- target/dif.sh@45 -- # for sub in "$@" 00:31:55.083 14:36:09 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:55.083 14:36:09 -- target/dif.sh@36 -- # local sub_id=0 00:31:55.083 14:36:09 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:55.083 14:36:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.083 14:36:09 -- common/autotest_common.sh@10 -- # set +x 00:31:55.083 14:36:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.083 14:36:09 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:55.083 14:36:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:55.083 14:36:09 -- common/autotest_common.sh@10 -- # set +x 00:31:55.083 14:36:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:55.083 00:31:55.083 real 0m11.163s 00:31:55.083 user 0m36.040s 00:31:55.083 sys 0m1.360s 00:31:55.083 14:36:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:55.083 14:36:09 -- common/autotest_common.sh@10 -- # set +x 00:31:55.083 ************************************ 00:31:55.083 END TEST fio_dif_digest 00:31:55.083 ************************************ 00:31:55.083 14:36:09 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:31:55.083 14:36:09 -- target/dif.sh@147 -- # nvmftestfini 00:31:55.083 14:36:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:55.083 14:36:09 -- nvmf/common.sh@116 -- # sync 00:31:55.083 14:36:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:55.083 14:36:09 -- nvmf/common.sh@119 -- # set +e 00:31:55.083 14:36:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:55.083 14:36:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:55.083 rmmod nvme_tcp 00:31:55.083 rmmod nvme_fabrics 00:31:55.083 rmmod nvme_keyring 00:31:55.083 14:36:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:55.083 14:36:09 -- nvmf/common.sh@123 -- # set -e 00:31:55.083 14:36:09 -- nvmf/common.sh@124 -- # return 0 00:31:55.083 14:36:09 -- nvmf/common.sh@477 -- # '[' -n 568312 ']' 00:31:55.083 14:36:09 -- nvmf/common.sh@478 -- # killprocess 568312 00:31:55.083 14:36:09 -- common/autotest_common.sh@936 -- # '[' -z 568312 ']' 00:31:55.083 14:36:09 -- common/autotest_common.sh@940 -- # kill -0 568312 00:31:55.083 14:36:09 -- common/autotest_common.sh@941 -- # uname 00:31:55.083 14:36:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:55.083 14:36:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 568312 00:31:55.341 14:36:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:55.341 14:36:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:55.341 14:36:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 568312' 00:31:55.341 killing process with pid 568312 00:31:55.341 14:36:09 -- common/autotest_common.sh@955 -- # kill 568312 00:31:55.341 14:36:09 -- common/autotest_common.sh@960 -- # wait 568312 00:31:55.341 14:36:09 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:31:55.341 14:36:09 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:31:57.872 Waiting for block devices as requested 00:31:58.131 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:31:58.131 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:58.131 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:58.388 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:58.388 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:58.388 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:58.388 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:58.646 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:58.646 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:58.646 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:31:58.646 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:31:58.904 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:31:58.904 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:31:58.904 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:31:59.161 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:31:59.161 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:31:59.161 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:31:59.161 14:36:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:59.161 14:36:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:59.161 14:36:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:59.161 14:36:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:59.161 14:36:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:59.161 14:36:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:59.161 14:36:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:01.689 14:36:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:01.689 00:32:01.689 real 1m13.549s 00:32:01.689 user 7m10.539s 00:32:01.689 sys 0m18.495s 00:32:01.689 14:36:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:01.689 14:36:15 -- common/autotest_common.sh@10 -- # set +x 00:32:01.689 ************************************ 00:32:01.689 END TEST nvmf_dif 00:32:01.689 ************************************ 00:32:01.689 14:36:15 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:01.689 14:36:15 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:01.689 14:36:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:01.689 14:36:15 -- common/autotest_common.sh@10 -- # set +x 00:32:01.689 ************************************ 00:32:01.689 START TEST nvmf_abort_qd_sizes 00:32:01.689 ************************************ 00:32:01.689 14:36:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:01.689 * Looking for test storage... 00:32:01.689 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:01.689 14:36:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:01.689 14:36:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:01.689 14:36:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:01.689 14:36:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:01.689 14:36:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:01.689 14:36:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:01.689 14:36:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:01.689 14:36:15 -- scripts/common.sh@335 -- # IFS=.-: 00:32:01.689 14:36:15 -- scripts/common.sh@335 -- # read -ra ver1 00:32:01.689 14:36:15 -- scripts/common.sh@336 -- # IFS=.-: 00:32:01.689 14:36:15 -- scripts/common.sh@336 -- # read -ra ver2 00:32:01.689 14:36:15 -- scripts/common.sh@337 -- # local 'op=<' 00:32:01.689 14:36:15 -- scripts/common.sh@339 -- # ver1_l=2 00:32:01.689 14:36:15 -- scripts/common.sh@340 -- # ver2_l=1 00:32:01.689 14:36:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:01.689 14:36:15 -- scripts/common.sh@343 -- # case "$op" in 00:32:01.689 14:36:15 -- scripts/common.sh@344 -- # : 1 00:32:01.689 14:36:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:01.689 14:36:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:01.689 14:36:15 -- scripts/common.sh@364 -- # decimal 1 00:32:01.689 14:36:15 -- scripts/common.sh@352 -- # local d=1 00:32:01.689 14:36:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:01.689 14:36:15 -- scripts/common.sh@354 -- # echo 1 00:32:01.689 14:36:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:01.689 14:36:15 -- scripts/common.sh@365 -- # decimal 2 00:32:01.689 14:36:15 -- scripts/common.sh@352 -- # local d=2 00:32:01.689 14:36:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:01.689 14:36:15 -- scripts/common.sh@354 -- # echo 2 00:32:01.689 14:36:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:01.689 14:36:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:01.689 14:36:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:01.689 14:36:15 -- scripts/common.sh@367 -- # return 0 00:32:01.689 14:36:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:01.689 14:36:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:01.689 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:01.689 --rc genhtml_branch_coverage=1 00:32:01.689 --rc genhtml_function_coverage=1 00:32:01.689 --rc genhtml_legend=1 00:32:01.689 --rc geninfo_all_blocks=1 00:32:01.690 --rc geninfo_unexecuted_blocks=1 00:32:01.690 00:32:01.690 ' 00:32:01.690 14:36:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:01.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:01.690 --rc genhtml_branch_coverage=1 00:32:01.690 --rc genhtml_function_coverage=1 00:32:01.690 --rc genhtml_legend=1 00:32:01.690 --rc geninfo_all_blocks=1 00:32:01.690 --rc geninfo_unexecuted_blocks=1 00:32:01.690 00:32:01.690 ' 00:32:01.690 14:36:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:01.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:01.690 --rc genhtml_branch_coverage=1 00:32:01.690 --rc genhtml_function_coverage=1 00:32:01.690 --rc genhtml_legend=1 00:32:01.690 --rc geninfo_all_blocks=1 00:32:01.690 --rc geninfo_unexecuted_blocks=1 00:32:01.690 00:32:01.690 ' 00:32:01.690 14:36:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:01.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:01.690 --rc genhtml_branch_coverage=1 00:32:01.690 --rc genhtml_function_coverage=1 00:32:01.690 --rc genhtml_legend=1 00:32:01.690 --rc geninfo_all_blocks=1 00:32:01.690 --rc geninfo_unexecuted_blocks=1 00:32:01.690 00:32:01.690 ' 00:32:01.690 14:36:15 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:01.690 14:36:15 -- nvmf/common.sh@7 -- # uname -s 00:32:01.690 14:36:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:01.690 14:36:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:01.690 14:36:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:01.690 14:36:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:01.690 14:36:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:01.690 14:36:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:01.690 14:36:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:01.690 14:36:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:01.690 14:36:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:01.690 14:36:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:01.690 14:36:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 00:32:01.690 14:36:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=80b56b8f-cbc7-e911-906e-0017a4403562 00:32:01.690 14:36:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:01.690 14:36:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:01.690 14:36:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:01.690 14:36:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:01.690 14:36:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:01.690 14:36:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:01.690 14:36:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:01.690 14:36:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:01.690 14:36:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:01.690 14:36:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:01.690 14:36:16 -- paths/export.sh@5 -- # export PATH 00:32:01.690 14:36:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:01.690 14:36:16 -- nvmf/common.sh@46 -- # : 0 00:32:01.690 14:36:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:01.690 14:36:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:01.690 14:36:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:01.690 14:36:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:01.690 14:36:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:01.690 14:36:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:01.690 14:36:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:01.690 14:36:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:01.690 14:36:16 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:01.690 14:36:16 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:01.690 14:36:16 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:01.690 14:36:16 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:01.690 14:36:16 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:01.690 14:36:16 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:01.690 14:36:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:01.690 14:36:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:01.690 14:36:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:01.690 14:36:16 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:01.690 14:36:16 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:01.690 14:36:16 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:01.690 14:36:16 -- common/autotest_common.sh@10 -- # set +x 00:32:06.955 14:36:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:06.955 14:36:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:06.955 14:36:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:06.956 14:36:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:06.956 14:36:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:06.956 14:36:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:06.956 14:36:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:06.956 14:36:21 -- nvmf/common.sh@294 -- # net_devs=() 00:32:06.956 14:36:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:06.956 14:36:21 -- nvmf/common.sh@295 -- # e810=() 00:32:06.956 14:36:21 -- nvmf/common.sh@295 -- # local -ga e810 00:32:06.956 14:36:21 -- nvmf/common.sh@296 -- # x722=() 00:32:06.956 14:36:21 -- nvmf/common.sh@296 -- # local -ga x722 00:32:06.956 14:36:21 -- nvmf/common.sh@297 -- # mlx=() 00:32:06.956 14:36:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:06.956 14:36:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:06.956 14:36:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:06.956 14:36:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:06.956 14:36:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:06.956 14:36:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:06.956 14:36:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.0 (0x8086 - 0x159b)' 00:32:06.956 Found 0000:af:00.0 (0x8086 - 0x159b) 00:32:06.956 14:36:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:06.956 14:36:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:af:00.1 (0x8086 - 0x159b)' 00:32:06.956 Found 0000:af:00.1 (0x8086 - 0x159b) 00:32:06.956 14:36:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:06.956 14:36:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:06.956 14:36:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:06.956 14:36:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:06.956 14:36:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:06.956 14:36:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.0: cvl_0_0' 00:32:06.956 Found net devices under 0000:af:00.0: cvl_0_0 00:32:06.956 14:36:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:06.956 14:36:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:06.956 14:36:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:06.956 14:36:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:06.956 14:36:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:06.956 14:36:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:af:00.1: cvl_0_1' 00:32:06.956 Found net devices under 0000:af:00.1: cvl_0_1 00:32:06.956 14:36:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:06.956 14:36:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:06.956 14:36:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:06.956 14:36:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:06.956 14:36:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:06.956 14:36:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:06.956 14:36:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:06.956 14:36:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:06.956 14:36:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:06.956 14:36:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:06.956 14:36:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:06.956 14:36:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:06.956 14:36:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:06.956 14:36:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:06.956 14:36:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:06.956 14:36:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:06.956 14:36:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:06.956 14:36:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:07.215 14:36:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:07.215 14:36:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:07.215 14:36:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:07.215 14:36:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:07.215 14:36:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:07.215 14:36:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:07.215 14:36:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:07.215 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:07.215 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.446 ms 00:32:07.215 00:32:07.215 --- 10.0.0.2 ping statistics --- 00:32:07.215 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:07.215 rtt min/avg/max/mdev = 0.446/0.446/0.446/0.000 ms 00:32:07.215 14:36:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:07.215 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:07.215 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.198 ms 00:32:07.215 00:32:07.215 --- 10.0.0.1 ping statistics --- 00:32:07.215 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:07.215 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:32:07.215 14:36:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:07.215 14:36:21 -- nvmf/common.sh@410 -- # return 0 00:32:07.215 14:36:21 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:07.215 14:36:21 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:10.497 0000:00:04.7 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:00:04.6 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:00:04.5 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:00:04.4 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:00:04.3 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:00:04.2 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:00:04.1 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:00:04.0 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:80:04.7 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:80:04.6 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:80:04.5 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:80:04.4 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:80:04.3 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:80:04.2 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:80:04.1 (8086 2021): ioatdma -> vfio-pci 00:32:10.497 0000:80:04.0 (8086 2021): ioatdma -> vfio-pci 00:32:10.755 0000:5e:00.0 (8086 0a54): nvme -> vfio-pci 00:32:11.012 14:36:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:11.012 14:36:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:11.012 14:36:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:11.012 14:36:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:11.012 14:36:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:11.012 14:36:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:11.012 14:36:25 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:11.012 14:36:25 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:11.012 14:36:25 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:11.012 14:36:25 -- common/autotest_common.sh@10 -- # set +x 00:32:11.012 14:36:25 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:11.012 14:36:25 -- nvmf/common.sh@469 -- # nvmfpid=585400 00:32:11.012 14:36:25 -- nvmf/common.sh@470 -- # waitforlisten 585400 00:32:11.012 14:36:25 -- common/autotest_common.sh@829 -- # '[' -z 585400 ']' 00:32:11.012 14:36:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:11.012 14:36:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:11.012 14:36:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:11.012 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:11.012 14:36:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:11.012 14:36:25 -- common/autotest_common.sh@10 -- # set +x 00:32:11.012 [2024-12-16 14:36:25.507060] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:11.012 [2024-12-16 14:36:25.507103] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:11.012 EAL: No free 2048 kB hugepages reported on node 1 00:32:11.012 [2024-12-16 14:36:25.566879] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:11.270 [2024-12-16 14:36:25.648161] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:11.270 [2024-12-16 14:36:25.648272] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:11.270 [2024-12-16 14:36:25.648279] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:11.270 [2024-12-16 14:36:25.648285] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:11.270 [2024-12-16 14:36:25.648329] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:11.270 [2024-12-16 14:36:25.648427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:11.270 [2024-12-16 14:36:25.648522] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:11.270 [2024-12-16 14:36:25.648524] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:11.836 14:36:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:11.836 14:36:26 -- common/autotest_common.sh@862 -- # return 0 00:32:11.836 14:36:26 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:11.836 14:36:26 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:11.836 14:36:26 -- common/autotest_common.sh@10 -- # set +x 00:32:11.836 14:36:26 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:11.836 14:36:26 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:11.836 14:36:26 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:11.836 14:36:26 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:11.836 14:36:26 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:11.836 14:36:26 -- scripts/common.sh@312 -- # local nvmes 00:32:11.836 14:36:26 -- scripts/common.sh@314 -- # [[ -n 0000:5e:00.0 ]] 00:32:11.836 14:36:26 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:11.836 14:36:26 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:11.836 14:36:26 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:5e:00.0 ]] 00:32:11.836 14:36:26 -- scripts/common.sh@322 -- # uname -s 00:32:11.836 14:36:26 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:11.836 14:36:26 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:11.836 14:36:26 -- scripts/common.sh@327 -- # (( 1 )) 00:32:11.836 14:36:26 -- scripts/common.sh@328 -- # printf '%s\n' 0000:5e:00.0 00:32:11.836 14:36:26 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:11.836 14:36:26 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:5e:00.0 00:32:11.837 14:36:26 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:11.837 14:36:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:11.837 14:36:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:11.837 14:36:26 -- common/autotest_common.sh@10 -- # set +x 00:32:11.837 ************************************ 00:32:11.837 START TEST spdk_target_abort 00:32:11.837 ************************************ 00:32:11.837 14:36:26 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:11.837 14:36:26 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:11.837 14:36:26 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:11.837 14:36:26 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:5e:00.0 -b spdk_target 00:32:11.837 14:36:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.837 14:36:26 -- common/autotest_common.sh@10 -- # set +x 00:32:15.122 spdk_targetn1 00:32:15.122 14:36:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:15.122 14:36:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.122 14:36:29 -- common/autotest_common.sh@10 -- # set +x 00:32:15.122 [2024-12-16 14:36:29.226392] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:15.122 14:36:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:15.122 14:36:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.122 14:36:29 -- common/autotest_common.sh@10 -- # set +x 00:32:15.122 14:36:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:15.122 14:36:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.122 14:36:29 -- common/autotest_common.sh@10 -- # set +x 00:32:15.122 14:36:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:15.122 14:36:29 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:15.122 14:36:29 -- common/autotest_common.sh@10 -- # set +x 00:32:15.122 [2024-12-16 14:36:29.259250] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:15.122 14:36:29 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:15.122 14:36:29 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:15.122 EAL: No free 2048 kB hugepages reported on node 1 00:32:18.411 Initializing NVMe Controllers 00:32:18.411 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:18.411 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:18.411 Initialization complete. Launching workers. 00:32:18.411 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 17811, failed: 0 00:32:18.411 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1368, failed to submit 16443 00:32:18.411 success 796, unsuccess 572, failed 0 00:32:18.411 14:36:32 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:18.411 14:36:32 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:18.411 EAL: No free 2048 kB hugepages reported on node 1 00:32:21.698 Initializing NVMe Controllers 00:32:21.698 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:21.698 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:21.698 Initialization complete. Launching workers. 00:32:21.698 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8544, failed: 0 00:32:21.698 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1212, failed to submit 7332 00:32:21.698 success 368, unsuccess 844, failed 0 00:32:21.698 14:36:35 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:21.698 14:36:35 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:21.698 EAL: No free 2048 kB hugepages reported on node 1 00:32:24.987 Initializing NVMe Controllers 00:32:24.987 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:24.987 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:24.987 Initialization complete. Launching workers. 00:32:24.987 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 39951, failed: 0 00:32:24.987 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2851, failed to submit 37100 00:32:24.987 success 597, unsuccess 2254, failed 0 00:32:24.987 14:36:38 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:24.987 14:36:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:24.987 14:36:38 -- common/autotest_common.sh@10 -- # set +x 00:32:24.987 14:36:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:24.987 14:36:38 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:24.987 14:36:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:24.987 14:36:38 -- common/autotest_common.sh@10 -- # set +x 00:32:25.925 14:36:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:25.925 14:36:40 -- target/abort_qd_sizes.sh@62 -- # killprocess 585400 00:32:25.925 14:36:40 -- common/autotest_common.sh@936 -- # '[' -z 585400 ']' 00:32:25.925 14:36:40 -- common/autotest_common.sh@940 -- # kill -0 585400 00:32:25.925 14:36:40 -- common/autotest_common.sh@941 -- # uname 00:32:25.925 14:36:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:25.925 14:36:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 585400 00:32:25.925 14:36:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:25.925 14:36:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:25.925 14:36:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 585400' 00:32:25.925 killing process with pid 585400 00:32:25.925 14:36:40 -- common/autotest_common.sh@955 -- # kill 585400 00:32:25.925 14:36:40 -- common/autotest_common.sh@960 -- # wait 585400 00:32:25.925 00:32:25.925 real 0m14.077s 00:32:25.925 user 0m56.001s 00:32:25.925 sys 0m2.313s 00:32:25.925 14:36:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:25.925 14:36:40 -- common/autotest_common.sh@10 -- # set +x 00:32:25.925 ************************************ 00:32:25.925 END TEST spdk_target_abort 00:32:25.925 ************************************ 00:32:26.184 14:36:40 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:26.184 14:36:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:26.184 14:36:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:26.184 14:36:40 -- common/autotest_common.sh@10 -- # set +x 00:32:26.184 ************************************ 00:32:26.184 START TEST kernel_target_abort 00:32:26.184 ************************************ 00:32:26.184 14:36:40 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:26.184 14:36:40 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:26.184 14:36:40 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:26.184 14:36:40 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:26.184 14:36:40 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:26.184 14:36:40 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:26.184 14:36:40 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:26.184 14:36:40 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:26.184 14:36:40 -- nvmf/common.sh@627 -- # local block nvme 00:32:26.184 14:36:40 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:26.184 14:36:40 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:26.184 14:36:40 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:26.184 14:36:40 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:28.719 Waiting for block devices as requested 00:32:28.719 0000:5e:00.0 (8086 0a54): vfio-pci -> nvme 00:32:28.719 0000:00:04.7 (8086 2021): vfio-pci -> ioatdma 00:32:28.719 0000:00:04.6 (8086 2021): vfio-pci -> ioatdma 00:32:28.978 0000:00:04.5 (8086 2021): vfio-pci -> ioatdma 00:32:28.978 0000:00:04.4 (8086 2021): vfio-pci -> ioatdma 00:32:28.978 0000:00:04.3 (8086 2021): vfio-pci -> ioatdma 00:32:28.978 0000:00:04.2 (8086 2021): vfio-pci -> ioatdma 00:32:29.237 0000:00:04.1 (8086 2021): vfio-pci -> ioatdma 00:32:29.237 0000:00:04.0 (8086 2021): vfio-pci -> ioatdma 00:32:29.237 0000:80:04.7 (8086 2021): vfio-pci -> ioatdma 00:32:29.496 0000:80:04.6 (8086 2021): vfio-pci -> ioatdma 00:32:29.496 0000:80:04.5 (8086 2021): vfio-pci -> ioatdma 00:32:29.496 0000:80:04.4 (8086 2021): vfio-pci -> ioatdma 00:32:29.496 0000:80:04.3 (8086 2021): vfio-pci -> ioatdma 00:32:29.755 0000:80:04.2 (8086 2021): vfio-pci -> ioatdma 00:32:29.755 0000:80:04.1 (8086 2021): vfio-pci -> ioatdma 00:32:29.755 0000:80:04.0 (8086 2021): vfio-pci -> ioatdma 00:32:30.014 14:36:44 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:30.014 14:36:44 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:30.014 14:36:44 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:30.014 14:36:44 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:30.014 14:36:44 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:30.014 No valid GPT data, bailing 00:32:30.014 14:36:44 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:30.014 14:36:44 -- scripts/common.sh@393 -- # pt= 00:32:30.014 14:36:44 -- scripts/common.sh@394 -- # return 1 00:32:30.014 14:36:44 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:30.014 14:36:44 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:30.014 14:36:44 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:30.014 14:36:44 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:30.014 14:36:44 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:30.014 14:36:44 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:30.014 14:36:44 -- nvmf/common.sh@654 -- # echo 1 00:32:30.014 14:36:44 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:30.014 14:36:44 -- nvmf/common.sh@656 -- # echo 1 00:32:30.014 14:36:44 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:30.014 14:36:44 -- nvmf/common.sh@663 -- # echo tcp 00:32:30.014 14:36:44 -- nvmf/common.sh@664 -- # echo 4420 00:32:30.014 14:36:44 -- nvmf/common.sh@665 -- # echo ipv4 00:32:30.014 14:36:44 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:30.014 14:36:44 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:80b56b8f-cbc7-e911-906e-0017a4403562 --hostid=80b56b8f-cbc7-e911-906e-0017a4403562 -a 10.0.0.1 -t tcp -s 4420 00:32:30.014 00:32:30.014 Discovery Log Number of Records 2, Generation counter 2 00:32:30.014 =====Discovery Log Entry 0====== 00:32:30.014 trtype: tcp 00:32:30.014 adrfam: ipv4 00:32:30.014 subtype: current discovery subsystem 00:32:30.014 treq: not specified, sq flow control disable supported 00:32:30.014 portid: 1 00:32:30.014 trsvcid: 4420 00:32:30.014 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:30.014 traddr: 10.0.0.1 00:32:30.014 eflags: none 00:32:30.014 sectype: none 00:32:30.014 =====Discovery Log Entry 1====== 00:32:30.014 trtype: tcp 00:32:30.014 adrfam: ipv4 00:32:30.014 subtype: nvme subsystem 00:32:30.014 treq: not specified, sq flow control disable supported 00:32:30.014 portid: 1 00:32:30.014 trsvcid: 4420 00:32:30.014 subnqn: kernel_target 00:32:30.014 traddr: 10.0.0.1 00:32:30.014 eflags: none 00:32:30.014 sectype: none 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:30.014 14:36:44 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:30.014 EAL: No free 2048 kB hugepages reported on node 1 00:32:33.302 Initializing NVMe Controllers 00:32:33.302 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:33.302 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:33.302 Initialization complete. Launching workers. 00:32:33.302 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 94590, failed: 0 00:32:33.302 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 94590, failed to submit 0 00:32:33.302 success 0, unsuccess 94590, failed 0 00:32:33.302 14:36:47 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:33.302 14:36:47 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:33.302 EAL: No free 2048 kB hugepages reported on node 1 00:32:36.590 Initializing NVMe Controllers 00:32:36.590 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:36.590 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:36.590 Initialization complete. Launching workers. 00:32:36.590 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 148582, failed: 0 00:32:36.590 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 37246, failed to submit 111336 00:32:36.590 success 0, unsuccess 37246, failed 0 00:32:36.590 14:36:50 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:36.590 14:36:50 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:36.590 EAL: No free 2048 kB hugepages reported on node 1 00:32:39.878 Initializing NVMe Controllers 00:32:39.878 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:39.878 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:39.878 Initialization complete. Launching workers. 00:32:39.878 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 143924, failed: 0 00:32:39.878 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 36046, failed to submit 107878 00:32:39.878 success 0, unsuccess 36046, failed 0 00:32:39.878 14:36:53 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:39.878 14:36:53 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:39.878 14:36:53 -- nvmf/common.sh@677 -- # echo 0 00:32:39.878 14:36:53 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:39.878 14:36:53 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:39.878 14:36:53 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:39.878 14:36:53 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:39.878 14:36:53 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:39.878 14:36:53 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:39.878 00:32:39.878 real 0m13.339s 00:32:39.878 user 0m7.735s 00:32:39.878 sys 0m2.918s 00:32:39.878 14:36:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:39.878 14:36:53 -- common/autotest_common.sh@10 -- # set +x 00:32:39.878 ************************************ 00:32:39.878 END TEST kernel_target_abort 00:32:39.878 ************************************ 00:32:39.878 14:36:53 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:39.879 14:36:53 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:39.879 14:36:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:39.879 14:36:53 -- nvmf/common.sh@116 -- # sync 00:32:39.879 14:36:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:39.879 14:36:53 -- nvmf/common.sh@119 -- # set +e 00:32:39.879 14:36:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:39.879 14:36:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:39.879 rmmod nvme_tcp 00:32:39.879 rmmod nvme_fabrics 00:32:39.879 rmmod nvme_keyring 00:32:39.879 14:36:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:39.879 14:36:53 -- nvmf/common.sh@123 -- # set -e 00:32:39.879 14:36:53 -- nvmf/common.sh@124 -- # return 0 00:32:39.879 14:36:53 -- nvmf/common.sh@477 -- # '[' -n 585400 ']' 00:32:39.879 14:36:53 -- nvmf/common.sh@478 -- # killprocess 585400 00:32:39.879 14:36:53 -- common/autotest_common.sh@936 -- # '[' -z 585400 ']' 00:32:39.879 14:36:53 -- common/autotest_common.sh@940 -- # kill -0 585400 00:32:39.879 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (585400) - No such process 00:32:39.879 14:36:53 -- common/autotest_common.sh@963 -- # echo 'Process with pid 585400 is not found' 00:32:39.879 Process with pid 585400 is not found 00:32:39.879 14:36:53 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:39.879 14:36:53 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:42.413 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:32:42.413 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:32:42.413 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:32:42.413 14:36:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:42.413 14:36:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:42.413 14:36:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:42.413 14:36:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:42.413 14:36:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:42.413 14:36:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:42.413 14:36:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:44.949 14:36:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:44.949 00:32:44.949 real 0m43.134s 00:32:44.949 user 1m8.014s 00:32:44.949 sys 0m13.419s 00:32:44.949 14:36:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:44.949 14:36:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.949 ************************************ 00:32:44.949 END TEST nvmf_abort_qd_sizes 00:32:44.949 ************************************ 00:32:44.949 14:36:58 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:32:44.949 14:36:58 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:32:44.949 14:36:58 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:32:44.949 14:36:58 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:32:44.949 14:36:58 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:32:44.949 14:36:58 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:32:44.949 14:36:58 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:32:44.949 14:36:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:44.949 14:36:58 -- common/autotest_common.sh@10 -- # set +x 00:32:44.949 14:36:59 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:32:44.949 14:36:59 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:32:44.949 14:36:59 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:32:44.949 14:36:59 -- common/autotest_common.sh@10 -- # set +x 00:32:49.140 INFO: APP EXITING 00:32:49.140 INFO: killing all VMs 00:32:49.140 INFO: killing vhost app 00:32:49.140 INFO: EXIT DONE 00:32:51.674 0000:5e:00.0 (8086 0a54): Already using the nvme driver 00:32:51.674 0000:00:04.7 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:00:04.6 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:00:04.5 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:00:04.4 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:00:04.3 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:00:04.2 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:00:04.1 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:00:04.0 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:80:04.7 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:80:04.6 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:80:04.5 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:80:04.4 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:80:04.3 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:80:04.2 (8086 2021): Already using the ioatdma driver 00:32:51.933 0000:80:04.1 (8086 2021): Already using the ioatdma driver 00:32:52.193 0000:80:04.0 (8086 2021): Already using the ioatdma driver 00:32:54.729 Cleaning 00:32:54.729 Removing: /var/run/dpdk/spdk0/config 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:32:54.729 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:32:54.729 Removing: /var/run/dpdk/spdk0/hugepage_info 00:32:54.729 Removing: /var/run/dpdk/spdk1/config 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:32:54.729 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:32:54.729 Removing: /var/run/dpdk/spdk1/hugepage_info 00:32:54.729 Removing: /var/run/dpdk/spdk1/mp_socket 00:32:54.729 Removing: /var/run/dpdk/spdk2/config 00:32:54.729 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:32:54.729 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:32:54.729 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:32:54.729 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:32:54.729 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:32:54.729 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:32:54.729 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:32:54.988 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:32:54.988 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:32:54.988 Removing: /var/run/dpdk/spdk2/hugepage_info 00:32:54.988 Removing: /var/run/dpdk/spdk3/config 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:32:54.988 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:32:54.988 Removing: /var/run/dpdk/spdk3/hugepage_info 00:32:54.988 Removing: /var/run/dpdk/spdk4/config 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:32:54.989 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:32:54.989 Removing: /var/run/dpdk/spdk4/hugepage_info 00:32:54.989 Removing: /dev/shm/bdev_svc_trace.1 00:32:54.989 Removing: /dev/shm/nvmf_trace.0 00:32:54.989 Removing: /dev/shm/spdk_tgt_trace.pid193079 00:32:54.989 Removing: /var/run/dpdk/spdk0 00:32:54.989 Removing: /var/run/dpdk/spdk1 00:32:54.989 Removing: /var/run/dpdk/spdk2 00:32:54.989 Removing: /var/run/dpdk/spdk3 00:32:54.989 Removing: /var/run/dpdk/spdk4 00:32:54.989 Removing: /var/run/dpdk/spdk_pid190976 00:32:54.989 Removing: /var/run/dpdk/spdk_pid192018 00:32:54.989 Removing: /var/run/dpdk/spdk_pid193079 00:32:54.989 Removing: /var/run/dpdk/spdk_pid193761 00:32:54.989 Removing: /var/run/dpdk/spdk_pid195395 00:32:54.989 Removing: /var/run/dpdk/spdk_pid196796 00:32:54.989 Removing: /var/run/dpdk/spdk_pid197147 00:32:54.989 Removing: /var/run/dpdk/spdk_pid197438 00:32:54.989 Removing: /var/run/dpdk/spdk_pid197746 00:32:54.989 Removing: /var/run/dpdk/spdk_pid198241 00:32:54.989 Removing: /var/run/dpdk/spdk_pid198672 00:32:54.989 Removing: /var/run/dpdk/spdk_pid198918 00:32:54.989 Removing: /var/run/dpdk/spdk_pid199204 00:32:54.989 Removing: /var/run/dpdk/spdk_pid200159 00:32:54.989 Removing: /var/run/dpdk/spdk_pid203129 00:32:54.989 Removing: /var/run/dpdk/spdk_pid203477 00:32:54.989 Removing: /var/run/dpdk/spdk_pid203826 00:32:54.989 Removing: /var/run/dpdk/spdk_pid203871 00:32:54.989 Removing: /var/run/dpdk/spdk_pid204361 00:32:54.989 Removing: /var/run/dpdk/spdk_pid204589 00:32:54.989 Removing: /var/run/dpdk/spdk_pid205007 00:32:54.989 Removing: /var/run/dpdk/spdk_pid205087 00:32:54.989 Removing: /var/run/dpdk/spdk_pid205354 00:32:54.989 Removing: /var/run/dpdk/spdk_pid205578 00:32:54.989 Removing: /var/run/dpdk/spdk_pid205831 00:32:54.989 Removing: /var/run/dpdk/spdk_pid205906 00:32:54.989 Removing: /var/run/dpdk/spdk_pid206402 00:32:54.989 Removing: /var/run/dpdk/spdk_pid206644 00:32:54.989 Removing: /var/run/dpdk/spdk_pid206943 00:32:54.989 Removing: /var/run/dpdk/spdk_pid207201 00:32:54.989 Removing: /var/run/dpdk/spdk_pid207325 00:32:54.989 Removing: /var/run/dpdk/spdk_pid207496 00:32:54.989 Removing: /var/run/dpdk/spdk_pid207724 00:32:54.989 Removing: /var/run/dpdk/spdk_pid207971 00:32:54.989 Removing: /var/run/dpdk/spdk_pid208205 00:32:54.989 Removing: /var/run/dpdk/spdk_pid208448 00:32:54.989 Removing: /var/run/dpdk/spdk_pid208682 00:32:55.248 Removing: /var/run/dpdk/spdk_pid208923 00:32:55.248 Removing: /var/run/dpdk/spdk_pid209154 00:32:55.248 Removing: /var/run/dpdk/spdk_pid209401 00:32:55.248 Removing: /var/run/dpdk/spdk_pid209629 00:32:55.248 Removing: /var/run/dpdk/spdk_pid209870 00:32:55.248 Removing: /var/run/dpdk/spdk_pid210105 00:32:55.248 Removing: /var/run/dpdk/spdk_pid210352 00:32:55.248 Removing: /var/run/dpdk/spdk_pid210579 00:32:55.248 Removing: /var/run/dpdk/spdk_pid210828 00:32:55.248 Removing: /var/run/dpdk/spdk_pid211057 00:32:55.248 Removing: /var/run/dpdk/spdk_pid211300 00:32:55.248 Removing: /var/run/dpdk/spdk_pid211532 00:32:55.248 Removing: /var/run/dpdk/spdk_pid211777 00:32:55.248 Removing: /var/run/dpdk/spdk_pid212004 00:32:55.248 Removing: /var/run/dpdk/spdk_pid212253 00:32:55.248 Removing: /var/run/dpdk/spdk_pid212483 00:32:55.248 Removing: /var/run/dpdk/spdk_pid212734 00:32:55.248 Removing: /var/run/dpdk/spdk_pid212968 00:32:55.248 Removing: /var/run/dpdk/spdk_pid213209 00:32:55.248 Removing: /var/run/dpdk/spdk_pid213437 00:32:55.248 Removing: /var/run/dpdk/spdk_pid213687 00:32:55.248 Removing: /var/run/dpdk/spdk_pid213915 00:32:55.248 Removing: /var/run/dpdk/spdk_pid214156 00:32:55.248 Removing: /var/run/dpdk/spdk_pid214392 00:32:55.248 Removing: /var/run/dpdk/spdk_pid214635 00:32:55.248 Removing: /var/run/dpdk/spdk_pid214867 00:32:55.248 Removing: /var/run/dpdk/spdk_pid215114 00:32:55.248 Removing: /var/run/dpdk/spdk_pid215347 00:32:55.248 Removing: /var/run/dpdk/spdk_pid215593 00:32:55.248 Removing: /var/run/dpdk/spdk_pid215828 00:32:55.248 Removing: /var/run/dpdk/spdk_pid216077 00:32:55.248 Removing: /var/run/dpdk/spdk_pid216303 00:32:55.248 Removing: /var/run/dpdk/spdk_pid216552 00:32:55.248 Removing: /var/run/dpdk/spdk_pid216778 00:32:55.248 Removing: /var/run/dpdk/spdk_pid217035 00:32:55.248 Removing: /var/run/dpdk/spdk_pid217311 00:32:55.248 Removing: /var/run/dpdk/spdk_pid217621 00:32:55.248 Removing: /var/run/dpdk/spdk_pid221262 00:32:55.248 Removing: /var/run/dpdk/spdk_pid304259 00:32:55.248 Removing: /var/run/dpdk/spdk_pid308459 00:32:55.248 Removing: /var/run/dpdk/spdk_pid319163 00:32:55.248 Removing: /var/run/dpdk/spdk_pid324503 00:32:55.248 Removing: /var/run/dpdk/spdk_pid328460 00:32:55.248 Removing: /var/run/dpdk/spdk_pid328932 00:32:55.248 Removing: /var/run/dpdk/spdk_pid337579 00:32:55.248 Removing: /var/run/dpdk/spdk_pid337830 00:32:55.248 Removing: /var/run/dpdk/spdk_pid342046 00:32:55.248 Removing: /var/run/dpdk/spdk_pid347849 00:32:55.248 Removing: /var/run/dpdk/spdk_pid350484 00:32:55.248 Removing: /var/run/dpdk/spdk_pid360707 00:32:55.248 Removing: /var/run/dpdk/spdk_pid370251 00:32:55.248 Removing: /var/run/dpdk/spdk_pid371910 00:32:55.248 Removing: /var/run/dpdk/spdk_pid372931 00:32:55.248 Removing: /var/run/dpdk/spdk_pid389635 00:32:55.248 Removing: /var/run/dpdk/spdk_pid393388 00:32:55.248 Removing: /var/run/dpdk/spdk_pid397845 00:32:55.248 Removing: /var/run/dpdk/spdk_pid399432 00:32:55.248 Removing: /var/run/dpdk/spdk_pid401368 00:32:55.248 Removing: /var/run/dpdk/spdk_pid401568 00:32:55.248 Removing: /var/run/dpdk/spdk_pid401754 00:32:55.248 Removing: /var/run/dpdk/spdk_pid401965 00:32:55.248 Removing: /var/run/dpdk/spdk_pid402694 00:32:55.248 Removing: /var/run/dpdk/spdk_pid404513 00:32:55.248 Removing: /var/run/dpdk/spdk_pid405507 00:32:55.248 Removing: /var/run/dpdk/spdk_pid406001 00:32:55.248 Removing: /var/run/dpdk/spdk_pid411561 00:32:55.248 Removing: /var/run/dpdk/spdk_pid417605 00:32:55.248 Removing: /var/run/dpdk/spdk_pid422556 00:32:55.507 Removing: /var/run/dpdk/spdk_pid459190 00:32:55.507 Removing: /var/run/dpdk/spdk_pid463338 00:32:55.507 Removing: /var/run/dpdk/spdk_pid469256 00:32:55.507 Removing: /var/run/dpdk/spdk_pid470556 00:32:55.507 Removing: /var/run/dpdk/spdk_pid471918 00:32:55.507 Removing: /var/run/dpdk/spdk_pid476349 00:32:55.507 Removing: /var/run/dpdk/spdk_pid480332 00:32:55.507 Removing: /var/run/dpdk/spdk_pid487688 00:32:55.507 Removing: /var/run/dpdk/spdk_pid487811 00:32:55.507 Removing: /var/run/dpdk/spdk_pid492307 00:32:55.507 Removing: /var/run/dpdk/spdk_pid492520 00:32:55.507 Removing: /var/run/dpdk/spdk_pid492747 00:32:55.507 Removing: /var/run/dpdk/spdk_pid493194 00:32:55.507 Removing: /var/run/dpdk/spdk_pid493200 00:32:55.507 Removing: /var/run/dpdk/spdk_pid494583 00:32:55.507 Removing: /var/run/dpdk/spdk_pid496259 00:32:55.507 Removing: /var/run/dpdk/spdk_pid498455 00:32:55.507 Removing: /var/run/dpdk/spdk_pid500080 00:32:55.507 Removing: /var/run/dpdk/spdk_pid501667 00:32:55.507 Removing: /var/run/dpdk/spdk_pid503441 00:32:55.507 Removing: /var/run/dpdk/spdk_pid509272 00:32:55.507 Removing: /var/run/dpdk/spdk_pid509836 00:32:55.507 Removing: /var/run/dpdk/spdk_pid511570 00:32:55.507 Removing: /var/run/dpdk/spdk_pid512599 00:32:55.507 Removing: /var/run/dpdk/spdk_pid518367 00:32:55.507 Removing: /var/run/dpdk/spdk_pid521125 00:32:55.507 Removing: /var/run/dpdk/spdk_pid526556 00:32:55.507 Removing: /var/run/dpdk/spdk_pid532212 00:32:55.507 Removing: /var/run/dpdk/spdk_pid537950 00:32:55.507 Removing: /var/run/dpdk/spdk_pid538890 00:32:55.507 Removing: /var/run/dpdk/spdk_pid539580 00:32:55.507 Removing: /var/run/dpdk/spdk_pid540187 00:32:55.507 Removing: /var/run/dpdk/spdk_pid541007 00:32:55.507 Removing: /var/run/dpdk/spdk_pid541648 00:32:55.507 Removing: /var/run/dpdk/spdk_pid542189 00:32:55.507 Removing: /var/run/dpdk/spdk_pid542862 00:32:55.507 Removing: /var/run/dpdk/spdk_pid547079 00:32:55.507 Removing: /var/run/dpdk/spdk_pid547423 00:32:55.507 Removing: /var/run/dpdk/spdk_pid553318 00:32:55.507 Removing: /var/run/dpdk/spdk_pid553581 00:32:55.507 Removing: /var/run/dpdk/spdk_pid555774 00:32:55.507 Removing: /var/run/dpdk/spdk_pid563439 00:32:55.507 Removing: /var/run/dpdk/spdk_pid563444 00:32:55.507 Removing: /var/run/dpdk/spdk_pid568432 00:32:55.507 Removing: /var/run/dpdk/spdk_pid570381 00:32:55.507 Removing: /var/run/dpdk/spdk_pid572369 00:32:55.507 Removing: /var/run/dpdk/spdk_pid573577 00:32:55.507 Removing: /var/run/dpdk/spdk_pid575535 00:32:55.507 Removing: /var/run/dpdk/spdk_pid576796 00:32:55.507 Removing: /var/run/dpdk/spdk_pid586015 00:32:55.507 Removing: /var/run/dpdk/spdk_pid586474 00:32:55.507 Removing: /var/run/dpdk/spdk_pid587133 00:32:55.507 Removing: /var/run/dpdk/spdk_pid589391 00:32:55.507 Removing: /var/run/dpdk/spdk_pid589856 00:32:55.507 Removing: /var/run/dpdk/spdk_pid590317 00:32:55.507 Clean 00:32:55.766 killing process with pid 147227 00:33:03.886 killing process with pid 147224 00:33:03.886 killing process with pid 147226 00:33:03.886 killing process with pid 147225 00:33:03.886 14:37:17 -- common/autotest_common.sh@1446 -- # return 0 00:33:03.886 14:37:17 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:03.886 14:37:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:03.886 14:37:17 -- common/autotest_common.sh@10 -- # set +x 00:33:03.886 14:37:17 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:03.886 14:37:17 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:03.886 14:37:17 -- common/autotest_common.sh@10 -- # set +x 00:33:03.886 14:37:17 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:03.886 14:37:17 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:03.886 14:37:17 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:03.886 14:37:17 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:03.887 14:37:17 -- spdk/autotest.sh@383 -- # hostname 00:33:03.887 14:37:17 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-wfp-04 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:03.887 geninfo: WARNING: invalid characters removed from testname! 00:33:21.976 14:37:35 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:23.354 14:37:37 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:25.259 14:37:39 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:26.637 14:37:41 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:28.542 14:37:42 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:29.920 14:37:44 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:31.297 14:37:45 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:33:31.297 14:37:45 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:33:31.297 14:37:45 -- common/autotest_common.sh@1690 -- $ lcov --version 00:33:31.297 14:37:45 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:33:31.560 14:37:45 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:33:31.560 14:37:45 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:33:31.560 14:37:45 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:33:31.560 14:37:45 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:33:31.560 14:37:45 -- scripts/common.sh@335 -- $ IFS=.-: 00:33:31.560 14:37:45 -- scripts/common.sh@335 -- $ read -ra ver1 00:33:31.560 14:37:45 -- scripts/common.sh@336 -- $ IFS=.-: 00:33:31.560 14:37:45 -- scripts/common.sh@336 -- $ read -ra ver2 00:33:31.560 14:37:45 -- scripts/common.sh@337 -- $ local 'op=<' 00:33:31.560 14:37:45 -- scripts/common.sh@339 -- $ ver1_l=2 00:33:31.560 14:37:45 -- scripts/common.sh@340 -- $ ver2_l=1 00:33:31.560 14:37:45 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:33:31.560 14:37:45 -- scripts/common.sh@343 -- $ case "$op" in 00:33:31.560 14:37:45 -- scripts/common.sh@344 -- $ : 1 00:33:31.560 14:37:45 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:33:31.560 14:37:45 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:33:31.560 14:37:45 -- scripts/common.sh@364 -- $ decimal 1 00:33:31.560 14:37:45 -- scripts/common.sh@352 -- $ local d=1 00:33:31.560 14:37:45 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:33:31.560 14:37:45 -- scripts/common.sh@354 -- $ echo 1 00:33:31.560 14:37:45 -- scripts/common.sh@364 -- $ ver1[v]=1 00:33:31.560 14:37:45 -- scripts/common.sh@365 -- $ decimal 2 00:33:31.560 14:37:45 -- scripts/common.sh@352 -- $ local d=2 00:33:31.560 14:37:45 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:33:31.560 14:37:45 -- scripts/common.sh@354 -- $ echo 2 00:33:31.560 14:37:45 -- scripts/common.sh@365 -- $ ver2[v]=2 00:33:31.560 14:37:45 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:33:31.560 14:37:45 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:33:31.560 14:37:45 -- scripts/common.sh@367 -- $ return 0 00:33:31.560 14:37:45 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:33:31.560 14:37:45 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:33:31.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:31.560 --rc genhtml_branch_coverage=1 00:33:31.560 --rc genhtml_function_coverage=1 00:33:31.560 --rc genhtml_legend=1 00:33:31.560 --rc geninfo_all_blocks=1 00:33:31.560 --rc geninfo_unexecuted_blocks=1 00:33:31.560 00:33:31.560 ' 00:33:31.560 14:37:45 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:33:31.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:31.560 --rc genhtml_branch_coverage=1 00:33:31.560 --rc genhtml_function_coverage=1 00:33:31.560 --rc genhtml_legend=1 00:33:31.560 --rc geninfo_all_blocks=1 00:33:31.560 --rc geninfo_unexecuted_blocks=1 00:33:31.560 00:33:31.560 ' 00:33:31.560 14:37:45 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:33:31.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:31.560 --rc genhtml_branch_coverage=1 00:33:31.560 --rc genhtml_function_coverage=1 00:33:31.560 --rc genhtml_legend=1 00:33:31.560 --rc geninfo_all_blocks=1 00:33:31.560 --rc geninfo_unexecuted_blocks=1 00:33:31.560 00:33:31.560 ' 00:33:31.560 14:37:45 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:33:31.560 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:33:31.560 --rc genhtml_branch_coverage=1 00:33:31.560 --rc genhtml_function_coverage=1 00:33:31.560 --rc genhtml_legend=1 00:33:31.560 --rc geninfo_all_blocks=1 00:33:31.560 --rc geninfo_unexecuted_blocks=1 00:33:31.560 00:33:31.560 ' 00:33:31.560 14:37:45 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:33:31.560 14:37:45 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:33:31.560 14:37:45 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:33:31.560 14:37:45 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:33:31.561 14:37:45 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:31.561 14:37:45 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:31.561 14:37:45 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:31.561 14:37:45 -- paths/export.sh@5 -- $ export PATH 00:33:31.561 14:37:45 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:33:31.561 14:37:45 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:33:31.561 14:37:45 -- common/autobuild_common.sh@440 -- $ date +%s 00:33:31.561 14:37:45 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1734356265.XXXXXX 00:33:31.561 14:37:45 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1734356265.3DlLue 00:33:31.561 14:37:45 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:33:31.561 14:37:45 -- common/autobuild_common.sh@446 -- $ '[' -n '' ']' 00:33:31.561 14:37:45 -- common/autobuild_common.sh@449 -- $ scanbuild_exclude='--exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/' 00:33:31.561 14:37:45 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:33:31.561 14:37:45 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/dpdk/ --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:33:31.561 14:37:45 -- common/autobuild_common.sh@456 -- $ get_config_params 00:33:31.561 14:37:45 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:33:31.561 14:37:45 -- common/autotest_common.sh@10 -- $ set +x 00:33:31.561 14:37:45 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk' 00:33:31.561 14:37:45 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j96 00:33:31.561 14:37:45 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:31.561 14:37:45 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:33:31.561 14:37:45 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:33:31.561 14:37:45 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:33:31.561 14:37:45 -- spdk/autopackage.sh@19 -- $ timing_finish 00:33:31.561 14:37:45 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:33:31.561 14:37:45 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:33:31.561 14:37:45 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:31.561 14:37:45 -- spdk/autopackage.sh@20 -- $ exit 0 00:33:31.561 + [[ -n 104375 ]] 00:33:31.561 + sudo kill 104375 00:33:31.658 [Pipeline] } 00:33:31.672 [Pipeline] // stage 00:33:31.676 [Pipeline] } 00:33:31.689 [Pipeline] // timeout 00:33:31.694 [Pipeline] } 00:33:31.707 [Pipeline] // catchError 00:33:31.712 [Pipeline] } 00:33:31.726 [Pipeline] // wrap 00:33:31.731 [Pipeline] } 00:33:31.744 [Pipeline] // catchError 00:33:31.753 [Pipeline] stage 00:33:31.755 [Pipeline] { (Epilogue) 00:33:31.767 [Pipeline] catchError 00:33:31.769 [Pipeline] { 00:33:31.781 [Pipeline] echo 00:33:31.783 Cleanup processes 00:33:31.789 [Pipeline] sh 00:33:32.247 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:32.247 603609 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:32.262 [Pipeline] sh 00:33:32.548 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:33:32.548 ++ grep -v 'sudo pgrep' 00:33:32.548 ++ awk '{print $1}' 00:33:32.548 + sudo kill -9 00:33:32.548 + true 00:33:32.560 [Pipeline] sh 00:33:32.844 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:33:45.068 [Pipeline] sh 00:33:45.353 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:33:45.353 Artifacts sizes are good 00:33:45.367 [Pipeline] archiveArtifacts 00:33:45.374 Archiving artifacts 00:33:45.525 [Pipeline] sh 00:33:45.810 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:33:45.825 [Pipeline] cleanWs 00:33:45.835 [WS-CLEANUP] Deleting project workspace... 00:33:45.835 [WS-CLEANUP] Deferred wipeout is used... 00:33:45.842 [WS-CLEANUP] done 00:33:45.844 [Pipeline] } 00:33:45.861 [Pipeline] // catchError 00:33:45.873 [Pipeline] sh 00:33:46.157 + logger -p user.info -t JENKINS-CI 00:33:46.166 [Pipeline] } 00:33:46.179 [Pipeline] // stage 00:33:46.184 [Pipeline] } 00:33:46.198 [Pipeline] // node 00:33:46.204 [Pipeline] End of Pipeline 00:33:46.245 Finished: SUCCESS